Today we’re faced with both a growing number of ways to test new software and a growing number of tools to accomplish those tests. And who really has time to keep track of the hundreds (and counting) of tools out there? Fortunately for you, we do. Use the navigation to the right to jump to different testing tool categories.
Before you get lost in the deep indexes of Google trying to figure out the best software testing tools for your needs, take a look at this trusty list developed by the software testing experts here at QASymphony.
Here’s what you can expect:
There are 102 software testing tools and 8 categories all with the following information:
Summary of the testing tool
UI Screen Shots
Key Features
What you need to know
Links to customer reviews (where applicable)
Pricing (if available)
We’ve broken down our recommendations into 8 categories, plus a bonus section with up and coming tools to keep an eye on.
Test Automation
ity Testing
Bug Tracking
Performance Testing
Test Setup & Infrastructure
Niche Testing
Test Management
Mobile Testing
Up & Coming Testing Tools
Extra: Need even more help narrowing your search? Check out our enterprise guide to evaluating software testing tools for best practices to ensure a successful evaluation.
Test Automation Tools
Test automation is one of the most mature software testing segments. Currently, the rise of good open source options and the push toward DevOps and multichannel models are transforming this segment.
We can break down test automation tools into two subcategories:
Functional testing
Integration/API testing
Functional Software Testing Tools
Why use Functional Testing tools? Functional Testing tools drive automated tests by interacting with the UI layer of an application. These tools usually provide a record and playback interface, making it easier for nontechnical testers to provide automation coverage. However, these tests can be slow and brittle.
1. HP Unified Functional Testing (UFT)
Summary: Previously known as QuickTest Professional (QTP), HP UFT automates GUI functionality and back-end service testing. It also offers reusable test components, helps convert manual testing assets into automated ones, embraces the shift left to make testing part of the Agile development cycle and allows for testing across multiple machines and devices.
Features:
Strong partner network
Increasing support for newer browsers and mobile (though HP does fall behind other market leaders)
Integrated offering that includes other test tools
What you really need to know: Although HP remains the market share leader in paid test automation, it has recently struggled to focus on newer platforms, ceding ground to competitors.
For more information: Check out the HP UFT site
Reviews: Checkout UTF reviews over at ITCentralStation.com
Pricing: Plans start at $600 per month with three pricing tiers. Visit their pricing page to learn more.
2. IBM Rational Functional Tester
Summary: Part of IBM’s larger Rational testing platform, the Rational Functional Tester uses data-driven testing to automate functional and regression testing. It supports a variety of applications and allows for both storyboard testing and test scripting.
Features:
Integrated offering that includes other test tools
Supports legacy platforms and frameworks
Offers mature and dependable tools
What you really need to know: Once a true market leader, IBM has had to focus on standing its ground against rising competition from HP and up and coming players in recent years.
For more information: Check out the IBM Rational Functional Testing site.
Reviews: Checkout a few reviews over at TrustRadius.com and ITCentralStation.com.
Pricing: Plans start at $3,400 per month with 6 pricing tiers. Visit their pricing page to learn more.
3. Tricentis Tosca Testsuite
Summary: Provides model-based test automation focused on test case design versus problem solving. The Tosca Testsuite also offers end-to-end testing and recording capabilities.
Features:
Offers support for Agile
Includes a more complete set of tools around test data management and Orchestration
Delivers model-based automation support that allows for easier reuse/less maintenance
What you really need to know: With the Tosca Testsuite, Tricentis has focused on creating model-based automation and a “mini-suite” that goes beyond pure test automation to provide risk coverage and test case design as well.
For more information: Check out the Tricentis test-automation site.
Reviews: Head over to ITCentralStation.com or G2Crowd.com to read reviews.
4. Worksoft Certify
Summary: Automates functional testing of business processes across the entire application landscape. Worksoft Certify offers capabilities around discovery, validation, measurement, compliance and scale.
Features:
Takes a scriptless approach
Compatible with package software as well as custom built code/extensions
Easy to use
Well supported
What you really need to know: Although Certify works with a wide variety of applications and custom built code/extensions, it’s focus is on supporting package software like SAP, Oracle, Salesforce, etc.
For more information: Checkout Worksoft Certify automated business process testing.
Reviews: Checkout reviews at ITCentralStation.com.
5. TestPlant eggPlant Functional
Summary: An automated functional testing tool that uses an image-based approach, which looks at the screen of any device the same way a user would. This image-based UI testing differs from the traditional approach because it tests from the perspective of a user rather than by looking at code. eggPlant Functional works across all device types.
Features:
Allows for reuse of functional automation for performance testing
Fast development
Offers lab management and CI integration
Supports all major platforms including web, mobile, POS systems – anything behind a pane of glass
What you really need to know: eggPlant Functional’s use of an image-based approach to automation can help solve complex automation problems. Their approach allows testers with little to no automation skills to achieve robust automation overage and for teams that have struggled to implement automation, its a way to get over the hump.
For more information: Checkout eggPlant Functionals automated mobile & desktop UI testing site.
Reviews: Head over to ITCentralStation.com to read a couple reviews.
Pricing: No prices listed, but view licensing and pricing information here.
6. Ranorex
Summary: Allows for setup and execution of test automation scripts and offers GUI object recognition, reusable code modules and record/play back functionality. Ranorex also offers script-free functionality.
Features:
Developer-friendly
Delivers strong object recognition
Offers a straightforward and affordable pricing model
What you really need to know: Ranorex provides similar functionality to integrated suite vendors with lower cost licenses and maintenance.
For more information: Checkout the Ranorex functional test automation site.
Reviews: G2Crowd.com and ITCentralStation.com have a good amount of reviews.
Pricing: Plans start at € 1,990 per license with 2 pricing tiers. Visit their pricing page to learn more.
Integration/API Software Testing Tools
Integration/API testing tools send various types of payloads through APIs to make sure they accept valid inputs and reject improper ones with proper messages.
Some of these software testing tools can also provide testing for load. Integration/API testing is especially important for cloud, mobile and PaaS. Let’s look at a handful of Integration/API testing tools to consider:
1. CA Technologies Application Test
Summary: Uses a declarative workflow model that focuses on building tests over scripting. CA Application Test embraces the shift left by allowing for API testing before UI development. It also offers automated mobile testing, visual tests, customized load testing and advanced analytics.
Features:
Allows for integration of mobile testing
Integrates with Selenium for improved visual editing
Offers robust mainframe support
Allows for reuse of LISA test cases and infrastructure
Creates a load on an internal network with few resources
What you really need to know: CA Technologies is mostly focused on competing in the mainframe space and testing desktop applications and complex infrastructure using LISA.
For more information: Checkout the CA Application Test website.
2. IBM Rational Test Workbench
Summary: A comprehensive test automation tool with integration testing capabilities as well as mobile, regression, performance and scalability testing capabilities. In terms of integration testing, IBM Rational Test Workbench allows for service-level testing, automatic scheduling and execution of testing via an integration with the IBM Rational collaborative lifecycle management tool.
Features:
Allows for continuous integration testing
Integrates with the larger IBM Rational testing suite for expanded capabilities
Provides lifecycle collaboration
Supports automaton
What you really need to know: IBM Rational Test Workbench provides a complete set of enterprise-ready testing tools that cover testing needs throughout the development lifecycle.
For more information: Checkout the Rational Test Workbench automation solution for load and integration testing.
Pricing: Plans start at $3,730 per year with 12 pricing tiers.
3. Parasoft SOAtest
Summary: Provides test automation for end-to-end scenarios across multiple endpoints with support for REST, web services and over 120 protocols/message types. Parasoft SOAtest creates extensible and reusable tests. In addition to API testing, it also offers SOA testing, web and performance testing, web UI testing, runtime error testing, API security testing, service virtualization and development testing.
Features:
Offers capabilities beyond integration/API testing
Supports a wide selection of messaging/protocols
What you really need to know: Parasoft SOAtest offers automated API testing as well as several other testing capabilities. Its most unique feature is the extensive list of environments, including protocols, platforms and messaging formats, that it supports.
For more information: Checkout Parasofts SOAtest API testing solution.
Reviews: Read a few reviews of SOAtest at ITCentralStation.com
4. SmartBear Ready! API
Summary: A complete API testing platform with support for API functional testing, API load testing, API security testing, service virtualization, API testing in code, API performance management and defining, building and managing APIS. SmartBear Ready! API provides project management, metrics and reporting, script support, discovery and continuous integration across all of these API testing capabilities.
Features:
Provides a wide variety of API testing capabilities
Supports continuous integration
What you really need to know: SmartBear Ready! API is a comprehensive API testing tool that covers API testing across functional, performance and post-deployment testing. It also integrates with the larger SmartBear testing environment.
For more information: Checkout SmartBears Ready! API testing tool.
5. Crosscheck Networks SOAPSonar
Summary: Provides API service testing, API emulation and virtualization and API security gateway technologies. Crosscheck Networks uses a dynamic mutation technology to deliver functional automation, performance and security testing. It also offers API simulated behavior modeling with support for a variety of protocols and messages.
Features:
Provides virtualization and security testing as well as API service testing
Supports a variety of protocols and messages, including JSON, REST and SOAP
What you really need to know: Crosscheck Networks SOAPSonar offers a variety of API testing capabilities, although it emphasizes functional, performance and security testing for service endpoints. It runs these tests using a patented mutation technology.
For more information: Checkout CrossCheck Service Testing.
Pricing: Plans start at $799 per year with 2 pricing tiers. Request pricing here.
Open Source Integration testing tools:
There are also several open source options for integration and API testing. If you decide to go the open source route, consider these tools:
Tool
Capability
Apache JMeter
API Testing
SoapUI
API Testing
PowerMock
Object Mocking
EasyMock
Object Mocking
REST Assured
API Testing
WebInject
API Testing
Mockito
Object Mocking
Jmockit
Object Mocking
mocktail
Object Mocking
WireMock
Object Mocking
Betamax
Object Mocking
Mockserver
Object Mocking
Performance Testing Tools
Performance testing tools take a simple automation script and run it through hundreds or thousands of machines to simulate how an application will perform under load.
These tests are typically expensive and are run less frequently than functional automation tests. Performance testing is particularly important for cloud applications and there are two main types to consider:
Pure Play
Extension Tools
This list represents both pure play and extension tools, each of which has its pros and cons. Here’s what you need to know about the difference between the two types of tools:
Pure Play Performance Testing Tools
Pros:
Typically cheaper
Creates less friction during purchase and implementation processes
Offers faster development with best of breed tools
Supports more integration and open source use
Cons:
Requires separate scripts/languages to train and maintain
Extension Performance Testing Tools
Pros:
Allows for reuse of past automation scripts
Uses familiar languages
Offers a single vendor relationship across multiple tools
Cons:
Follows slower, less focused development
Provides a closed ecosystem that limits access to best of breed tools
Typically more expensive and geared toward large organizations
1. Automation Anywhere Testing Anywhere
Summary: Uses robotic process automation to automate any type of testing and offers cross platform support for mobile, web and desktop. Automation Anywhere can convert scripts into load scripts and allows for machine learning and analytics.
Features:
Offers easy conversion from automation
Less expensive but similar to HP
Includes a TestLab to control testing devices
Tool Type: Extension
What you really need to know: Automation Anywhere is a lower end competitor to HP that offers some test case management capabilities as well as more robust automation capabilities.
For more information: Check out their automation RPA solution.
Reviews: Head over to G2Crowd.com or ITCentralStation.com to read a few reviews.
2. BlazeMeter
Summary: Runs open source-based performance tests as well as scalable load testing. BlazeMeter is compatible with Apache JMeter, offers real-time reporting and mobile capture, simulates network conditions and allows developers to create and edit performance tests.
Features:
Scalable
DevOps ready
Uses open source and AWS
Offers strong support for APIs and customization
Tool Type: Pure Play
What you really need to know: BlazeMeter is a growing player in the cloud performance testing space. Although it has limited use cases and does not offer monitoring or post-production capabilities, it is popular with developers.
For more information: Checkout the BlazeMeter performance testing solution.
Pricing: Free plan available, but paid plans start at $99 per mo with 3 pricing tiers. Visit their pricing page.
3. Borland Silk Performer
Summary: Offers unlimited scalability to simulate any size load as well as a variety of network technologies, including mobile. Silk Performer also provides visual diagnostics and stress testing with pattern detection. As part of Borland’s larger Silk Central platform, Silk Performer also includes a wide variety of supporting capabilities.
<img class="alignnone wp-image-18604" src="http://www.qasymphony.com/wp-content/uploads/2016/04/Borland-Silk-Performer.jpg" alt="silk load and stress performance testing" width="1163" height="654" srcset="https://www.qasymphony.com/wp-content/uploads/2016/04/Borland-Silk-Performer.jpg 1280w, https://www.qasymphony.com/wp-con