1. aqua ALM
aqua ALM is the latest established solution to join the ranks of AI tools for testing. The test management solution that evolved into a full-scale ALM was launched in 2013, while the AI functionality entered beta at the end of 2022. aqua is supported by the German andagon group, which has been doing IT consulting for over 20 years.
The key AI functionality here is generating entire test cases from requirements. aqua uses a large-scale natural language processing algorithm (fine-tuned by QA specialists) to turn plain text into a test. The functionality is not limited to English or German, which is great for multilingual teams and/or companies that attract external talent. About 40% of the AI-generated test cases do not need any human tweaks before they can be added to the test suite.
There is some less groundbreaking functionality that will still save you a lot of time. QA specialists can create test steps themselves but make the AI fill out the test case description. The opposite is also possible: enter test case description and get AI-generated test steps. These options require a bit more upfront effort but fewer finishing touches.
aqua’s is expanding beyond test generation. The extra functionality includes AI prioritisation of tests from your test suite and automated removal of duplicate test cases. These features will be useful even if you don’t quite trust artificial intelligence to make tests for you.
As for non-AI functionality, aqua is one of the highest agile test management tools in the market. It has a rating of over 4.5 on G2 and Capterra. The software boasts the Made in Germany badge and is used by German government agencies and Google among other clients. It has a dozen native integrations and can send/receive data from any other third-party tool via REST API.
Forward-looking AI solution to save hours on testing
2. Perfecto Scriptless
Perfecto Scriptless is one of the most prominent AI tools for test automation purposes. It is specifically designed to enhance automated quality assurance of web and mobile applications. The solution was launched as TestCraft by an independent company before Perfecto started a partnership and eventually purchased the tool in late 2018.
Perfecto Scriptless is as close as we get to an open source automation tool for testing AI systems. While this is a commercial solution that does not disclose source code, Perfecto Scriptless is enhancing Selenium test automation — and Selenium is open-source. This is a really inspiring point in a new market like AI test automation, since potential migration to a more advanced tool will be smooth.
The key selling point of Perfecto Scriptless is the low barrier of entry. Boasting the no-code approach, this is designed to be one of the simplest tools used for implementing AI in automation testing. It is made to be even easier than regular test automation with Selenium.
Other than testing, Perfecto Scriptless advertises AI-powered reporting and third-party-friendly continuous integration pipeline. The solution can work with Jenkins, TeamCIty, Jira, and GitLab among others.
The community sentiment is hard to measure, because most reviews of Perfecto Scriptless date back to 2018. Back then, users praised the core functionality but had complaints about buggy navigation that would require reopening the tool from time to time. This is something to look out for during the free trial period.
3. Testim
Testim is another example of test automation-focused AI tools. It was propelled by Microsoft’s accelerator programme in 2016, and then acquired by the test automation powerhouse Tricentis in February 2022. To this day, Microsoft remains the biggest client on the Testim portfolio.
The feature suite of Testim has many similarities to Perfecto Scriptless. They both advertise self-healing tests, good visibility for quick troubleshooting, and the room to increase the scope. Testim’s approach, however, is more about aiding experienced engineers in writing automated tests rather than creating them without any code. The key areas are UI, API, and functional testing.
Testim has over 15 integrations with issue tracking solutions as well as continuous integration software. Just like Perfecto Scriptless, it is powered by Selenium and thus won’t lock you into a painful choice of sticking with Testim or starting from scratch.
Just like aqua, Testim is hovering around the 4.5 score on review websites. Customers are happy with the AI functionality, but there are multiple reports of a non-intuitive user interface and limited mobile testing. Luckily, there is a free trial option to see if the UI will be a deal breaker for you.
4. ACCELQ
ACCELQ, an AI-based test automation tool, is a no-code platform launched in 2014. It is used by Intel, Pfizer, and United Airlines.
What differentiates ACCELQ from other automation-focused AI solutions is the wide scope. The company provides dedicated solutions for web, mobile, and API testing. They also boast of offering these three options alongside a space for manual QA, but aqua’s test management software natively unites manual and automated testing. Most other AI-powered solutions without issue management will integrate with third-party solutions for that, too.
The solution has a serviceable range of integrations with open-source automation frameworks and continuous integration solutions. The no-code component creates tests that cover all prominent frameworks, including React and AngularJS.
ACCELQ is punching above a review score of 4.5 as well. There are some minor performance complaints, a couple of reports on lacking documentation, and a note about high upfront investment. The customers are happy about the wide scope of the solution, and that’s the key advantage that the company advertises.
Speaking of scope, the rise of GPT unlocked and expanded a lot of AI testing niches. We explore the new possibilities and how you can take advantage of them in our overview of key AI testing trends.
Learn the 5 AI testing trends to save 12.8 hrs/week per specialist
5. Applitools
Applitools is an AI-powered test automation platform that specialises in UI testing. Launched in 2015, it features Microsoft, Bank of America, and adidas on the portfolio.
The key selling point of Applitools is its range of visualised testing solutions. It includes a cross-browser (and cross-device) grid for testing web applications as well as a mobile grid to test native mobile applications. Here, artificial intelligence compares snapshots of app screens to quickly spot changes that are likely erroneous. Auto-compliance with visual accessibility requirements is a nice touch as well.
Applitools supports all major development frameworks, synergises with continuous integration software, and sends status updates to corporate messengers. It also integrates with issue tracking solutions and even competitor solutions, including Testim.
Reviews-wise, Applitools is scoring just below the 4.5 mark. The two major concerns raised by users are a huge time investment to weed out false positives and slow execution. One user notes that it takes 100 seconds for a simple test because of everything happening in the background. Just like with non-AI test automation, you can brute force unoptimised execution to make it faster — but at an almost proportionally higher cost.
| Feature | aqua ALM | Perfecto Scriptless | Testim | ACCELQ | Applitools |
|---|---|---|---|---|---|
| AI Functionality | Generates test cases from requirements | Enhances Selenium for automation | Aids in automated test writing | Wide scope of testing options | Visual testing, AI-driven comparison |
| Test Case Generation | AI-generated with minimal tweaks | No-code approach for simplicity | Aids experienced engineers | No-code automation platform | AI-driven visual comparison for errors |
| Non-AI Functionality | Agile test management, high ratings | Third-party integrations, CI compatibility | Issue tracking, CI integrations | Manual and automated testing | Visual accessibility checks, integrations |
| Integrations | Native integrations, REST API | Jenkins, TeamCity, Jira, GitLab, etc. | Issue tracking, CI tools, Selenium | Various automation frameworks | CI, issue tracking, Testim integration |
| Reviews | Highly rated | Mixed reviews from 2018, buggy navigation | Non-intuitive UI, limited mobile testing | Minor performance issues | Mixed reviews, slow execution |
6. Mabl
Mabl is a low-code AI test automation tool. It focuses on performance, web, and API testing.
The solution utilises artificial intelligence in 2 ways. First, it tries to reduce the number of unnecessary automated test runs to save time and money. Second, Mabl’s AI suggests new tests to expand the test coverage.
Other than this AI functionality, Mabl is similar to many low-code test automation solutions. It can work with Selenium for regular, non-AI test automation. It offers self-healing in case your tests break. Regression testing is part of the automation suite as well.
7. Katalon
Katalon is an AI-powered test automation tool for UI testing. The solution was launched in 2016 and has SAP, Santander, and Rakuten among high-profile clients. Just like with competitors, it is hard to tell where simpler image recognition ends and advanced AI functionality starts. Katalon claims that the AI algorithm can tell which visual changes are deal breakers and which are acceptable. The tool also self-corrects false positives to avoid extra work by your front-end developers.
Regular functionality includes UI validation by screenshots, cross-browser and cross-OS testing, and granular ignored zones to test individual components only. The solution also boasts dozens of integrations with test automation tools and even a couple of non-AI test management solutions.
The solution was launched in 2016 and has SAP, Santander, and Rakuten among high-profile clients.
8. Eggplant Test
Eggplant Test is another AI tool for automation of user interface testing. The algorithm is used to adapt and run the same tests across various operating systems and browsers. The company also highlights the security benefits of not actually giving AI the source code to test the product.
As for non-AI functionality, Eggplant Test highlights API evaluation and model-based testing. Native integrations with CI/CD solutions are included out of the box.
The tool is run by Keysight, a company founded in 2014 but tracing roots to the late 1990s. The company’s portfolio includes Nokia as well as a number of manufacturers and service providers in 5G and mobile batteries markets.
9. Parasoft C/C++ test
Parasoft C/C++ test is a unique tool for AI-powered test automation. It specifically focuses on validating C/C++ code.
The solution uses AI to analyse code and spot defects automatically. This does require sharing your C/C++ IDE with Parasoft, which may be a problem depending on your industry and the project.
Despite being a niche solution, Parasoft C/C++ test has a solid suite of non-AI functionality. Native CI/CD and automation integration, traceability, and reporting are all available.
The solution is maintained by Parasoft, one of the biggest software vendors founded back in 1987.
10. Digital.ai Continuous Testing
Digital.ai Continuous Testing is a test management solution targeting web and mobile testing. The AI functionality covers code and release governance. The tool looks for errors, suggests workflows to prevent them, and assesses code readiness to adjust release timeline if needed.
The rest of the functionality is similar to what you will find in other test management solutions. Digital.ai offers tools for accessibility testing, but you may find them in tools that focus on UI/UX testing as well.
The tool is part of an application lifecycle suite that Digital.ai has been launching and acquiring since 2020. Schneider, Air France, and Societe Generale are some of the biggest clients.
| Feature | Mabl | Katalon | Eggplant Test | Parasoft C/C++ test | Digital.ai Continuous Testing |
|---|---|---|---|---|---|
| AI Functionality | Reduces unnecessary test runs, suggests new tests | Identifies critical visual changes, self-corrects false positives | Adapts tests across OS and browsers | Analyses C/C++ code for defects | Code governance, error detection, release assessment |
| Test Case Generation | AI-based suggestions for test expansion | AI identifies critical visual changes | Adapts tests across platforms | AI spots defects automatically | Code governance, error detection, release assessment |
| Non-AI Functionality | Low-code, Selenium integration | UI validation, cross-platform testing | API evaluation, model-based testing | Native CI/CD integrations | Accessibility testing, code and release governance |
| Integrations | Selenium, API, CI tools | Test automation, various integrations | CI/CD solutions, automation integrations | CI/CD, automation tools | Accessibility testing, release and code governance |
Final thoughts
AI test automation is on the rise, and there are tools to cover all sorts of needs. All AI tools for testing on the list have generally positive reviews, and the industry will likely only get better as licensing AI algorithms to build solutions becomes even more popular.
The most flexible AI test management solution on the market
