Launched in late 2020, Qase is the latest test management solution to get notable traction. It had a very modern interface and surprisingly mature UX from day 1. Still, what exactly do they lack that an established TMS has? Find out, section by section, in just 10 minutes.
aqua brings free AI-enhanced testing
aqua offers On-Premise
Qase lacks reporting
AI is a rapidly developing tech, so we will look at cutting-edge tech rather than the baseline. Here’s what you should expect from an AI-powered test management solution:
aqua started adapting the algorithm behind ChatGPT to QA needs before ChatGPT was even revealed. Almost a year later, you can not only generate new tests but also update them after changing a requirement. Qase barely launched an early beta, which does not read the context of your project and has strict bandwidth requirements.
Test management is the main reason we are looking at these two tools. You should consider various aspects of handling test cases as well as traceability-minded features. These include:
aqua and Qase both offer industry-leading test management experience. You can create tests, group them, designate shared test steps, and track changes to items. Qase, however, lacks views and workflows, which are major time savers for projects of any scale.
Most tools rely on automation via common third-party tools that QA specialists have been using for over a decade. The experience is much better when your test management solution has native integrations for industry-leading tools. REST API support is a must if you do not want to be at the vendor’s mercy for integrations.
Qase and aqua take different approaches to test automation. Qase suggests that you work with open-source frameworks like Cucumber, Cypress, and Playwright to create tests that will be reported into your workspace. aqua has integrations with leading test automation solutions like JMeter, SoapUI, and Ranorex. With both vendors, you can also use the REST API to connect any tool you like.
Tools differ in how much money they request upfront and what scaling looks like. Some criteria here are:
Qase has a lot of plans that are slightly obscure. Most companies would need the Business plan to have native test case review functionality as well as access restrictions. Both plans are billed annually. Qase pricing options, however, can’t compete with aqua’s universal pricing. Smaller teams often mean a lot of manual testers, and aqua offers free licences for them. These people will benefit from proper QA workflows and access relevant information only.
On-Premise deployment is a must in many industries, yet vendors won’t explicitly say if they don’t offer it. Depending on your security policies and scale, deploying in a non-vendor Cloud is a beneficial option too.
Qase has never expressed interest in on-premise deployment, and they still do not support it. On the other hand, aqua has been offering On-Premise since day 1 and boasts a portfolio of clients that rely on it. If vendor Cloud does not work for you, both aqua and Qase can host your workspaces on an isolated server.
QA dashboards serve two vital purposes. They help the QA team track their progress, but they also make other teams aware of potential bottlenecks. At a minimum, you should be able to include any data and share dashboards with the team.
Qase’s dashboards are sufficient. You can organise a good number of widgets that visualise key metrics. aqua goes wider by allowing you to display any data from the workspace. It also offers KPI Alerts that track data on the dashboards and notify you when a metric goes below or above the number that you find concerning.
Reporting is important for both internal and external stakeholders. The goal here is to get what you need with as little or as much effort as possible. When a tool offers both a template library and rich customisation, that is a good start.
Qase does not have dedicated reports that go beyond dashboard widgets. On the other hand, aqua brings highly customised reports that can mix dashboards, pivot tables, data that is auto-transformed by scripts, and even any other texts or images you add. Reports can be easily shared with outside parties as well.
Qase’s user management is a little unpleasant. There are only 3 basic roles out of the box. If you want anything more granular, you need to go up to the Business plan. There are no per user permissions either.
Granular user management is useful even if security is not the biggest concern for your project. Both tools are solid here, but aqua offers per-user permission that Qase does not.
This is not a hard requirement, but you may be interested in a test management solution that also handles the entire product lifecycle. This is a great money saver as you need licences from fewer vendors, and the synergy should save you some hours as well.
aqua and Qase are both QA-first solutions that can also handle the entire product lifecycle. You can keep Jira if your devs request so, but new projects and small teams would appreciate not paying for extra tools.
Here are a few things people like and dislike about both tools.
“I was surprised to find such a comprehensive and mature tool for test management in the German market without having taken it seriously beforehand.”
Jörg Großmann
Head of Development at Bank 11
“The main thing which got us using Qase was their UX, which is way more convenient to use than most of the competition. There is room for improvement, such as reporting — especially cross-team reporting and building holistic views on how all projects are doing across the company”.
Mikko V.
Enterprise (>1,000 emp.)
“The reporting is meaningful and provides a good basis for decisions. After the employees have used aqua, they recognize the added value very quickly.”
Thomas Haeske
Head of Organisation/IT at Berlin Hyp
“There is one area where I feel Qase could improve: the process of writing test steps for similar cases. While the platform provides some tools to make this easier, writing out the same steps for multiple cases with similar characteristics can still be quite time-consuming and tedious“.
Luka C.
Small business (<50 emp.)
“Manual test cases are easily automated with aqua. Seamless integration with test automation tools helps here.”
Jörn-Hendrick Sörensen
Test Manager at KBA
“There is a distinct lack of filters available on a test run level and on a test case level, e.g.: 1. Filter only the test runs which contain failing tests among thousands of test runs (triggered by automation) 2. Filter out test cases that no longer exist in the code (we deprecated and old feature and therefore removed the tests)”
Lee W.
Small business (<50 emp.)
“I was surprised to find such a comprehensive and mature tool for test management in the German market without having taken it seriously beforehand.”
Jörg Großmann
Head of Development at Bank 11
“The reporting is meaningful and provides a good basis for decisions. After the employees have used aqua, they recognize the added value very quickly.”
Thomas Haeske
Head of Organisation/IT at Berlin Hyp
“Manual test cases are easily automated with aqua. Seamless integration with test automation tools helps here.”
Jörn-Hendrick Sörensen
Test Manager at KBA
“The main thing which got us using Qase was their UX, which is way more convenient to use than most of the competition. There is room for improvement, such as reporting — especially cross-team reporting and building holistic views on how all projects are doing across the company”.
Mikko V.
Enterprise (>1,000 emp.)
“There is one area where I feel Qase could improve: the process of writing test steps for similar cases. While the platform provides some tools to make this easier, writing out the same steps for multiple cases with similar characteristics can still be quite time-consuming and tedious“.
Luka C.
Small business (<50 emp.)
“There is a distinct lack of filters available on a test run level and on a test case level, e.g.: 1. Filter only the test runs which contain failing tests among thousands of test runs (triggered by automation) 2. Filter out test cases that no longer exist in the code (we deprecated and old feature and therefore removed the tests)”
Lee W.
Small business (<50 emp.)
aqua is both an established Enterprise-grade solution and a pioneer of AI testing. Qase is a fast climber in the market, but they barely released AI functionality and need more time to deliver general efficiency features. Despite a number of clear feature advantages, aqua competes and often beats Qase on price as well.