AI

AI in test management has moved well beyond basic test generation. A well-rounded AI solution should function as a context-aware copilot across the full QA workflow. Here is what to look for:

AI grounded in your actual project documentation, not generic templates
Test case generation from text, images, voice notes, or PDFs
Requirements and test data generation
Automatic test suite updates when requirements change
Support for multiple methodologies including BDD

aqua’s actana AI uses Retrieval-Augmented Generation (RAG), grounded in your actual project documentation. It covers requirements generation, test case creation, test data creation, and BDD output, all included free on Cloud plans. Teams report saving over 12.8 hours per week per tester. QMetry delivers AI through QMetry Intelligence (QI): test case generation from user stories, flaky test detection with a “Flaky Score” and “Success Rate” metric, AI-powered search, and duplicate test asset prediction. These capabilities are available on QTM4J and the standalone Enterprise product.

RAG-grounded actana AI trained on your project documentation

AI via QMetry Intelligence; no RAG grounding confirmed

Test case generation from requirements, images, voice notes, PDFs

Test case generation from user stories and requirements text

AI requirements generation

Not listed

AI test data generation

Not listed

Update test suites when requirements change

Not listed

AI included free on all Cloud plans

Available on QTM4J and Enterprise SaaS; scope may vary

BDD test case generation

BDD support with native Gherkin editor

Flaky detection not listed

AI-powered flaky test detection and success rate scoring

RAG-grounded actana AI trained on your project documentation

Test case generation from requirements, images, voice notes, PDFs

AI requirements generation

AI test data generation

Update test suites when requirements change

AI included free on all Cloud plans

BDD test case generation

Flaky detection not listed

AI via QMetry Intelligence; no RAG grounding confirmed

Test case generation from user stories and requirements text

Not listed

Available on QTM4J and Enterprise SaaS; scope may vary

BDD support with native Gherkin editor

AI-powered flaky test detection and success rate scoring

Verdict: aqua wins. Its RAG-grounded actana AI covers the full QA lifecycle for free, including requirements and test data generation not available in QMetry. QMetry leads on flaky test detection.

Try aqua AI

Test management

Test management is the core reason to compare these tools. Beyond creating and running tests, look for traceability, compliance logging, and flexible organisation. Here is what a well-rounded solution should include:

Create, execute, share, and manage test cases across the workspace
Group tests into suites and cycles with folder structures
Store a full audit log of changes for compliance
Support reusable shared test steps and data parameterisation
Visualise requirements coverage and item traceability
Configure custom QA workflows to match your team's process

Both tools handle test management fundamentals well. QMetry offers test case versioning, exploratory testing via a Chrome extension, native BDD support with a Gherkin editor, data parameterisation for reuse, and modular reusable test steps. aqua adds configurable QA workflows, shared views for team collaboration, nested test cases, and change reversal across all plans.

Test cases, scenarios, bulk edits, custom fields

Test cases, test sets, cycles, bulk edits, custom fields

Full execution history

Full execution history and audit logs

Configurable QA workflows

Not listed

Compliance change history on all plans

Test case versioning with full audit history

Shared test steps

Modular reusable test steps

Nested test cases and change reversal

Modular test calls; no change reversal listed

BDD support

Native BDD / Gherkin editor with version control sync

Shared views for team collaboration

Filters and saved views available

Release planning

Release and cycle planning

Test cases, scenarios, bulk edits, custom fields

Full execution history

Configurable QA workflows

Compliance change history on all plans

Shared test steps

Nested test cases and change reversal

BDD support

Shared views for team collaboration

Release planning

Test cases, test sets, cycles, bulk edits, custom fields

Full execution history and audit logs

Not listed

Test case versioning with full audit history

Modular reusable test steps

Modular test calls; no change reversal listed

Native BDD / Gherkin editor with version control sync

Filters and saved views available

Release and cycle planning

Verdict: aqua wins. Configurable workflows, shared views, and change reversal are available on all plans without an upgrade.

Integrations

Most QA teams rely on third-party tools built up over many years. Native integrations and REST API access are essential for staying independent. Here is what a strong integration offering looks like:

Native integrations with test automation and CI/CD tools
Jira integration with real-time synchronisation
REST API for connecting any tool in your stack
Version control system sync for BDD and test authoring
Native bug recording or test capture tool

Both tools offer Jira integration and REST API access. QMetry supports native integration with Cucumber, Selenium, Appium, JUnit, TestNG, Robot Framework, UFT, and SpecFlow. It connects to CI/CD pipelines via Jenkins, Bamboo, Maven, Gradle, GitHub, GitLab, Bitbucket, CircleCI, and Azure DevOps. BDD feature file sync is supported directly from version control systems including GitHub, GitLab, SVN, Bitbucket, and Azure DevOps. aqua covers Selenium, Jenkins, UFT, JMeter, SoapUI, and Ranorex natively. The native Capture tool adds one-click bug recording with video, screenshots, and technical context attached automatically.

Jira real-time bi-directional sync

Jira-native (tests are Jira issues in QTM4J)

Azure DevOps and Confluence integration

Azure DevOps; Confluence integration available

REST API

Selenium, Jenkins, UFT, JMeter, SoapUI, Ranorex (native)

Cucumber, Selenium, Appium, JUnit, TestNG, Robot Framework, UFT, SpecFlow

Native bug recording via aqua Capture

Exploratory testing Chrome extension with action recording

No version control sync for BDD files

BDD sync to/from GitHub, GitLab, SVN, Bitbucket, Azure DevOps

CI/CD: Jenkins, GitLab, GitHub Actions, Azure DevOps

CI/CD: Jenkins, Bamboo, Maven, Gradle, CircleCI, GitHub, Bitbucket

Jira real-time bi-directional sync

Azure DevOps and Confluence integration

REST API

Selenium, Jenkins, UFT, JMeter, SoapUI, Ranorex (native)

Native bug recording via aqua Capture

No version control sync for BDD files

CI/CD: Jenkins, GitLab, GitHub Actions, Azure DevOps

Jira-native (tests are Jira issues in QTM4J)

Azure DevOps; Confluence integration available

REST API

Cucumber, Selenium, Appium, JUnit, TestNG, Robot Framework, UFT, SpecFlow

Exploratory testing Chrome extension with action recording

BDD sync to/from GitHub, GitLab, SVN, Bitbucket, Azure DevOps

CI/CD: Jenkins, Bamboo, Maven, Gradle, CircleCI, GitHub, Bitbucket

Verdict: Tie. aqua wins on native bug recording; QMetry wins on CI/CD breadth and version control sync for BDD.

Pricing flexibility

Pricing structures vary widely across test management tools. Looking beyond the headline number for hidden costs and licence flexibility matters. Key criteria include:

Free licences for stakeholders or read-only users
Low-cost licence types for manual testers
Transparent public pricing
No dependency on paying for additional third-party tools
Compliance features without expensive add-ons

aqua’s Test Management and Requirement Management modules are each €89/month per user, billed annually (€119/month billed monthly). The Test Runner DEV licence is available at €19/month (annual) / €29/month (monthly) — designed for developers and testers who execute tests but are not involved in test or requirement management. Free unlimited Guest licences are included on every plan. The aqua Suite, which bundles all modules for Private Cloud or On-Premise deployment, is available at €99/month. No Jira subscription is required. QMetry’s standalone Enterprise product uses contact-for-pricing. QTM4J is available on the Atlassian Marketplace with per-user pricing, and all QTM4J users also need a Jira licence. QMetry offers an eSignature module aligned with 21 CFR Part 11 compliance, available as part of the Enterprise tier.

No setup cost

TM and RM modules at €89/month per user (annual)

Enterprise SaaS: contact sales; QTM4J: per-user via Atlassian Marketplace

Free Guest licences on every plan (unlimited)

Read-only licence type available; no confirmed free guest licence

Test Runner DEV licences at €19/month

Full and read-only licence types only

aqua Suite (all modules) at €99/month for Private Cloud / On-Premise

No equivalent bundled on-premise pricing published

No Jira licence required

QTM4J requires a Jira licence per user

Audit logs and compliance documentation supporting 21 CFR Part 11

eSignature with 21 CFR Part 11 compliance on Enterprise tier

No setup cost

TM and RM modules at €89/month per user (annual)

Free Guest licences on every plan (unlimited)

Test Runner DEV licences at €19/month

aqua Suite (all modules) at €99/month for Private Cloud / On-Premise

No Jira licence required

Audit logs and compliance documentation supporting 21 CFR Part 11

No setup cost

Enterprise SaaS: contact sales; QTM4J: per-user via Atlassian Marketplace

Read-only licence type available; no confirmed free guest licence

Full and read-only licence types only

No equivalent bundled on-premise pricing published

QTM4J requires a Jira licence per user

eSignature with 21 CFR Part 11 compliance on Enterprise tier

Verdict: aqua wins. No Jira subscription is required, pricing is transparent per module, and free Guest licences are included on all plans.

Try aqua for free

Deployment Models

Deployment flexibility matters for regulated or security-sensitive industries. Key deployment types to look for:

Vendor-hosted Cloud SaaS
Self-hosted or On-Premise deployment
Data centre region selection for data residency
Independence from third-party infrastructure

aqua has supported On-Premise deployment for over a decade, with customers in banking, insurance, and government. GDPR-compliant German-hosted Cloud and Enterprise Custom Cloud on any Azure data centre are also available. actana AI is Cloud-only. QMetry’s standalone Enterprise product supports both SaaS and On-Premise/Server deployment. QTM4J runs on Jira Cloud and Data Center. QMetry’s AI features are available on Cloud; availability on Data Center or On-Premise may vary by version.

On-Premise deployment available

On-Premise / Server deployment available (standalone product)

GDPR-compliant German Cloud hosting

Cloud SaaS available; no German-hosted option confirmed

Enterprise Custom Cloud on any Azure data centre

Data residency in US and Australia confirmed for QTM4J

actana AI on Cloud only

AI features on Cloud; availability On-Premise may be limited

Fully independent of Jira infrastructure

QTM4J requires Jira infrastructure

On-Premise deployment available

GDPR-compliant German Cloud hosting

Enterprise Custom Cloud on any Azure data centre

actana AI on Cloud only

Fully independent of Jira infrastructure

On-Premise / Server deployment available (standalone product)

Cloud SaaS available; no German-hosted option confirmed

Data residency in US and Australia confirmed for QTM4J

AI features on Cloud; availability On-Premise may be limited

QTM4J requires Jira infrastructure

Verdict: aqua wins. On-Premise deployment is available with no dependency on third-party infrastructure, alongside flexible Cloud options for regulated industries.

Dashboards

QA dashboards help teams track progress and make bottlenecks visible to the wider organisation. A strong dashboard offering should include:

Display workspace data including custom fields
Private and shared dashboards
Multiple chart and visualisation types
External sharing without a login
Proactive alerting when key metrics change

aqua provides fully customisable dashboards with multiple graph types and KPI Alerts. When a tracked metric goes outside a defined range, alerts are sent via email or in-app notification. Dashboards can be shared externally without a login. QMetry Enterprise supports custom dashboards with drag-and-drop gadget management, co-owner sharing, and embedded URL sharing outside QMetry. In QTM4J, dashboard gadgets are available via Jira and Confluence integration.

All workspace data including custom fields

Custom gadgets, cross-project data, custom fields

Private and shared dashboards

Private, shared, and co-owned dashboards

Multiple graph types

Multiple gadget and graph types

KPI Alerts via email and in-app

Not listed

External sharing without login

External sharing via embedded URL (Super Admin-controlled)

All workspace data including custom fields

Private and shared dashboards

Multiple graph types

KPI Alerts via email and in-app

External sharing without login

Custom gadgets, cross-project data, custom fields

Private, shared, and co-owned dashboards

Multiple gadget and graph types

Not listed

External sharing via embedded URL (Super Admin-controlled)

Verdict: aqua wins. KPI Alerts for proactive monitoring are not available in QMetry.

Reporting

Reporting is important for both internal and external stakeholders. The goal here is to get what you need with as little or as much effort as possible. When a tool offers both a template library and rich customisation, that is a good start.

Vendor-provided template library
Fully custom report layouts built natively in the tool
Use and transform any workspace data in reports
Export for audit or compliance evidence

QMetry includes 30+ off-the-shelf reports, dashboard gadgets, a Document Generator, Confluence integration, and an advanced query reporting module with SQL-based custom reports. PDF export is available for test execution and test cases. aqua’s reporting engine is fully native. Any data can be dragged into a report, custom formatting applied, external imagery added, and pivot tables or scripts used. Templates are saved and reused inside the platform without switching tools.

Template library

30+ off-the-shelf reports and document generator

Native custom reports with drag-and-drop builder

Advanced query reports via SQL interface

Any workspace data including custom fields

Cross-project data and custom field reporting

External text, imagery, and parametrisation

Not confirmed natively

Pivot tables, scripts, saved layouts

Not confirmed natively

PDF export

PDF export for test execution and test cases

Confluence integration for sharing

Confluence integration for reporting

Template library

Native custom reports with drag-and-drop builder

Any workspace data including custom fields

External text, imagery, and parametrisation

Pivot tables, scripts, saved layouts

PDF export

Confluence integration for sharing

30+ off-the-shelf reports and document generator

Advanced query reports via SQL interface

Cross-project data and custom field reporting

Not confirmed natively

PDF export for test execution and test cases

Confluence integration for reporting

Verdict: aqua wins. A fully native drag-and-drop report builder is built inside the platform. QMetry's SQL-based reporting is well-suited to technical users.

User management

Precise user management is essential when working on multiple projects and/or working with external specialists. It will also save you a lot of pain from running crowd testing in the same test management solution.

Default and custom roles with granular permissions
Per-user and per-group permission assignment
SSO authentication
Automated user provisioning and deprovisioning

QMetry supports LDAP and SSO, custom roles, module-level granular permissions assignable per user or group, and SCIM 2.0 for automated provisioning and deprovisioning via identity providers such as Okta. aqua provides individual per-user permission overrides, SSO via SAML and LDAP (included in the aqua Suite), and both server-level and project-level administrators.

SSO via SAML and LDAP (aqua Suite / Enterprise)

SSO/LDAP; SAML supported

Default and custom roles on all plans

Default and custom roles with module-level granular permissions

Individual per-user permission overrides

Permissions assignable per user or group

Server and project level administrators

Project and account admin

SCIM not listed

SCIM 2.0 for automated user provisioning and deprovisioning

Interface in English and German

QTM4J available in English, Spanish, and German

SSO via SAML and LDAP (aqua Suite / Enterprise)

Default and custom roles on all plans

Individual per-user permission overrides

Server and project level administrators

SCIM not listed

Interface in English and German

SSO/LDAP; SAML supported

Default and custom roles with module-level granular permissions

Permissions assignable per user or group

Project and account admin

SCIM 2.0 for automated user provisioning and deprovisioning

QTM4J available in English, Spanish, and German

Verdict: Tie. QMetry has an edge with SCIM 2.0 provisioning. aqua provides per-user permission overrides at every plan level.

ALM

This is not a hard requirement, but you may be interested in a test management solution that also handles the entire product lifecycle. This is a great money saver as you need licences from fewer vendors, and the synergy should save you some hours as well.

Test case management
Requirements management
End-to-end traceability between requirements, tests, and results
Project management

Both tools cover the full product lifecycle. aqua is purpose-built as a QA-first ALM where requirements, tests, and project management coexist natively in one interface. QMetry achieves ALM coverage through its standalone Enterprise product or through Jira combined with QTM4J, with full traceability maintained via Jira issue links and QMetry’s traceability reports.

Test case management

Requirements management

Requirements management (standalone and QTM4J)

Project management

Project management via Jira or standalone

End-to-end traceability in one interface

Full traceability via Jira links or standalone

Test case management

Requirements management

Project management

End-to-end traceability in one interface

Test case management

Requirements management (standalone and QTM4J)

Project management via Jira or standalone

Full traceability via Jira links or standalone

Verdict: Tie. Both tools cover the full product lifecycle through different architectural approaches.

What people say

Here are a few things people like and dislike about both tools.

“Manual test cases are easily automated with aqua. Seamless integration with test automation tools helps here.”

Jörn-Hendrick Sörensen

Test Manager and KBA

“I really like the usability of the tool as a whole. I'm able to figure out the tool without much guidance which is nice to have in a test management system. However, the admin screens are a little tricky to understand. When looking at the fields it is hard to understand what should be in that field. Updating user passwords is difficult to do especially for your own username.”

Crystal H.

Sr Business Analyst

“aqua test management has a super easy-to-use web interface. One can start in minutes setting up a project and start create test cases and organise everything around their testing activities. aqua offers a great set of features which help testers to do a great job! I love the AI feature to generate test cases from the requirements section of aqua. This saves lots of time and testers as well as test managers can spend the time in more challenging details when it comes to testing.”

Daniel K.

Blogger and freelance writer

“You can organise your test cases and reuse them for other test runs. But there's a lot going on. It would be better if it was as simple as before. And also, adding test cases and putting them in test runs always end up being jumbled.”

Elah. C.

A G2 Reviewer, working with small businesses

“Manual test cases are easily automated with aqua. Seamless integration with test automation tools helps here.”

Jörn-Hendrick Sörensen

Test Manager and KBA

Daniel K.

Blogger and freelance writer

Crystal H.

Sr Business Analyst

Elah. C.

A G2 Reviewer, working with small businesses

Final verdict

aqua is a QA-first ALM that operates independently, includes RAG-grounded actana AI across the QA lifecycle at no extra cost, supports true On-Premise deployment, and delivers fully native custom reporting. QMetry is a capable enterprise test management platform with strong CI/CD depth, version control sync, SCIM provisioning, and 21 CFR Part 11 compliance. It performs best for teams already invested in the Atlassian ecosystem. aqua is self-contained and QA-first; QMetry is ecosystem-native and deeply integrated with Jira.

RAG-grounded actana AI, free on Cloud; covers requirements + test data + BDD

QMetry Intelligence: test generation, flaky detection, search

Full independent On-Premise

On-Premise via standalone product

Unified QA-first interface

Via standalone or Jira + QTM4J

Audit logs and compliance documentation on all plans

eSignature with 21 CFR Part 11 on Enterprise

Transparent; free Guest; €19 Test Runner DEV; €99 Suite; no Jira seat required

QTM4J requires Jira licence; contact sales for Enterprise

Native drag-and-drop builder inside platform

SQL-based advanced query reports; 30+ off-the-shelf

Fully customisable; KPI Alerts

Custom gadgets; embedded URL sharing

Per-user overrides; SAML + LDAP (Suite/Enterprise)

SCIM 2.0; granular group/user permissions

Native QA tools + Capture recorder

CI/CD breadth + version control BDD sync

English and German

English, Spanish, German (QTM4J)

German Cloud; any Azure region

US and Australia data residency (QTM4J)

RAG-grounded actana AI, free on Cloud; covers requirements + test data + BDD

Full independent On-Premise

Unified QA-first interface

Audit logs and compliance documentation on all plans

Transparent; free Guest; €19 Test Runner DEV; €99 Suite; no Jira seat required

Native drag-and-drop builder inside platform

Fully customisable; KPI Alerts

Per-user overrides; SAML + LDAP (Suite/Enterprise)

Native QA tools + Capture recorder

English and German

German Cloud; any Azure region

QMetry Intelligence: test generation, flaky detection, search

On-Premise via standalone product

Via standalone or Jira + QTM4J

eSignature with 21 CFR Part 11 on Enterprise

QTM4J requires Jira licence; contact sales for Enterprise

SQL-based advanced query reports; 30+ off-the-shelf

Custom gadgets; embedded URL sharing

SCIM 2.0; granular group/user permissions

CI/CD breadth + version control BDD sync

English, Spanish, German (QTM4J)

US and Australia data residency (QTM4J)

Winner

Try aqua for free

FAQ

What are the key differences between aqua and QMetry?

aqua is a standalone QA-first ALM with RAG-grounded actana AI across the full testing lifecycle, true On-Premise deployment independent of any third party, and a native custom reporting engine. QMetry is an enterprise test management platform with strong Jira integration, AI-powered flaky detection, SCIM provisioning, and CI/CD depth. It is best suited to teams already in the Atlassian ecosystem.

Can I migrate from QMetry to aqua without losing my project structure?

Yes. aqua provides an automated migration tool that preserves test cases, attachments, and project hierarchy.

Does QMetry work without Jira?

Yes. QMetry Test Management Enterprise is a standalone SaaS and On-Premise product that works independently. QTM4J, the Jira plugin, requires a Jira licence for every user.

Is actana AI available on aqua's On-Premise deployment?

No. aqua’s actana AI is Cloud-only. Full On-Premise deployment remains available for teams that do not need AI features.

Does QMetry offer free licences?

QMetry offers a read-only licence type within their Enterprise product. aqua includes free unlimited Guest licences on every plan with no seat cost.

What is the Test Runner DEV licence in aqua?

The Test Runner DEV (formerly Scout) licence is a low-cost add-on at €19/month (annual) or €29/month (monthly). It is designed for developers and QA specialists who execute tests and manage bugs but do not create or manage test cases or requirements. Teams can add as many Test Runner DEV licences as needed without buying a full all-in-one licence for every team member.

Cookie	Duration	Description
cookielawinfo-checkbox-analytics	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional	11 months	The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy	11 months	The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Which TMS Is the Best for You?

Key differences between aqua and QMetry

How we compare

AI

Verdict: aqua wins. Its RAG-grounded actana AI covers the full QA lifecycle for free, including requirements and test data generation not available in QMetry. QMetry leads on flaky test detection.

Test management

Integrations

Pricing flexibility

Verdict: aqua wins. No Jira subscription is required, pricing is transparent per module, and free Guest licences are included on all plans.

Deployment Models

Dashboards

Reporting

User management

ALM

What people say

Final verdict

Winner

FAQ

What are the key differences between aqua and QMetry?

Can I migrate from QMetry to aqua without losing my project structure?

Does QMetry work without Jira?

Is actana AI available on aqua's On-Premise deployment?

Does QMetry offer free licences?

What is the Test Runner DEV licence in aqua?