Allure TestOps

Using Allure TestOps 3.193.0

Commentaires : Overall I am very happy with Allure TestOps. I am using it to improve the manual testing experience for testers and integrate reporting with automated tests. My experience has been with the 3.193.0 version. Most of the issues I have experienced are fixed/improved by the recent 4.x release. I'm looking forward to upgrading.

Avantages :

- Handling both manual and automated tests with a consistent UI is fantastic - Manual test development and execution is a breeze - Automation integration with Jenkins is easy - It is easy to learn and use - Automated tests executed with the allure-framework (https://github.com/allure-framework) provides rich reporting in TestOps

Inconvénients :

- There is no way to modify test result messages for manual tests - There is no way to provide pre-defined test environments for test plans. They must be entered manually each time the test plan is launched. - I've experienced some API bugs that I am able to workaround, but they were unexpected. Support worked with me to resolve the issues. - Custom field and environment definitions are globally scoped (applies to all projects). This is confusing when I want to manage projects differently, but the options for one project are shown in another.

Unique solution on the market

Commentaires : I think this is a good solution overall that eliminates a need in other software for Quality Assurance department.

Avantages :

Single point for all QA-related activities (test case management, automated executions, reporting, analytics, etc.) It helps in collaboration between different departments. Brings great visibility on overall QA department activities to management. Customizable dashboards!

Inconvénients :

Configuring dashboards quite challenging. Dependency on the Allure framework that is not part of the TestOps customer support, so If you got strike with a problem you have to solve it on your own, or ask in Telegram chat where I did not get any response in most of occasions.

Pros and cons of Allure TestOps

Commentaires : We use a tool for manual testing and automation.
We store test cases, test plans in it, use tags and other types of sorting.
We also store test cases for automation and reports on the passage of tests in it. Recently we added a video to the reports, which is very convenient!
A good tool to help you test and improve processes.
I would like it to become more stable, to better integrate with iOS.

Avantages :

- Conveniently build a system for working with test cases and test plans - Integrates well with Android - Conveniently sort test cases - It is possible to add dashboards, watch metrics - Autotest reports can include both screenshots and videos - Quite easy to use tool - There is an opportunity to interact with the developers of the Allure TestOps

Inconvénients :

- The release note on the site is not updated in a timely manner - Poor support for integration with ios, not given due attention to this platform, few examples in the documentation - It takes a long time to complete feature requests that are written to the support service for fairly simple features. It would be nice to see a public road map - It would be cool to see tutorials on YouTube as a Allure, because there is not much in the documentation (restarting autotests for example)

Most useful test reporting tool

Avantages :

The product have complete integration with most programmings languages and testing frameworks; good support by email and Telegram chat; wide community which give helpful responses for questions or troubles; easy integrations with CI/CD.

Inconvénients :

The new versions could break old functionality (regression).

The Best TMS system

Commentaires : I used it for automation mostly but I really like metrics and test-case generation

Avantages :

When you generate test cases from the code. Test case management - many filters and etc. Easy to connect with your code. Works with any languages. Design of the system!

Inconvénients :

Detailed documentation in English. That's it!)