Avis clients sur Katalon Studio

Katalon - Bon produit, mais...

Commentaires : Une deception au niveau marketing. Sinon l'outil est l'un des meilleurs.

Avantages :

Katalon studio est un outil excellent.Il s'integre avec tout presque, il importe des tests case depuis Selenium, depuis open api v2 ou v3.

Inconvénients :

On a commencé à l'adapter, mais le changement de politique de licence était trop agressive.On a eu besoin de changer l'activation offline par une online : Le support a refusé, il fallait attendre un mois pour faire ce type de changement

Katalon Studio - The one stop solution to software testing

Commentaires : Now all my test scripts are built with this tool. I don't have to solely rely on Postman to test backend APIs or just Selenium Webdriver to test frontend web applications or Appium to automate mobile applications. I do prepare all my automation test scripts now using Katalon Studio.

Avantages :

The tool can be used to test the following: 1) API 2) Web Applications 3) Mobile applications Requires minimal programming knowledge to leverage the tool for application testing. Easily integrated with 3rd party applications like Slack. Ready, Handy and FREE plugins available to make testing more effective. Test scripts are interchangeable with Selenium Webdriver.

Inconvénients :

Since this tool is somewhat new in the market compared to Selenium Webdriver, hence, its at times difficult to find solutions if a user is stuck in a problem. However, the KS developers tries their level best to find the suitable solution for you as early as possible.

Automation Tools that makes newby Automation Engineer can play around like a pro

Commentaires : its very easy tools to use especially if you don't have any experience with automation tool. Pretty easy to install and configure so junior team can easily install and create automation for your service (web,api, and mobile). Basically if you are newby once you try this tools your manager or other peers can see you like a pro.

Avantages :

- Easy to use because it has feature record and play so no need coding skill to use their feature - Good user interface - No need to worry about web driver like other automation tools - Katalon has feature to support Web , Mobile, API automation testing - It has feature to support Continuous Integration testing tools - It has ability to handle cross browser testing

Inconvénients :

- Its use pretty big memory so some times its impact to performance issue (like crash or slow) when run many scenario - only Katalon 7+ version licensed owner, that able to use debugging feature - its limited to Java and Groovy

Good tool for API Automation but not so good for mobile UI

Commentaires : API Automation - It is good
UI Automation - Not good

Avantages :

Well organized and easy to use. For APIs its straight forward

Inconvénients :

Mobile UI automation is quite tough to setup. Android automation, once we make a script using the a particular mobile using the recorder, we were not able to use it on another model phone. When recording, the ids which the Katalon Studio is creating were changing for the next phone and hence it is not recognizing the on other phones. On the Iphone UI automation, most of the Iphones are not getting recognized. We spent 2 months on doing research and it is pretty inconsistent. Finally we moved just to Appium and manually create the scripts which is the reliable solution from years.

Ultimate tool for automated and overall testing.

Commentaires : I found it really good as it even provides screenshots where the error occurs and has helped our firm to create the whole process easily testable through katalon .

Avantages :

The browser/desktop recording helps to automatically record scripts and helps a lot in saving time to create automation scripts, plus it helps in parallel execution to save time.

Inconvénients :

It can't handle the load of a large number of test cases under one suite and consumes a lot of time. Rest functionality is good.

Makes life easy

Commentaires : We have managed to fill in the gaps that Postman has left wide open in being able to share reports with teammates, using BDD/Cucumber in API testing, and being able to integrate with Jira. To be able to produce anything similar with postman would require tons of custom Node.js which would be difficult to use for our less technical team members.

Avantages :

What I like about this software is the fact that I can perform API, Web UI, and Mobile Applications testing all in one suite. I like the fact that the software is based on Eclipse, Java, and Selenium, and comes with all the drivers ready to go. It makes life easier for me who have to deal with a lot of the more technical components, but allows others on our team, who aren't as technical, drag and drop my scripts using the UI provided. I like the fact that the software encourages the Page Object Model and also makes Cucumber much easier.

Inconvénients :

You guys are making improvements on your reporting tool, but it used to be a major headache. Other than that, no major headaches.

Front end web testing, with ease

Commentaires : We have to deploy software to numerous systems, numerous times per month. Katalon offers the flexibility to run some basic sanity checks to ensure our deployments were successful, without a ton of manual testing hours to verfiy.

Avantages :

Learning curve is relatively quick and easy to get going with your first few basic tests. There is also a lot of documentation out there if you get stuck on something.

Inconvénients :

The design is horrible. It feels like interacting with an app built in the early 2000s. BUT, it works well.

KS opinion

Commentaires : Currently we've implented execution of several SC that must be executed every 5min,each SC has UI tests and Data Base tests.

Avantages :

Self healing is just great, Katalon testops is really good it has everything a I need all in one platform.

Inconvénients :

The possibility of analyzing a report should not be KSE's thing.

Katalon is the best Automation tool to use!

Commentaires : In the past 2 years experiencing Katalon Studio, Our test cases based on web application were easily managed, automated and matained by the team, even without technical skills required.

Avantages :

It is easy to use and easy to install. Alao easy to manage when implementing cicd to your project or team.

Inconvénients :

It requires you to log online before using it offline

QA Review of Katalon

Commentaires : We've so far had a great experience using Katalon. I'm very excited to introduce it to the company and hope we're able to fully utilize it and keep it around.

Avantages :

I really love how easy it is to create objects and reuse on multiple sites. The copy/paste/move up/move down options are super easy to use. This makes it easy to maintain our work and make it fun to consistently use.

Inconvénients :

Its very difficult to troubleshoot issues. We've started keeping very detailed documentation about which errors may occur and when. If it weren't for that, I'm not confident our QA team would be able to understand how to fix/get past whatever is happening. I would really like to see clearer notes as to why something would be causing an error.

Amazing product for collaborative API Testing

Avantages :

Team Collaboration, Test Management, Code snippets functionality.

Inconvénients :

UI could be improved to have less clutter and Test Verification tab should have facility to open in side window for easy code writing.

Useful, Time Saver, Easy to Use, Good UI and the BEST In the Industry of Automation

Commentaires : I have been using it for 2 years. It is great to test both my web and mobile projects in the same environment and support with powerful reports. Otherwise, sending the test results to your email address after the test is completed is amazing in reaching each test step on Katalon Analysis Beta. With the Recoder feature, recording and executing the tests provides great convenience especially for regression tests. The interface is very useful. The program is constantly alive and in development. New versions and improvements are available. Automating mobile testing is easy with the Katalon. In addition to the ready-made keywords in your structure, you can define custom keywords and improve your test capacity. I don't think you can find a tool that's free and with these features, it's a great Katalon!

Avantages :

With advanced technology, high-quality applications are now inevitable. Manual testing of applications also slows down this rapid process. Considering the different factors such as slowness as well as multi-platform support, cross-browser, responsive design and more, an application's manual test may leave you with unexpected complications and extra efforts. So what do we do then? Remedy Automation Tests: Although the automation test may seem to take more time at the beginning, it has proved to be a more effective approach in the long term in terms of both time and resources since the time of the automation solution. In projects that require intensive regression testing, their utility greatly increases. The ability to re-use the established test scenarios by other teammates is also a big plus. Katalon Studio is a program that you can use to test your Web and Mobile applications. Java-based program can use all the features in a free way. You can start using the program without having any technical knowledge. You can create test cases quickly thanks to the keywords in the program. One thing I would like to mention is the Cross Platform feature. The script you write is a program that allows you to test Cross Platform (Chrome, Firefox, Safari, Internel, etc.) without writing additional code. I recommend you to use.The interface is useful, but it has a lot of integration with many systems such as JIRA, GIT, KATALON ANALYSIS BETA. Has a very strong reporting structure.

Inconvénients :

I don't think it is very useful for web service and API testing. There may be more browser support. Sometimes you feel helpless when you get stuck somewhere when you get an error as community help is not that strong.

an Excellent Automation Testing Solution for Everyone

Commentaires : It helped me a lot by saving me a lot of time because I do some tasks automation on it and I run some tests to see what's working and what's not.
It's free and easy to use and it's perfect for everyone especially for a small business like me who don't need to have programming skills to runs some web and API tests and do Web Automation.
It's an amazing tool and I hope the Katalon Studio team will keep improving it in the future.

Avantages :

I like it because It's % Free tool and It's very easy to use with an excellent user interface. It helped me to test some Automation tasks using an Excel spreadsheet and I find it very useful especially the record option because I don't need to code anything I just need to click record and start to do my task from A to Z and after this, I will just put everything into a Loop and all my tasks are fully Automated. It's very easy to use and I saved a lot of time using it because I don't have much experience as a programmer and to get someone to program an Automation tool for your business is very expensive but, with the Help of Katalon Studio now I have the Knowledge to Automate any simple task I have. I run some tests on multi browsers and It's very easy to create cross-browser testing and It allows me to do multi API and Web service testing too. I love when I get real-time reports about the performance of my test so, I can fix the bug without checking everything. I like the pre-installed templates because for someone with a little knowledge of coding I can just use Katalon templates and they get the work done without any problem. They have an amazing support team and a lot of blog posts and question answered on their Community website also, I like when they send me a lot of useful tips and tricks by Email weekly and there's a lot of YouTube Videos about this tool and I learned a lot from it too.

Inconvénients :

They can add more features and integrate with other testing and automation tools because this will help in saving a lot of time. They can improve their Recorder tool and they can add more Browsers too.

Great Automation Tool

Commentaires : My overall experience with the product is very good, I have explored this tool to the core. it provides you nice reporting format and also you can configure it with jenkins which made my life very easy.

Avantages :

I would say, this is the best automation tool if you have very least experience on automation testing. with least knowledge on automation, you can start using this tool. It provides you in built functionality to select the xpath of objects which is known as self healing. This feature is a savior if you find difficulty finding xpaths of the objects. It has extensive knowledge base, very nicely maintained by katalon community which will answer most of your questions.

Inconvénients :

the only drawback which I have seen so far is that, its kind of slow in performance if your project size is very big.

Good product and great alternative

Commentaires : Overall the tool has many good functions and capabilities. Pros, outweigh cons in a major way.
Pricing structure and support is excellent.

Avantages :

Somewhat easy to get started (see cons), Git integration, beginner and expert modes. Ability to export and continue with other IDEs if desired to go outside of the tool (not locked in to it forever). Plenty of information on the web to troubleshoot and ask questions (unlike our previous tool). May frequent updates and feature releases.

Inconvénients :

A little cumbersome to setup all the needed plugins. Until everything is configured just right, you will run in to errors here and there that take time to troubleshoot. Test case navigation/folder structure could use a few more options and customization capabilities to be able to sort things better. Automatic centralized location for code and test case storage (similar to ALM) would be great. Having to commit and pull code each time from different stations is cumbersome. To schedule remote execution you must make sure the machine pulled latest code which is an issue if execution and development PCs are different.

Katalon Studio - Free, Easy to Use, Best UI for Web, Mobile and API automation

Avantages :

Easy to setup Easy to use UI - Objecy Spy, Recorder, Keyword and Script view, debugging, Integration with GIT etc.., Easy to learn - Built in keywords, framework, simple external data integration, record and play back Advanced Capabilities - Multi browser, parallel execution, command line execution, record / spy mobile applications, API etc..,

Inconvénients :

Newer version of Katalon Studio has moved some of the free features to paid (ex. Jira integration) Capturing objects, scripting and execution time on mobile apps must be improved Multilevel API calls are not efficient compared to tools like SoapUI, Postman etc.. Report cannot be customized Desktop app automation not available

A powerful automated testing tool at free of cost

Commentaires : We have a challenge to start over the automation immediately and there aren't any QA's who has much knowledge about it. In that case being a QA Developer I suggested on using Katalon studio to save time on setting up the framework from scratch. Having this tool handy and easy to use it doesn't take much time for our manual testers to write scripts using manual mode. I personally like the tool as it allows us to create custom keywords though the tool provides many pre-defined methods there is a requirement to create custom keywords as the application demands like retrieving the links from emails, verfying pdfs. Today we have had ample number of test cases developed using Katalon Studio. And we are further hoping to start working on API automation too using Katalon.

Avantages :

Powerful tool but easy to use and simple to deploy Open Source Tool Single tool provides features to perform Web UI, Mobile and API automation Supports Page Object Modal Provides Object Spy feature Provides cross browser testing It has both manual and script mode It has many pre-defined methods which helps the manual testers to create automation scripts Releases feature updates frequently Provides integration with various 3rd party tools like TestRail, qTest, Git, Jenkins Provides great reports.

Inconvénients :

Paid support Frequent feature release takes time for installation everytime

Awesome product for doing Automation

Commentaires : Able to complete the business cases very fast

Avantages :

1. Parallel Execution 2. Developing the scripts in different modes 3. Keywords concept 4. Katalon Analytics 5. Maintaining Objects easily and customizable with different locators 6. Test Listeners helps a lot 7. Plugins concept is really awesome. Saves a lot of time 8. Regular updates from the team 9. Quick response from Katalon Community and Katalon developers

Inconvénients :

1. Uses more System memory 2. Proposals will not be displayed properly 3. Any errors while developing a script are not displayed. Only when we run we get the errors in the console 4. Some of the jars are very old and those are not updated in the library

I still can't believe it's free

Avantages :

It's packed with features, which comes in handy when you want to perform many tasks with one single tool. Getting started is easy, even for beginners; I have a few years of experience in automation with pure scripting and transitioning to a UI based tool was like going from riding a horse to driving a sports car. SpyWeb is incredibly useful, I even prefer it to the recorder, which may seem faster at first, but in my experience it's been far more efective; selecting the right locator immediately after capturing the TestObject really saves time. Databinding in test suites is a blessing, very easy to use and drive tests from this data.

Inconvénients :

The UI is a bit clunky, not very intuitive, and I guess the word is "overpopulated". There are many options, buttons, dropdowns, popups, which can be confusing. The learning process is fast at first, but when you are forced to use extended keywords, conditionals, method calling, the tool becomes a nightmare for beginner/intermediate users. I usually just write methods in script view, but many users have no experience in coding and really struggle with the UI assembly of methods or binary statements. Debugging is somewhat confusing as well, but that's not so important in my opinion. The application takes way too long to *start* running tests as the size of them increases (the execution is really fast though).

Growing Tool in Test Automation

Commentaires : Katalon Studio as a Test Automation Tool satisfies the need of the Regression testing and is continuously improving as a Tool that gives a chance to Automate everything.

Avantages :

- Katalon Studio is easy to script - Support multiple platforms(WEB UI, Mobile, API) - Supports multiple Integrations for Reporting and Tracking

Inconvénients :

- Newer versions have browser upgrade issue as each time we have to upgrade the browser for smooth execution. Most of the time it does not upgrade in one go.

Good for beginners, fast growing software with a lot of pros

Avantages :

It was my first software for automation of my tests. So it's a good tool for complete beginners. The test case writing process takes less time than in many other tools. I like the way you can switch between manual and script mode - from predefined options to the actual code

Inconvénients :

Updates for the software could be with errors when tests couldn't be executed. Or with changes like "to create a pdf report please install the add on". I don't like such changes when some of the functionalities suddenly stop working.

Katalon is my daily use software for testing

Commentaires : I used appium before I know katalon. I think katalon is easier compared with appium. Especially for verify the element displayed or not. In Katalon, we have special method to verify element not exist. Katalon is more user friendly and easier to manage the test case.

Avantages :

It is convenient and integrated with Selenium and Appium. It almost has all the features what Sele/App have. Besides, it has its own defined methods which can be used very efficiently to do the testing work. For example, which you want to scroll to a certain text, all you need to do is use scrollToText() without handling the XY coordinate. I truly thank Katalon for making my work easier!

Inconvénients :

I think one feature I am not satisfied is handling the webview in mobile apps. I know there is a method in Katalon which allow us to switch from native apps to webview. But it seems like it does not work for me. When I post the question in forum, I did not get the solution neither. Currently I am working on testing hybrid apps with webview in it. I hope one day you can fix this.

Free Version - Good for intended purpose

Avantages :

I like that is was easy to download/install. The tutorials were good in helping me set up my initial project and test cases. I was brand new to automated testing so speaking from experience, I'd say this is a good tool for people who are new to automated testing and have little scripting experience. The point and click functionality is great because then people who are more on the business side can help get test cases set up and then turn to the developers if they need further help.

Inconvénients :

It could have just been the application I was trying to automate, but it seemed like for most objects I had to go in an manually update the xpath. The xpath recorded didn't seem to work. I think this tool is pretty easy to use for basic test cases, but once you get into more complicated test cases it can get very cumbersome. I had good luck setting up the cases for my web application, and once they are set up the run with no problem. However, I had 0 luck setting up the mobile device testing. Again, it could have been the application itself, but there were a lot of extensions I needed to install in order to even get the device to plug in. Once I did, the point and click functionality did not seem as user friendly as the web application point and record functionality.

It's a great concept, but since it is a testing tool, it has TOO many bugs.

Commentaires : Waste alot of time. A testing tool must be tested more before it is released, or should be marketed as such.

Avantages :

Easy to record and use. Very intuitive. Basically the interface is a copy of Selenium IDE. Records absolute xpath well.

Inconvénients :

I don't even know where to start. It is very messed up at what it is supposed to do basically. It will give you lots of options to use but most of them are either broken or just there for visuals. The idea behind the tool is great but the execution is horrendous. Eg, You can add csv sheets to the recorder but can't actually use it. You can export scripts from the recorder but it wont even work on their own Katalon studio. Many a times we are unable to save recorded scripts and have to rely on copy paste which actually wastes more time. We all have stopped using this product, and are working on IntelliJ's Idea IDE. Much more reliable and so easy to manipulate the script.

Didn't see a tool that provides more flexible features like Katalon

Commentaires : Well with katalon. really loved it

Avantages :

1. Integrations with GIT, Bitbucket, Slack 2. Data binding 3. variable binding 4. Execution settings 5. Compatible with other languages even though it is running using groovy 6. Profiles 7. Data files

Inconvénients :

1. Better to have options to connect multiple databases with windows auth mode 2. Execution reports in katalonanalytics seem not running properly 3. API automation report doesn't have the flexibility to trace the issues easily we need to do many clicks