Testim 사용 후기 및 리뷰

It's an amazing product. Stable tests created in minutes & results are easily analyzed.

주석: We are very satisfied with Testim.
It easy to use & Provides great results in minimum time.
We definitely recommend it as a main testing platform!

장점:

With Testim, our time from development to Production has decreased to minutes. It allows us to test new features in no time with full regression test coverage & CI integration. Test stability is very high, the results are easy to read and diagnose.

단점:

we still have some difficult with image verification (on dynamic map).

I believe that Testim.io is present and future of automation

주석: From my experience with different automation tools in the past I wholeheartedly believe that "Automation is not an auto-magic". To be efficient, it requires investment. And open source automation tools are not that free as it might seem.
I have been dealing for months with all these "around automation" issues - setups, configurations, environment maintenance, and other technical infrastructure which is important because automation won't work if I don't handle that, but the time that was left for really authoring tests which could show actual value was about 20% of my time (not even talking about dealing with locators and other ongoing maintenance).
This is why I truly believe that to bring real value to my company it would be most effective if we hand over this "side-effect headache" to external professionals who will take care of everything but the business flows and we will add coverage much faster.
Testim gives great value for money allowing to deliver high quality software in a shorter time. Additionally, Testim is more than just software. It is also a community, shared by Testim staff and customers, where we have the opportunity to exchange customers experiences, participate in road map reviews, join various automation expert panels being held on an ongoing basis and this whole thing increases our level of expertise providing the opportunity to share and learn. This professional growth of employees is definitely a gift companies gain from their cooperation with Testim.

장점:

Testim did great job investigating and addressing all famous automation pain points. First, they take care of all the "side work" (environments, code libraries, setups, versions, etc.) allowing companies to fully concentrate on increasing testing coverage of their business flows. Second, being stable, reliable and intuitive solution, it allows achieving impressive outcome quite fast. Following best practices, it is quite easy to build very scalable automation project. There was nothing I couldn't achieve with Testim using it for almost a year by now. Next, the Smart Locators mechanism proves itself de-facto: UI changes but tests keeps running identifying the elements by alternative identifiers. Last but not least, reporting tools are highly self explanatory allowing developers to easily analyze failures and release QA bottle neck. To summarize, Testim.io is quite a robust tool allowing to establish and maintain effective automation using both codeless and coded techniques. It is important to understand, that technical background is required to achieve success in automation project. Record&Play is a great start, however in order to be scalable, following the concepts of programming basics (such as reusable components, parameters, loops and conditions) is essential in order to be able to always extend the coverage rather than spending time on tests' maintenance upon application changes. Having the availability (and passion 🙂) is all you need in order to succeed with Testim.

단점:

There are always things to improve to any software and I have a list of my "nice to have" enhancement requests which is being addressed in our Product-Customers channel. None of them is a showstopper.

Is Testim customizable?

장점:

Easily usable and can be used by anyone.

단점:

It doesnt look customizable. Suppose I need to add certain if else or loops to it, i cant find a way to do so

Ideal framework for E2E automation testing

주석: We have more than 50 users that using Testim on a daily basis. It is a very simple platform that everybody can learn just in a few minutes.
They releasing new features and adding more functionality almost every week.
Once of the best products that I've ever used.

장점:

- Easy of use - Various great features such as: Branches/Parallel tests/Scheduler runner/API Actions/Email/Custom JavaScript Editor and many more - Amazing customer & technical support

단점:

- Can't copy steps from one project to another - Lack of a mobile automation

Great code-less QA automation testing tool

주석: My experience has a positive one. The tool does it says, and it does it well. It's easy to use and easy to maintain. The team picked it up pretty quickly. No coding necessary.

장점:

The product is easy to use, with intuitive features

단점:

Sometimes I can wait for a while for support...

I wish I heard about this product earlier

주석: I wish I heard about this product earlier. In very short time it helped us turn a lot of repetitive work which took a few work days to a quick 40 minutes fully automatic flow. It's so much better comparing to other tools we integrated with before like Selenium IDE, and the manual QA team can take almost everything themselves while focusing on the interesting part of their work. We already caught numerous bugs with the system and the value is great.

장점:

Ease of use, the ability to add almost any validation or action you can think with code integration.

단점:

Pricing model is very weird when you start using the product. It's very hard to define how many tests you run if you don't know how to define a single test in a new system you are unfamiliar with.

Super easy to learn software; comes with the most helpful & professional team.

주석: Honestly this experience so far has been amazing. We're a small company so I'm the only one who does QA. I used to have a really long regression-testing process that took me several hours to do solo. This is going to save me so much time. In addition, the Testim.io regression suite caught something this week I wouldn't have been able to catch manually. I'm thrilled with this system.

장점:

1. It is super easy (and insanely fast) to record tests with little to no technical knowledge. 2. Where technical knowledge is needed, there are a lot of resources and guidance for me to use. The support team on Live Chat has been phenomenal, and they were available at like 11 PM at night. 3. If a test breaks for whatever reason (e.g. construction was done on the page so an element got removed), it's actually not that hard to re-record the test. You can keep whatever steps were working, delete the steps that don't work, and re-record from there.

단점:

This is just a wishlist of things I want: 1. The ability to run mobile tests on Safari, Firefox, and Edge 2. A predefined step for validating the comparison of two things (e.g. Text A is numerical and is greater than or equal to the number in Text B) 3. A predefined step of validating a whole div instead of a single element 4. The ability to run tests across multiple browsers without using CL

I do not regret choosing Testim.

주석: I was tasked with finding a test automation tool for our company, and I reviewed a lot of contenders, but only two ticked enough boxes, and Testim ticked a lot more boxes than the other contender, and provided a much better experience overall. So I recommended Testim. That was 3 years ago. I don't regret my choice. I can't leave without praising Testim Support. They are amazing. Knowledgeable and helpful and willing to guide you through anything you are trying to achieve. The onboarding process also helps you get up to speed developing tests.

장점:

What I like most about Testim is the user interface. This from a developer who is used to hacking around in code. The user interface provided for both recording, creating and editing/maintaining tests is a pleasure to use. It offers a no-code approach to testing, but one that allows a test developer to dive into code when necessary. The way our test team works is we have two non-coders, one did some code 20 years ago, can manage a bit of javascript to myself a technical developer who deals with anything technical that might come up. Usually writing a shared custom action or shared step to perform a particularly tricky bit of testing, that the non-coders can then use in their test. I would say 95% of our test development is developed without code because of Testim.

단점:

I have yet to find anything that I would consider as disliking. If something isn't working as expected its usually because I am doing something wrong.

Great!

주석: With good tests you can find out exactly what is getting broken with ease.
Makes like easier than trying to reverse engineering what happened and where.

장점:

Powerful tests which requires no code Big variety of functionalities Intuitive

단점:

Could slow down merges if you dont run in parallel

Good automation testing tool

장점:

it is very easy automation testing tool. Which require no code but gives the best and variety of functionality.it is extremely easy who are non technical. Users can easily record their action and send directly via emails.

단점:

Overall it is good tool but seems it doesn’t work on Firefox.

Start automating your testing NOW!

주석: Easy to demonstrate value to stakeholders, small to medium ramp-up time, quick to get to first workflow test in production. UX can be improved/simplified.

장점:

Accurately and easily record steps, allows JS execution, re-use of steps and groups of steps, has example practical tutorials readily available, CLI and CI support, has a JavaScript syntax and auto-complete editor, incognito run mode. All test changes and runs are tracked git-style, videos of test runs can be recorded and bugs can be created from the test runs. Baseline screenshots can be compared to see what changed/caused a failure, console logs and network logs available on failure. Warnings and errors are picked up during run, helping trace untracked bugs/errors.

단점:

UX for navigating on the platform is confusing. The screen resolutions are limited to 1080p (if you're building your tests on your machine, they might differ when you run them on the test grid since scaling is not customizable). Does not support tablet testing natively. Some really fine-tuning things like dragging and dropping on specific areas of UI don't always work as recorded. The JS editor doesn't know about variables from other steps or from the test data (forces user to go out of the specific step and go search). Reporting is very minimal.

I strongly recommend Testim for your QA efforts

주석: Testim provided us with a direct contact, we meet once every two weeks to discuss issues we and other teams in our company have encountered and how to resolve them.
After 6 months of working on Testim I arranged a meeting to review our satisfaction level and any requests that had come up and several issues were resolved with one-on-one explanation of best practices.

장점:

The product has excellent documentation which guides you through the onboarding process, in addition the sample project and examples are incredibly helpful. The learning curve was short from start to having a series of tests running and finding bugs was within days and using Testim has helped me get fresh insights in to how our product works. Having predefined test steps is a huge help and shared steps makes reusability a snap. Reusability at cross-environment level is also made easy by Testim projects working with branches: we now have branches of test suites for our Dev, Staging and Production. The next step for us is to add our tests suites to the CI/CD pipeline in Azure Devops which also appears to be well documented and intuitive to enable.

단점:

the two major features missing for our needs are integration with Azure Devops at test-case level and copy tests between projects. However, Testim were responsive to the request for integration with ADO and are working with us on this.

Testim is flexible and powerful integrated development env. to implement robust test automation

주석: Testim recording feature saves a ton of time. If you are looking to get more complex with your tests there are a lot of advanced features available. The support is excellent and details documentation. The reports generated are very helpful and it's great that I can implement Testim right into our workflow.

장점:

Grouping, Parameterization, Dynamic Locators, Branching and merging, Validation and Assertions, CLI, Test results Screenshots and Labeling test script. I have used each and every of the above features in all my scripts and it is very easy to implement for any project.

단점:

I can only Schedule Run process for any of my scripts only by hour in GMT time zone. It would be nice to schedule run any of my scripts by hour and minutes. During prod deployment if our deployment gets completed lets say around 8:10 am/pm then I have to wait until next hour (i.e. 9:00 am/pm) to run my schedule run process. Also, when any script fails during field validation check. Instead of simply displaying the entire Expected vs Actual results. I would like to see only difference between the two results.

Testim filled in the automation gaps for our teams

주석: The customer support and training met all of our needs. They are responsive and are quick to guide the team to solutions to our issues and concerns. Providing a view of the run reports is very helpful to our management team and Testim provides us a way to share updates and needs.

장점:

Automating web apps with a fast start up and little training was the draw for my team. We were able to onboard others that normally would not automate tests to assist us once trained on Testim and our standards. Everyone was excited about the use of Testim with our API integrations for the UI, and the flexibility of using variables and shared steps make an important part of our automation tool set.

단점:

The step comments are on the far right and we would like to see them as hover tips. Drag and drop could be included. Once a test fails in the grid, no email alerts are provided until the suite passes again. Scrolling in the app under test has to be worked around.

Testim is your gateway to web and responsive web automated test success

주석: Testim provides us with a strong End to End automated QA solution, the documentation, features and support are excellent and a team that does not have a dedicated automated test engineer can build basic tests easily.

장점:

the no/low code, AI driven test creation combined with template test steps, shared (reusable) steps and custom steps (Javascript) make Testim an automated testing solution for testers of all levels of ability. Using the recorder via the browser extension means a tester can record an exploratory session and show active generation / capture of defects by sharing the saves test run with their Dev

단점:

1. Mobile responsive testing is supported but only on simulated devices. I would like to be able to connect to live devices thru services like Browserstack. 2. Testim has support for API actions or validations as steps, I would like to import a collection to generate happy path tests for each call or use the recorder to capture each call thru the UI

Quality manager

주석: We are using Testim for more then 3 years now. we like it and use it daily
we feel the bugs and system crashes are taking place alot lately

장점:

I like the easy of use and the fact it does what it say it does - test UI

단점:

The system failling alot and not always working good

UI Automation Simplified

장점:

Testim is extremely accessible for those who are non-technical as tests can be authored without writing a single line of code. Testim also has the flexibility for those who are familiar with code to author personal enhancements to the existing Testim functionality. Customer support is always active and addresses any issues very quickly.

단점:

The learning curve for using the software can be both simple and steep. It is simple in the fact that users can simply record their actions and have Testim replay them. It can be complex implementing some of the deeper functionality Testim offers such as grouping test steps, using dynamic test parameters, and dynamic data sets for reusability.

Best automation tool I worked with

장점:

Its very simple and quick tool to start automating the product

단점:

Did not find something about it. Was very good experience

We got to 80 tests in 6 weeks. This is far better than Selenium or other tools

주석: We significantly improved the speed and quality at which we release

장점:

Super easy to use, connect to the CI and discover/fix bugs. You get an indication about very step including screenshots so you can see compare the expected outcome vs. the actual one. In about 2 hours we authored 12 tests and connect them to our Jenkins. They ran smoothly for a dew days. We actually discovered a number of bugs using the system. Today we have about 80 tests running on every code push testing IE, Chrome, Safari, Edge and Firefox. We use little custom code (JS). This is much easier than Selenium and much more stable! By the way their documentation and support are great. If you need assistance they have ppl responding through the chat all the time. In most cases they will point you to the docs, which is find to be very helpful

단점:

Organizing the test could be done better. When you're getting to a few dozen tests numbering them in a certain order is required

Testim is a good automation framework

장점:

great support and product with a lot of features and new features introduced very often

단점:

hard to hire people with relevant experience

Best software for automation testing

주석: By getting tested our softwares through this software we are givng our customers a quality product

장점:

It is very easy to understand. New trainee and people can easly understand it after one time guidance. Do the things in very less time which helps us to makes our productions more faster as well as its customer support is also very good.

단점:

As if now we have faced issues with some dynamic testing things else everything is fine with testim as it is a good tool for automation testing for technical and as well as for non technical person

Testim is intuitive and could be an easy way to introduce automation

장점:

I could record and run a test within 15 minutes of getting into the tool.

단점:

The grids are complicated, and we had a hard time learning more with the resources available.

Nice continuous integration support

장점:

We find that the available continuous integration support has been quite helpful.

단점:

The "self-learning" aspect doesn't seem to do quite as much as what I was thinking/expecting it might do, but overall the tool has still been quite beneficial for us.

A simple solution for automating front end testing

주석: First and foremost, their customer service is fantastic. I have never seen such fast responses (within minutes).However, I think it's unfortunate that their pricing is based on seats which makes it harder for example to expose just controlling test runs or dashboards to managers (or costly). Also, the number of projects seems to be fixed in the contract. I think they could easily be more flexible on those two parameters, and the number of test runs (which are also dictated in the contract) actually would still protect their service being flooded.

장점:

The software runs very reliably and stable. Overall its very easy to use, and I was even able to teach non-technical people to use the system, and write their own test cases.

단점:

Unfortunately, it does not work in Firefox that well.

Great Product! Best on the market.

장점:

Mostly simple to use but when it's not, support is quick and very helpful.

단점:

Sometimes tests fail for unknowns reasons and the pass upon subsequent executions. So the product is mostly stable but slightly unreliable at times.