“TestProject”!!! competition for Other Automation Tools?

Sayma Nasrin
6 min readJun 25, 2021

Recently, I have done RnD on TestProject and automated my own project with this tool. I have used other automation tools earlier, but this seems easy and more powerful than other tools to me. That has actually motivated me to write an article about my own experience.

What is TestProject?

TestProject is the world’s first free cloud-based, community-powered test automation platform.TestProject offers a few things that no other test automation platform has.

TestProject comes with a “free forever” plan, which means it’s completely free and gives you lifetime access to all of TestProject’s features.TestProject works on almost any platform, with the install of a single agent.

TestProject recorder has AI-Powered Self-Healing technology built right in. This means that if an element locator changes or the element moves slightly, the test maintenance will be automatically handled by the Smart Recorder. For each step that you perform, it will be recorded as a test and automatically Selenium or Appium code will be generated in the background.

Wherever you need to perform complex steps that go beyond a traditional recorder, you can lean on any of the existing add-ons built by the community.

Installation Process:

Unlike other open-source tools, TestProject removes all the complexities of installing and managing drivers for each platform and browser that you use.

All you need to do is install the Agent and sign up to TestProject.Once you have done that, you can go to the agents’ tab at the top of the page and click on the link for the platform you are on to download the agent executable or go to Agent Download. Once that download has finished, users can use it to install the TestProject agent on their machine. The Agent is a cross-platform local desktop component that communicates with TestProject’s cloud testing repository and is responsible for local test execution. By using the Agent user will always be up-to-date with all the latest stable components and drivers to support test automation. Users don’t need to set up any environment as they do for other automation tools.

It supports all the browsers.

You can also follow this video to install TestProject: TestProject Set up

Test Recorder:

To create automated tests, users do not need to write a single line of code. With TestProject’s Test Recorder feature, users can create automated tests just by recording the steps performed on the browser.

Wherever you need to perform complex steps that go beyond a traditional recorder, you can lean on any of the existing add-ons built by the community.

Test Editor:

Its most important feature is Test Editor which helps you in creating, editing, and organizing tests. At each step, you can add comments, select elements, create parameters, perform actions, define pass/fail behavior, take screenshots, set prefix/postfix, and many more. And it seamlessly supports iFrames, Popups, and Dynamic Elements.

Addons:

An Addon is a collection of coded Automation Actions you can use within any test to empower TestProject in-browser recorder. The recorder automatically suggests add-ons that can be helpful for users’ tests. Users can add these addons and extend their tests. Addons are stored in a collaborative library on TestProject’s platform. You can learn more about Addons From here

Schedule Test Jobs:

Users can create and schedule jobs. Each job contains a list of test cases that need to be executed. Jobs can be pre-scheduled for execution at a given date and time. The scheduled job automatically executes the tests on an active test agent and uploads the detailed analytics and reports to the cloud.

It also offers email reporting. Users can add clients' and team members' email. A detailed report of the Test job will be sent to the clients and team members after the completion of the Jobs.

Locate Elements:

Unlike other tools, the TestProject element locator is much more accurate. A locator helps to find out location details of the web element on which it needs to operate. Buttons, textbox, dropdowns, checkboxes, navigation bar, etc. are common web elements present on a web page.TestProject identifies the elements present in the web page by using its DOM properties which is similar to how Selenium identifies its elements.

With built-in Adaptive-wait technology, it automatically handles deviations in web application loading times. Where in Katalon and Selenium, users need to hardcode wait time/sleep time.

Collaborative Testing Repository:

Users can share the whole project or the test script that user-created and can collaborate on a single project by inviting the teammates. Also can provide access to anyone you want.

Where Selenium and Katalon users must share their assets to a Git repository.

You can share individual test scripts with teammates and stakeholders as well.

Reports:

In TestProject, users can create and share reports in real-time with many different out-of-the-box templates for easy sharing via email, Slack, or API. Where Katalon users must generate and share reports locally.

Users can get reports in various formats. And also can get the whole project reports, last 20 execution reports, last 7days execution report, individual test report, any particular days’ test report with passed failed steps, ratio, and execution time.

Users can view the velocity graph for each test script.

Using agent in Docker Container:

TestProject provides agents as applications that can be installed across the different operating systems. Docker agent can be run as a permanent container that is available from the machine to execute tests and also as an Ephemeral Instance.

You can learn more about the Docker container agent from here.

Integration to Slack and Jenkins:

Test Project can easily integrate with Slack allowing you to get notifications and information about your test automation runs directly in a Slack channel.

Test Project’s Jenkins plugin is available in the Jenkins plugin index. To install it, login to your Jenkins server and choose Manage Jenkins → Manage Plugin → Available in the filter field type “TestProject” and then select the TestProject plugin and hit Install without Restart.

Cons:

Like other automation tools, TestProject has some Cons too.

  • When its agent gets stopped, it does not show any warning sign or notification.
  • Can’t integrate to GitHub.

Version 3 is much more enriched than this, which was just released on 23rd June 2021 (the day before yesterday). Parallel test case execution was not possible with the earlier release but in Version 3 Parallel test case execution is possible.

Also, they now have features to integrate with GitHub.

--

--