Test Suite and Test Suite Collection Reports in Katalon

Test Case Log Details

If we want to see the details of logs that have been executed, In the Test Case Table, we will select an iteration. After selecting the iteration,​ we will click on  Show Test Case Details.

Test Log

This tab displays information about all of the steps that have been executed or completed as well as their status.

Test Log Information Tab

This tab has the information about the specified test step in the Test Case Log section:

• The test step's name. This is also known as the name of the keyword that is used in the test step.
• Date, time, and duration of execution
• The test step's description
• Any system messages generated while the test step was run 

Test Log Image Tab

The screenshot is taken from the application under test, and it gets taken when one of two things happens:

• The first case is if, during test execution, an error occurs.
• The second case is if the take screenshot keyword gets used.

Using the given filters, we can select the type of information to be displayed:

We can submit a ticket to this system if we have configured Jira integration.

Screenshots are taken for the steps that are unsuccessful or have failed. We can also review them by hovering our mouse cursor over the attachment symbol. 

Information

This tab contains the test case's summary information.

Integration

This tab shows the information about this iteration's qTest or JIRA integration.

Test Suite Collection Report

Reports are available right from each test suite collection page. Only Katalon Studio Enterprise users have access to test suite collection reports.

To view the test suite collection report after conducting a test suite collection, we can navigate to the Result tab.

Report History

Note: Before we go into Report History, it's worth noting that it's only available to users who have the Katalon Studio Enterprise version.

When a test suite/test suite collection completes its execution, a report gets generated and saved in the Reports folder.

The report is named using the naming convention YYYYMMDDHHmmss_, which relates to the start date and time of the execution.

Export Reports to Other Formats

We can export test suite reports into different formats for distribution, such as CSV, HTML, PDF, and JUnit.

However, there are a few things that we should note.

Katalon Studio automatically creates JUnit reports. This applies to both the test suite and test suite collection, starting with version 7.0.0.

For Katalon Studio - Platform Edition versions 8.5.0 and later: 

• Running in debug mode does not create basic reports automatically (PDF, CSV, HTML). Katalon Studio - Platform Edition only exports the JUnit report when in debug mode.
• When in debug mode, the execution results are not automatically sent to Katalon TestOps.
• Manually exporting reports for debug mode is not possible.

Automatically Generate Reports

In Katalon, we also have the option to generate reports automatically. Let us look at the Steps.

Step 1: First, we click on Project and then select Settings. This will take us to Katalon Settings.

Step 2: Once we land on the Katalon Settings dialog box, we will select the Plugins side panel and click on report.

Step 3: Now we Choose the format we want for the reports generated after each test suite execution.

Now we Execute a test suite and monitor the Log Viewer after the test is finished. The generated reports are the same as the settings we specified above.

After the test execution is completed, we can examine the generated reports at <project folder>\\Reports\\<execution folder>. 

Manually Export Reports

Only HTML format can be exported for test suite collection. To export reports manually, do the following:

1. Open the Result view of a test suite or a collection of test suites.

2. Select Export report in the upper right corner. Then, select an export format.

Get Generated Reports Location at Runtime

We can get generated report's location at runtime. We can use the sample code below to access the current location of created reports:

import com.kms.katalon.core.configuration.RunConfiguration
RunConfiguration.getReportFolder()

Along with that, users also get more information via the RunConfiguration package.

Frequently Asked Questions

Is Katalon easy to use?

Katalon Studio currently offers a good UI/UX for testers with little to no programming experience. Users may quickly access capabilities like built-in keywords, drag-and-drop, and finding and selecting test cases for reuse. However, for skilled automation testers, leveraging these functionalities can be time-consuming.

Does Katalon have any cloud-based solution?

Katalon TestCloud is a cloud-hosted system that delivers multi-browser testing environments that are on-demand, adaptable, and secure.

Does Katalon have automated testing options for a team?

Katalon is a modern, all-encompassing quality management tool that enables teams of any size to provide the highest-quality digital experiences. Robust solution for end-to-end web automated testing. API testing for REST and GraphQL that is automated.

Conclusion

In the article, we read about Test Suite and Test Suite Collection reports in Katalon. We also saw the ways of viewing test case log details, reports and history. Refer to our courses and explore Coding Ninjas Studio to find more exciting stuff. You can also look into the interview experiences and solve different problems. Look into our Guided paths, test series, libraries and resources to know more.

Happy Coding!