Skip to main content

Robot Framework

Submit and collect your Robot Framework results in Testiny to track automated test runs. By integrating Robot Framework with Testiny, you can gain valuable insights into your testing process. Track results over time, identify frequently failing tests, and detect patterns in test failures to fix CI failures and find flaky tests. To get started, use Robot Framework's built-in JUnitXML reporter to generate structured test result files and import them into Testiny.

Robot Framework

Generate Robot Framework XML Reports

Robot Framework provides built-in support for generating xUnit-style XML test reports, making it easy to integrate with CI/CD pipelines and test reporting tools. To generate a xUnit-style XML report, simply run Robot Framework with the --xunit option and specifying the desired output file path:

robot --xunit results/test-results.xml *.robot

When you execute this command, Robot Framework will run all available tests and generate a structured XML report in the specified file. You can also specify another output directory.

Import Results to Testiny

Make sure you've generated an API key and use the Testiny CLI to import the results to Testiny:

export TESTINY_API_KEY=****
npx @testiny/cli automation --project ID_OR_KEY --source "frontend" --xunit results/test-results.xml 

In the above example, the environment variable TESTINY_API_KEY is set to authenticate the request. The --project flag specifies the target Testiny project using its ID or key and the --source flag categorizes the test results (e.g., frontend, backend, integration tests, ...). The --xunit flag specifies the format of the specified test result file(s).

Once executed, the Testiny CLI will automatically create a new automated test run in Testiny and import all results from the specified report(s).

More resources

Here are some further resources to help you get started with integrating Robot Framework with Testiny, including CI/CD integration examples, a full automation guide, and the Testiny CLI.