Robot Framework
Submit and collect your Robot Framework results in Testiny to track automated test runs. By integrating Robot Framework with Testiny, you can gain valuable insights into your testing process. Track results over time, identify frequently failing tests, and detect patterns in test failures to fix CI failures and find flaky tests. To get started, use Robot Framework's built-in JUnitXML reporter to generate structured test result files and import them into Testiny.
Generate Robot Framework XML Reports
Robot Framework provides built-in support for generating xUnit-style XML test reports, making it easy to integrate with CI/CD pipelines and test reporting tools. To generate a xUnit-style XML report, simply run Robot Framework with the --xunit
option and specifying the desired output file path:
robot --xunit results/test-results.xml *.robot
When you execute this command, Robot Framework will run all available tests and generate a structured XML report in the specified file. You can also specify another output directory.
Import Results to Testiny
Make sure you've generated an API key and use the Testiny CLI to import the results to Testiny:
- Node.js/npm
- Linux
- Windows
- macOS
export TESTINY_API_KEY=****
npx @testiny/cli automation --project ID_OR_KEY --source "frontend" --xunit results/test-results.xml
export TESTINY_API_KEY=****
./testiny-importer-linux automation --project ID_OR_KEY --source "frontend" --xunit results/test-results.xml
set TESTINY_API_KEY=****
testiny-importer-win.exe automation --project ID_OR_KEY --source "frontend" --xunit results/test-results.xml
export TESTINY_API_KEY=****
./testiny-importer-macos automation --project ID_OR_KEY --source "frontend" --xunit results/test-results.xml
In the above example, the environment variable TESTINY_API_KEY
is set to authenticate the request.
The --project
flag specifies the target Testiny project using its ID or key and the --source
flag categorizes the test results (e.g., frontend, backend, integration tests, ...).
The --xunit
flag specifies the format of the specified test result file(s).
Once executed, the Testiny CLI will automatically create a new automated test run in Testiny and import all results from the specified report(s).
More resources
Here are some further resources to help you get started with integrating Robot Framework with Testiny, including CI/CD integration examples, a full automation guide, and the Testiny CLI.