CLI option to include all test cases from a test plan to new test run

App Feedback
1

I have created a test plan which contains multiple tests and some of them are automated and some require manual testing.

Currently when I create a new test run linked to an existing test plan by importing test results with the CLI tool, only the tests that are referenced in the test results are included in the test run. Any other test cases from the linked test plan are missing from the test run. I need to manually add all the missing tests cases to the test run.

What I would like to do is something like this:

  1. Automatically create a new test run from CI/CLI which includes all tests from a plan marked as NOTRUN.
  2. Import automated test results with CLI tool to the previously created test run.
  3. Manually execute tests for the NOTRUN tests in the test run.

This could be implemented with just one extra argument to the CLI tool. For example, something like:

npx @testiny/cli testrun --project myproject --testplan 1 --name "manual+automated" --testcases ignore --confirm --include-testcases-from-testplan NOTRUN

2

Hi Esa,

the described behaviour is expected, i.e. when linking a test run to a test plan, the test cases are not automatically added to the test run.

Unfortunately, there is no easy way to create a test run from a test plan via API right now. We’re aware that this feature is missing and we already plan to provide API endpoints to solve this.

For now, you’ll unfortunately need to stick to the manual workaround, or you could create two runs (one for automated results created via CLI and one for manual tests created via test plan).

Thank you for letting us know so we know which API endpoints to prioritise on our roadmap.

Best regards,
Hanna