Skip to content
This repository has been archived by the owner on Jan 23, 2024. It is now read-only.

Compare Test Results To Snapshot #469

Open
bforbis opened this issue Jul 12, 2020 · 0 comments
Open

Compare Test Results To Snapshot #469

bforbis opened this issue Jul 12, 2020 · 0 comments

Comments

@bforbis
Copy link

bforbis commented Jul 12, 2020

I am currently trying to add a build to our FHIR server's development branches that will automatically run inferno and prove that a previously passing inferno test did not start failing on the new branch. Since we are currently not in a state where ALL inferno tests are passing, this is a bit difficult to do with the current command line interface, as they would currently require that all required tests for each opt-in test sequence passes in their entirety.

One solution to this would be to provide a test snapshot into the run command which would be compared with the test output. If a previously passing test starts failing, it would have a non-zero exit code. Tests that were failing in the snapshot that continue to fail would be ignored.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant