Skip to content

Commit

Permalink
added metrics screenshot, changing paragraph break
Browse files Browse the repository at this point in the history
  • Loading branch information
urikirsh committed Jan 1, 2024
1 parent 953fc82 commit 53a05f3
Showing 1 changed file with 8 additions and 3 deletions.
11 changes: 8 additions & 3 deletions docs/gambit/mutation-verifier.md
Original file line number Diff line number Diff line change
Expand Up @@ -191,14 +191,15 @@ We are actively working on mitigating them.

The mutation verification results are
summarized in a user-friendly visualization.
[Here](https://mutation-testing-beta.certora.com/?id=01623b02-0cda-435b-8c31-af9306d6d302&anonymousKey=857c3aeb-169c-4c93-8021-e82058603ca1)
is an example summary for the [advanced mutation of an ERC20 example](https://github.com/Certora/CertoraInit/blob/master/mutation/advanced_mutation.conf).

![Report of the advanced mutation of CertoraInit](doc/mutation_advanced_results.png)

[Here](https://mutation-testing-beta.certora.com/?id=01623b02-0cda-435b-8c31-af9306d6d302&anonymousKey=857c3aeb-169c-4c93-8021-e82058603ca1)
is an example summary for the
[advanced mutation of an ERC20 example](https://github.com/Certora/CertoraInit/blob/master/mutation/advanced_mutation.conf).
The green outer circles represent the rules,
and the gray dots represent the mutants.

![Report of the advanced mutation of CertoraInit](doc/mutation_advanced_results.png)

Selecting a rule shows which mutants it detected,
and selecting a mutant shows which rules caught it.
Expand All @@ -209,6 +210,10 @@ Clicking on a mutant's patch shows the difference between it and the original pr

![Showing a mutant patch](doc/show_mutant_patch.png)

### Metrics

![Mutation metrics](doc/mutation_metrics.png)

The Coverage metric is the ratio of the caught mutants to all mutants tested,
also shown under Caught Mutations.
The Rules metric shows the ratio of the rules that caught at least one mutation
Expand Down

0 comments on commit 53a05f3

Please sign in to comment.