From 53a05f36dd3e5cfde035c9088a05cfebefcb81a6 Mon Sep 17 00:00:00 2001 From: urikirsh Date: Mon, 1 Jan 2024 19:04:27 +0200 Subject: [PATCH] added metrics screenshot, changing paragraph break --- docs/gambit/mutation-verifier.md | 11 ++++++++--- 1 file changed, 8 insertions(+), 3 deletions(-) diff --git a/docs/gambit/mutation-verifier.md b/docs/gambit/mutation-verifier.md index 4aa59d85..5be027a3 100644 --- a/docs/gambit/mutation-verifier.md +++ b/docs/gambit/mutation-verifier.md @@ -191,14 +191,15 @@ We are actively working on mitigating them. The mutation verification results are summarized in a user-friendly visualization. -[Here](https://mutation-testing-beta.certora.com/?id=01623b02-0cda-435b-8c31-af9306d6d302&anonymousKey=857c3aeb-169c-4c93-8021-e82058603ca1) - is an example summary for the [advanced mutation of an ERC20 example](https://github.com/Certora/CertoraInit/blob/master/mutation/advanced_mutation.conf). -![Report of the advanced mutation of CertoraInit](doc/mutation_advanced_results.png) +[Here](https://mutation-testing-beta.certora.com/?id=01623b02-0cda-435b-8c31-af9306d6d302&anonymousKey=857c3aeb-169c-4c93-8021-e82058603ca1) + is an example summary for the + [advanced mutation of an ERC20 example](https://github.com/Certora/CertoraInit/blob/master/mutation/advanced_mutation.conf). The green outer circles represent the rules, and the gray dots represent the mutants. +![Report of the advanced mutation of CertoraInit](doc/mutation_advanced_results.png) Selecting a rule shows which mutants it detected, and selecting a mutant shows which rules caught it. @@ -209,6 +210,10 @@ Clicking on a mutant's patch shows the difference between it and the original pr ![Showing a mutant patch](doc/show_mutant_patch.png) +### Metrics + +![Mutation metrics](doc/mutation_metrics.png) + The Coverage metric is the ratio of the caught mutants to all mutants tested, also shown under Caught Mutations. The Rules metric shows the ratio of the rules that caught at least one mutation