Skip to content

Commit

Permalink
pgr
Browse files Browse the repository at this point in the history
  • Loading branch information
SeungoneKim committed Dec 6, 2024
1 parent a18536a commit e2f55ae
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/index.markdown
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ In AgoraBench, we cover the following data generation methods:

## Metrics
{: .sys-img}
![Performance Gap Recovered (PGR) metric used in AgoraBench.](/assets/img/metrics.png)
![Performance Gap Recovered (PGR) metric used in AgoraBench.](/assets/img/pgr.png)

<br>
To quantify the quality of the generated data (i.e., data generation capability), we propose a new metric called **Performance Gap Recovered (PGR)**. On a high level, PGR measures how much a student model trained on the synthetic data improves over its base model compared to a reference model that shares the same base model.
Expand Down

0 comments on commit e2f55ae

Please sign in to comment.