Skip to content

Commit

Permalink
Add documentation for the code repair task
Browse files Browse the repository at this point in the history
Part of #201
  • Loading branch information
ruiAzevedo19 committed Jul 11, 2024
1 parent 4f8922c commit c7bbc96
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -220,6 +220,21 @@ Currently, the following cases are available for this task:
- [`golang/plain`](testdata/golang/plain)
- [`golang/light`](testdata/golang/light)

### Task: Code Repair

Code repair is the task of repairing source code with compilation errors.

For this task, we introduced the `mistakes` repository, which includes examples of source code with compilation errors. Each example is isolated in its own package, along with a valid test suite. We compile each package in the `mistakes` repository and provide the LLM's with both the source code and the list of compilation errors. The LLM's response is then validated with the predefined test suite.

#### Cases

Currently, the following cases are available for this task:

- Java
- [`java/mistakes`](testdata/java/mistakes)
- Go
- [`golang/mistakes`](testdata/golang/mistakes)

### Reward Points

Currently, the following points are awarded for any task:
Expand Down

0 comments on commit c7bbc96

Please sign in to comment.