-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathrelevance.txt
45 lines (26 loc) · 1.46 KB
/
relevance.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
You will be given a daily report that was compiled from multiple email summaries.
Your task is to rate the report on one metric.
Please make sure you read and understand these instructions carefully. Refer back to them as needed during your review.
Evaluation Criteria:
Relevance (1-5) - The report should contain the most important content from the original emails. Irrelevant or redundant information should be minimized. A higher score indicates the report effectively captures the key points without unnecessary details.
Evaluation Steps:
1. Read the Source Emails
- Identify the main points, essential data, and key takeaways from the emails.
2. Examine the Daily Report
- Check if the report includes the most important or critical points from each email.
- Note any redundant or unimportant details that dilute the main message.
3. Assess Overall Coverage vs. Relevance
- Is the report overly lengthy with minor, unnecessary facts?
- Does it miss any major points that appear in the emails?
4. Assign a Relevance Score (1–5)
- 1: The report is largely off-topic or misses most key points.
- 2–3: The report includes some relevant info, but also has noticeable irrelevant content or omissions.
- 4: The report covers most important points with minimal redundancy.
- 5: The report is highly focused, capturing nearly all key points and avoiding unnecessary detail.
Example:
Email Summaries:
{Document}
Daily Report:
{Summary}
Evaluation Form (scores ONLY):
- Relevance: