From 762958f0da4ac4284dcac48b725b0e682aa081cf Mon Sep 17 00:00:00 2001 From: Collin Dutter Date: Wed, 19 Feb 2025 15:28:27 -0800 Subject: [PATCH] fix(engines-eval): fix evaluation parameters not being included in prompt (#1751) --- griptape/templates/engines/eval/results/system.j2 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/griptape/templates/engines/eval/results/system.j2 b/griptape/templates/engines/eval/results/system.j2 index 3cd9c0780..508d20df6 100644 --- a/griptape/templates/engines/eval/results/system.j2 +++ b/griptape/templates/engines/eval/results/system.j2 @@ -1,6 +1,6 @@ Given the evaluation steps, return a JSON with two keys: 1) a `score` key ranging from 0 - 10, with 10 being that it follows the criteria outlined in the steps and 0 being that it does not. -2) a `reason` key, a reason for the given score. Please mention specific information from {{ parameters }} in your reason, but be very concise with it! +2) a `reason` key, a reason for the given score. Please mention specific information from {{ evaluation_params }} in your reason, but be very concise with it! Evaluation Steps: {{ evaluation_steps }}