Skip to content

Commit 4ec117f

Browse files
authored
Move pytrec_eval to its own optional dependencies section (#3470)
1 parent 16452fa commit 4ec117f

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

setup.cfg

+4-1
Original file line numberDiff line numberDiff line change
@@ -77,12 +77,14 @@ scenarios =
7777
metrics =
7878
google-api-python-client~=2.64 # For perspective_api_client via toxicity_metrics
7979
numba~=0.56 # For copyright_metrics
80-
pytrec_eval==0.5 # For ranking_metrics
8180
sacrebleu~=2.2.1 # For disinformation_metrics, machine_translation_metrics
8281
langdetect~=1.0.9 # For ifeval_metrics
8382
immutabledict~=4.2.0 # For ifeval_metrics
8483
gradio_client~=1.3 # For bigcodebench_metrics
8584

85+
ranking =
86+
pytrec_eval==0.5 # For ranking_metrics
87+
8688
summarization =
8789
summ-eval~=0.892 # For summarization_metrics
8890
bert-score~=0.3 # For summarization_metrics
@@ -338,6 +340,7 @@ all =
338340
# crfm-helm[seahelm] is excluded because pyonmttok does not support Python 3.12
339341
# crfm-helm[dev] is excluded because end-users don't need it.
340342
# crfm-helm[summarize] is excluded because it requires torch<2.0
343+
# crfm-helm[ranking] is excluded because pytrec_eval causes build errors (see #3470)
341344
# TODO(#2280): Add crfm-helm[summarize] back.
342345

343346
# Development only

0 commit comments

Comments
 (0)