Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
chore(api/task): fix pre-existing ruff violations blocking Linters CI Tasks Modified #6682: Pull request #3999 synchronize by arrdel
Action required arrdel:chore/lint-task-py
arrdel:chore/lint-task-py
Action required
chore(api/task): fix pre-existing ruff violations blocking Linters CI Unit Tests #6655: Pull request #3999 synchronize by arrdel
Action required arrdel:chore/lint-task-py
arrdel:chore/lint-task-py
Action required
Add FlexRank model evaluation support Tasks Modified #6681: Pull request #4000 opened by RickZack
Action required RickZack:flexrank
RickZack:flexrank
Action required
Add FlexRank model evaluation support Unit Tests #6654: Pull request #4000 opened by RickZack
Action required RickZack:flexrank
RickZack:flexrank
Action required
chore(api/task): fix pre-existing ruff violations blocking Linters CI Tasks Modified #6680: Pull request #3999 opened by arrdel
Action required arrdel:chore/lint-task-py
arrdel:chore/lint-task-py
Action required
chore(api/task): fix pre-existing ruff violations blocking Linters CI Unit Tests #6653: Pull request #3999 opened by arrdel
-1s arrdel:chore/lint-task-py
arrdel:chore/lint-task-py
-1s
feat: add blimp_it italian grammar evaluation tasks Tasks Modified #6679: Pull request #3917 synchronize by cristianochesi
Action required cristianochesi:add-blimp-it-task
cristianochesi:add-blimp-it-task
Action required
feat: add blimp_it italian grammar evaluation tasks Unit Tests #6652: Pull request #3917 synchronize by cristianochesi
Action required cristianochesi:add-blimp-it-task
cristianochesi:add-blimp-it-task
Action required
Add task for SEGData (German VQA) Tasks Modified #6678: Pull request #3963 synchronize by baberabb
1m 7s redspottedbittern:SEGData
redspottedbittern:SEGData
1m 7s
Add task for SEGData (German VQA) Unit Tests #6651: Pull request #3963 synchronize by baberabb
5m 49s redspottedbittern:SEGData
redspottedbittern:SEGData
5m 49s
feat(legalbench): add Contract NLI suite (14 NDA entailment tasks) (#… Unit Tests #6650: Commit 8a07e11 pushed by baberabb
4m 49s main
main
4m 49s
feat(legalbench): add Contract NLI suite (14 NDA entailment tasks) (#… Tasks Modified #6677: Commit 8a07e11 pushed by baberabb
55s main
main
55s
Putnam Axiom (#3998) Unit Tests #6649: Commit 73da081 pushed by baberabb
5m 13s main
main
5m 13s
Putnam Axiom (#3998) Tasks Modified #6676: Commit 73da081 pushed by baberabb
1m 2s main
main
1m 2s
fix(filters): guard RegexFilter against out-of-range group_select Tasks Modified #6675: Pull request #3997 synchronize by kanishkaVarshini39
Action required kanishkaVarshini39:fix/group-select-indexerror
kanishkaVarshini39:fix/group-select-indexerror
Action required
fix(filters): guard RegexFilter against out-of-range group_select Unit Tests #6648: Pull request #3997 synchronize by kanishkaVarshini39
Action required kanishkaVarshini39:fix/group-select-indexerror
kanishkaVarshini39:fix/group-select-indexerror
Action required
Putnam Axiom Tasks Modified #6674: Pull request #3998 opened by baberabb
52s putnam_axiom
putnam_axiom
52s
Putnam Axiom Unit Tests #6647: Pull request #3998 opened by baberabb
5m 23s putnam_axiom
putnam_axiom
5m 23s
fix(filters): guard RegexFilter against out-of-range group_select Unit Tests #6646: Pull request #3997 opened by kanishkaVarshini39
Action required kanishkaVarshini39:fix/group-select-indexerror
kanishkaVarshini39:fix/group-select-indexerror
Action required
fix(filters): guard RegexFilter against out-of-range group_select Tasks Modified #6673: Pull request #3997 opened by kanishkaVarshini39
Action required kanishkaVarshini39:fix/group-select-indexerror
kanishkaVarshini39:fix/group-select-indexerror
Action required
fix: resolve fewshot gen_prefix against the fewshot doc (#3979) Tasks Modified #6672: Commit 72d2638 pushed by baberabb
41s main
main
41s
fix: resolve fewshot gen_prefix against the fewshot doc (#3979) Unit Tests #6645: Commit 72d2638 pushed by baberabb
5m 13s main
main
5m 13s
Add ifeval_pt to harness Tasks Modified #6671: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
Add ifeval_pt to harness Unit Tests #6644: Pull request #3622 synchronize by Nkluge-correa
Action required Polygl0t:ifeval_pt
Polygl0t:ifeval_pt
Action required
Honor configured timeout for synchronous API requests Tasks Modified #6670: Pull request #3995 synchronize by SiavashShams
9s SiavashShams:oss/api-sync-timeout-ignored-20260813-0100050700
SiavashShams:oss/api-sync-timeout-ignored-20260813-0100050700
9s