LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Ecosystems
Launchpads

Search

Other

bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

29mo ago

Recent commits

Latest commits.

Merge pull request #190 from ganler/mbppplus
00967d1Loubna Ben Allal29mo ago
docs
5d4bc98ganler29mo ago
refactor: allow evaluating mbpp+ tasks on mbpp base tests
5d9a4c7ganler29mo ago
feat: add mbpp+ evaluation task
89b4c1dganler29mo ago
Merge pull request #187 from ganler/heplus
9cfa52bLoubna Ben Allal29mo ago

feat(docs): humaneval+

b62e7a6ganler29mo ago

refactor: set the de facto timeout for HumanEval+ to be 10s

301f936ganler29mo ago

feat: add humaneval+ evaluation task

2873e21ganler29mo ago

Top contributors

Builders behind this project.