---
title: HumanEval
author: coder
date: 2021-07-07 00:00:00 +0800
categories: [arxiv]
tags: [benchmarks]
math: true
---

- 🗂️Benchmark Name: [HumanEval](https://arxiv.org/pdf/2107.03374.pdf)
- 📚Publisher/Date: `Arxiv/2022`
- 🏠Author Affiliation: `OpenAI`
- 🔗URL: [https://github.com/openai/human-eval](https://github.com/openai/human-eval)
- Number of Instances: `164`
- Problem Description's Natural Language: `English`
- Code Solution's Programming Language: `Python`
- Data Statistics
  + Test Case: ✅
  + Average Number of Test Cases: `7.8`
  + Average Number of Characters in Problem Description: `450.6`
  + Average Number of Lines in Problem Description: `13.7`
  + Average Number of Characters in Code Solution: `180.9`
  + Average Number of Lines in Code Solution: `6.8`
- Scenario: `Code Exercise`