Claude 3 Sonnet on HumanEval: Score Breakdown

Claude 3 Sonnet × HumanEval

Score Breakdown

Model RankingScore
#66 / 20574.5

Performance Analysis

Claude 3 Sonnet achieves 74.5 on HumanEval.