On-premise Hosting Recommendation: Claude 3.5 Sonnet
On-premise Hosting → Claude 3.5 Sonnet
Use Case Overview
Claude 3.5 Sonnet by Anthropic is a recommended option for the On-premise Hosting use case.
Recommended Models
| Rank | Vendor | Context Window | Score |
|---|
| #8 | Anthropic | 200K | 17/100 |
| Benchmark | Score |
|---|
| MMLU | 88.7 |
| HUMANEVAL | 92.0 |
| GSM8K | 96.4 |
| MATH | 71.1 |
| BBH | 84.5 |
Strengths
- MMLU score 88.7, strong knowledge reasoning.
- HumanEval 92.0, excellent code generation.
- GSM8K 96.4, robust math reasoning.
- Context window 200K.
Requirements
- API key from anthropic
- Input length within 200K context window