Key Specifications

SpecificationStarCoder2 15BCode Llama 34B
Vendorothermeta
Versionstarcoder2-15bcode-llama-34b
Release Date2024-02-282023-08-24
Context Window16384 tokens16000 tokens
Input Modalitiestexttext
Output Modalitiestexttext
LicenseBigCode Open Model LicenseLlama 2 Community License
SOC2
HIPAA
GDPR
ISO 27001

Benchmark Results

BenchmarkStarCoder2 15BCode Llama 34BWinner
ARC87.688.7Code Llama 34B
BBH62.859.1StarCoder2 15B
GPQA35.327StarCoder2 15B
GSM8K69.659.8StarCoder2 15B
HUMANEVAL73.571.7StarCoder2 15B
IFEVAL59.658.7StarCoder2 15B
MATH46.244.7StarCoder2 15B
MMLU60.674.5Code Llama 34B
MUSR51.744.9StarCoder2 15B
WINOGRANDE70.280Code Llama 34B

Pricing Comparison

Tier (per Mtok)StarCoder2 15BCode Llama 34B
Input$0.3$0.5
Output$0.3$0.5
Cache Read$0$0
Cache Write$0$0

StarCoder2 15B vs Code Llama 34B

Model Overview

StarCoder2 15B and Code Llama 34B are both notable options in the AI model market. This page compares their benchmarks, pricing, and compliance.

Key Specifications

VendorRelease DateContext WindowLicense
Other / Meta2024-02-28 / 2023-08-2416K / 16KBigCode Open Model License / Llama 2 Community License

Benchmark Performance

BenchmarkStarCoder2 15BCode Llama 34BWinner
ARC87.688.7B
BBH (BIG-Bench Hard)62.859.1A
GPQA35.327.0A
GSM8K (Grade School Math 8K)69.659.8A
HumanEval73.571.7A
IFEval59.658.7A
MATH46.244.7A
MMLU (Massive Multitask Language Understanding)60.674.5B
MUSR51.744.9A
WinoGrande70.280.0B

Pricing Comparison

InputOutputCache ReadCache Write
— / —— / —— / —— / —

per million tokens — A / B

Strengths & Weaknesses

StarCoder2 15B

  • ✅ Reliable general-purpose model.
  • ⚠️ Proprietary, not self-hostable.
  • ⚠️ Context window 16K is limited.

Code Llama 34B

  • ✅ Reliable general-purpose model.
  • ⚠️ Proprietary, not self-hostable.
  • ⚠️ Context window 16K is limited.

Editor’s Take

StarCoder2 15B and Code Llama 34B each have their strengths. Choose based on workload (code, long context, vision), referencing the tables above.

FAQ

Which model is better for coding tasks?

Refer to the HumanEval benchmark table; the model with a higher score is better suited for coding tasks.

Which model is cheaper?

Refer to the pricing comparison table above; the model with lower input/output prices is more cost-effective.

Which has a longer context window?

Refer to the key specifications table; the model with a larger context window is better for long documents.

References

Editor's Take

See Editor's Take section.