LLM Weather Report

Tracking raw LLM reasoning drift — pure endpoint, no agents

gemini-2.5-flash dropped on common-sense-1. gpt-5.4-mini failing spatial-1. gemini-2.5-pro recovering. gpt-5.4-mini, gpt-5.4-mini scores rising.

April 15, 2026 — 12:30 PM CT

Drift Alerts

Scorecard

Modelambiguity-1causality-1code-1common-sense-1logic-1math-1spatial-1
anthropic/claude-haiku-4-5✓ (4.5)✓ (4.67)✓ (4.67)✓ (3.33)✓ (5)✓ (5)✓ (5)
anthropic/claude-opus-4-6✓ (5)✓ (5)✓ (4.8)✓ (4.33)✓ (5)✓ (5)✓ (5)
anthropic/claude-sonnet-4-6✓ (4.5)✓ (4.83)✓ (4.4)✓ (4.33)✓ (4.83)✓ (5)✓ (5)
gemini/gemini-2.5-flash✓ (4.5)✓ (3.67)✓ (4.5)✓ (2.8)was 4.5✓ (5)✓ (5)✓ (5)
gemini/gemini-2.5-pro✓ (4.33)✓ (4.83)✓ (4.83)✓ (5)was ✗ ()✓ (5)✓ (5)✓ (5)
ollama/llama3
openai/gpt-5.4✓ (4.5)✓ (4.83)✓ (4.83)✓ (4.33)✓ (4.83)✓ (4.6)✓ (5)
openai/gpt-5.4-mini✓ (5)✓ (4.83)✓ (4.8)✓ (4)✓ (5)✓ (5)was 4✗ (3.67)was 2.4

Model Status

Raw Data