LLM Weather Report

Tracking raw LLM reasoning drift — pure endpoint, no agents

gpt-5.4-mini failing spatial-1; gemini-2.5-flash failing causality-1. claude-sonnet-4-6, claude-haiku-4-5 recovering. gpt-5.4 scores rising.

April 21, 2026 — 12:28 PM CT

Drift Alerts

Provider Status

Scorecard

Modelambiguity-1causality-1code-1common-sense-1logic-1math-1spatial-1
anthropic/claude-haiku-4-5✓ (4.17)✓ (4.5)✓ (4.5)✓ (3.17)was ✗ (2.75)✓ (5)✓ (5)✓ (5)
anthropic/claude-opus-4-6✓ (4.83)✓ (4.67)✓ (4.67)✓ (4.33)✓ (5)✓ (5)✓ (5)
anthropic/claude-sonnet-4-6✓ (4.5)✓ (4.83)✓ (4.33)✓ (3.67)was ✗ (3)✓ (5)✓ (5)✓ (5)
gemini/gemini-2.5-flash✓ (4.5)✗ (2.33)✓ (4.83)✓ (3.83)✓ (4.83)✓ (5)✓ (5)
gemini/gemini-2.5-pro✓ (4.5)✓ (5)✓ (4.5)✓ (4.33)✓ (5)✓ (5)✓ (4.83)
ollama/llama3
openai/gpt-5.4✓ (4.33)✓ (4.83)✓ (4.67)✓ (4.33)✓ (5)✓ (5)was 3.8✓ (5)
openai/gpt-5.4-mini✓ (4.67)✓ (5)✓ (4.67)✓ (4.33)✓ (4.83)✓ (4.67)✗ (3.67)

Model Status

Raw Data