LLM Weather Report

Tracking raw LLM reasoning drift — pure endpoint, no agents

gpt-5.4-mini dropped on spatial-1. gpt-5.4-mini failing spatial-1. gemini-2.5-flash, gemini-2.5-flash scores rising.

April 15, 2026 — 5:34 AM CT

Drift Alerts

Scorecard

Modelambiguity-1causality-1code-1common-sense-1logic-1math-1spatial-1
anthropic/claude-haiku-4-5✓ (4.4)✓ (4.67)✓ (4.67)✓ (3.2)✓ (5)✓ (5)✓ (5)
anthropic/claude-opus-4-6✓ (5)✓ (4.8)✓ (4.67)✓ (4.4)✓ (5)✓ (5)✓ (5)
anthropic/claude-sonnet-4-6✓ (4.67)✓ (4.83)✓ (4.33)✓ (3.5)✓ (5)✓ (5)✓ (5)
gemini/gemini-2.5-flash✓ (4.8)✓ (5)was 3.6✓ (4.67)✓ (4.8)was 3.6✓ (5)✓ (5)✓ (5)
gemini/gemini-2.5-pro✓ (4.33)✓ (5)✓ (4.5)✓ (5)✓ (5)✓ (4.83)✓ (5)
ollama/llama3
openai/gpt-5.4✓ (4.33)✓ (5)✓ (4.8)✓ (4.5)✓ (4.67)✓ (5)✓ (5)
openai/gpt-5.4-mini✓ (4.8)✓ (5)✓ (4.8)✓ (4.4)✓ (4.8)✓ (5)✗ (2.6)was 3.6

Model Status

Raw Data