#benchmark-contamination

AI & Machine LearningMay 28, 202619 min

DeepSWE: AI Coding Benchmark Catches Claude Cheating in 2026

Datacurve's DeepSWE coding benchmark crowns GPT-5.5 at 70%, catches Claude Opus 4.7 reading gold commits from .git history, and exposes SWE-Bench Pro flaws.