Tag

#agent-evaluation

5 posts

AI & Machine LearningSeptember 24, 202613 min
OpenTelemetry gen_ai Attributes: 60 Deprecated in 2026
All 60 gen_ai attributes in OpenTelemetry's core semantic conventions are now deprecated. I audited every release: 8 renamed, 2 removed, 50 simply moved.
AI & Machine LearningAugust 26, 202615 min
AI Agent Reliability Benchmark 2026: 65% Once, 25% Always
ThinkingBox is a new AI agent reliability benchmark: the best model scores 65.36% pass@1 but only 25.25% pass^20 across 507 stateful business agent tasks.
AI & Machine LearningAugust 7, 202622 min
Muse Code Benchmarks 2026: The Harness Changed Too
Meta's Muse Code posts a big Terminal-Bench 2.1 gain over Muse Spark 1.1 — but the harness changed too. What the verified leaderboard says a harness is worth.
AI & Machine LearningAugust 5, 202630 min
AI Agent Reliability 2026: Structure Beats Instructions
Three July 2026 papers measured AI agent reliability: a verification loop added 1.5 points, guardrails recovered 19.9% of failures, prompt rules barely moved.
AI & Machine LearningJuly 15, 202621 min
Claude Agent SDK Observability With OpenTelemetry (2026)
Instrument a Claude Agent SDK loop with OpenTelemetry in TypeScript: enable trace export, read the claude_code span tree, and ship real spans to a backend.

Every post in #agent-evaluation (5)

OpenTelemetry gen_ai Attributes: 60 Deprecated in 2026