#subquadratic-attention

AI & Machine LearningJune 1, 202614 min

SubQ: First Subquadratic LLM Ships 12M Context Window

SubQ from Subquadratic launches with a 12M-token context, a claimed 300x cost reduction on RULER 128K vs Claude Opus, and a wave of researcher skepticism.