Parallax: A Parameterized Local Linear Attention That Keeps Softmax and Adds a Learned Covariance Correction Branch
Low Severity
Global
Date OccurredJun 01, 202604:36 UTC
Event TypeAI News
SourceAI News
RecordedJun 01, 2026
Full Description
<p>Parallax replaces LLA's per-query solver with a learned projector, doubling arithmetic intensity and improving perplexity at 0.6B and 1.7B.</p>
<p>The post <a href="https://www.marktechpost.com/202