DepthBench Tests DeepSeek and Frontier Labs on Architectural Depth
A new benchmark compares how different labs redesign the residual stream to overcome the 'curse of depth' in LLMs.
DeepSeek V4's mHC joins Kimi K3 and ByteDance's HC in a new comparative study, as researchers launch DepthBench to determine which architecture truly maximizes effective computational depth.