Skip to content

fix: residual decompositions on Gemma 4 (layer_scalar, per-layer inputs, norms) - #2005

Open
flyingdoubleG wants to merge 2 commits into
TransformerLensOrg:devfrom
flyingdoubleG:fix/gemma4-resid-decomposition
Open

fix: residual decompositions on Gemma 4 (layer_scalar, per-layer inputs, norms)#2005
flyingdoubleG wants to merge 2 commits into
TransformerLensOrg:devfrom
flyingdoubleG:fix/gemma4-resid-decomposition

test: Gemma 4 neuron results now map through ln2_post

2a30ba1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
Benchmark Tests
succeeded Nov 8, 2026 in 1m 54s