iHore/J-Wash
8
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Clarify read projection usage in README

Browse Source 
Added note about read projection usage for exporting results.
This commit is contained in:
Extraltodeus
2026-07-15 22:02:00 +02:00
committed by GitHub
parent dd00c898d2
commit 007bc53165
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+4
View File
@@ -234,8 +234,12 @@ editing. A mode toggle switches between:
- **Read projection** (pure-weights) — a change of basis of the downstream reads so - **Read projection** (pure-weights) — a change of basis of the downstream reads so
the **live preview matches the exported checkpoint exactly**. Use this to save a model and preview the result. the **live preview matches the exported checkpoint exactly**. Use this to save a model and preview the result.
#### Read projection is what you want to use if your intent is to export the result.
![projection](assets/projection.png) ![projection](assets/projection.png)
> **Architecture note**: models whose layers normalize their *writes* into the > **Architecture note**: models whose layers normalize their *writes* into the
> residual stream (Gemma 2/3 style, `pre/post_feedforward_layernorm`) can't take > residual stream (Gemma 2/3 style, `pre/post_feedforward_layernorm`) can't take
> the read projection. On those, the toggle offers **Global projection** (W_U > the read projection. On those, the toggle offers **Global projection** (W_U