Add one-head nanoGPT Attention Residuals baseline - #60

Draft

charlesmartin14 wants to merge 10 commits into

mainfrom

agent/nanogpt-attnres-baseline

Commits on Aug 12, 2026

Add full attention residual routing
charlesmartin14
committed
1255b9b
Add matched AttnRes long-horizon config
charlesmartin14
committed
abee03f
Add conservative long-cosine Muon control
charlesmartin14
committed
178f580
Add conservative AttnRes long-cosine config
charlesmartin14
committed
7cdc1b5
Test attention residual baseline
charlesmartin14
committed
05a8257
Document Attention Residuals baseline
charlesmartin14
committed
a00c7fe
Correct Full AttnRes replacement semantics
charlesmartin14
committed
1d3a39b
Clarify Full AttnRes sublayer semantics
charlesmartin14
committed
3647d4c
Add matched short AttnRes reference config
charlesmartin14
committed
052e8a9
Document short and long AttnRes CLI runs
charlesmartin14
committed
46b4bda