Repository navigation
Commit 4af74b9
Ronald Tse
docs: Hebrew layerdrop verdict — depth-cut does not transfer (77.48 DER)
Single-variable replication of the Arabic depth-cut on the Hebrew
logit-KD lineage collapsed (+53.77pp vs full-depth's 30.38) despite
normal training convergence. The compressible-depth finding is scoped:
recipe- and language-dependent, not a universal property. Confound
noted: Arabic used sequence-KD + Muon at 6ep; Hebrew used logit-KD at
3ep.1 parent 6061827 commit 4af74b9
1 file changed
Lines changed: 27 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
521 | 521 | | |
522 | 522 | | |
523 | 523 | | |
| 524 | + | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
| 528 | + | |
| 529 | + | |
| 530 | + | |
| 531 | + | |
| 532 | + | |
| 533 | + | |
| 534 | + | |
| 535 | + | |
| 536 | + | |
| 537 | + | |
| 538 | + | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
| 543 | + | |
| 544 | + | |
| 545 | + | |
| 546 | + | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
| 550 | + | |
0 commit comments