Repository navigation
Commit fe14708
Ronald Tse
feat(specs): heb-diac-small-s46-layerdrop — cross-lingual depth-cut replication
Item 04: the Arabic width/depth finding replicated on Hebrew — encoder
12->6 verbatim layer copy from pretrained ByT5-small, single variable
vs run-002-s46 (same s46 teacher, hebrew-v4 corpus, 3 epochs). Wires
_maybe_stitch into the logit-KD custom-config branch so depth-cut
students keep the pretrained init there too (previously random-init,
which the capacity law rejects).1 parent 00d4efa commit fe14708
2 files changed
Lines changed: 26 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
527 | 527 | | |
528 | 528 | | |
529 | 529 | | |
| 530 | + | |
| 531 | + | |
| 532 | + | |
| 533 | + | |
| 534 | + | |
| 535 | + | |
| 536 | + | |
| 537 | + | |
| 538 | + | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
| 543 | + | |
| 544 | + | |
| 545 | + | |
| 546 | + | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
| 550 | + | |
| 551 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
311 | 311 | | |
312 | 312 | | |
313 | 313 | | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
314 | 318 | | |
315 | 319 | | |
316 | 320 | | |
| |||
0 commit comments