Repository navigation
Commit b94f399
Ronald Tse
fix(distill): split label files on newline only
str.splitlines() fragments on U+0085/U+2028-class codepoints inside
Arabic label text, shredding healthy files into mid-JSON fragments —
the original '3 valid srcs' mystery. All label-file reads now split
on plain \n (verified locally: 11,793 srcs, 0 bad after the fix).1 parent 05bc2f0 commit b94f399
1 file changed
Lines changed: 3 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
781 | 781 | | |
782 | 782 | | |
783 | 783 | | |
784 | | - | |
| 784 | + | |
785 | 785 | | |
786 | 786 | | |
787 | 787 | | |
| |||
914 | 914 | | |
915 | 915 | | |
916 | 916 | | |
917 | | - | |
| 917 | + | |
918 | 918 | | |
919 | 919 | | |
920 | 920 | | |
| |||
1238 | 1238 | | |
1239 | 1239 | | |
1240 | 1240 | | |
1241 | | - | |
| 1241 | + | |
1242 | 1242 | | |
1243 | 1243 | | |
1244 | 1244 | | |
| |||
0 commit comments