Skip to content

wip: accelerate tokenizator with simd - #365

Draft
dkharms wants to merge 2 commits into
mainfrom
0-simd-tokenizer
Draft

wip: accelerate tokenizator with simd#365
dkharms wants to merge 2 commits into
mainfrom
0-simd-tokenizer

perf: reduce allocations

e1d18b5
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar