[feat](inverted-index) Add IK tokenizers to custom analyzers - #67918

Open

airborne12 wants to merge 53 commits into

apache:masterfrom

airborne12:feature/ik-custom-tokenizers

Commits on Sep 21, 2026

[feat](inverted-index) Add IK tokenizers to custom analyzers
airborne12
committed
d9993ed
[fix](inverted-index) Address IK analyzer review findings
airborne12
committed
34e1761
[fix](inverted-index) Preserve IK analyzer semantics
airborne12
committed
748c08d
[fix](inverted-index) Unify IK analyzer identities
airborne12
committed
979d1c3
[fix](inverted-index) Preserve IK analyzer semantics
airborne12
committed
c9595f6
[fix](inverted-index) Preserve IK pinyin source offsets
airborne12
committed
a93f752
[fix](inverted-index) Stabilize analyzer identity replay
airborne12
committed
02dc82e
[fix](inverted-index) Preserve custom analyzer replay semantics
airborne12
committed
b86bfa1
[fix](inverted-index) Canonicalize analyzer filter identities
airborne12
committed
8d99469
[fix](inverted-index) Preserve analyzer token offsets
airborne12
committed
e467aab
[fix](inverted-index) Preserve exact analyzer offsets
airborne12
committed
cc3bf33
[fix](inverted-index) Preserve exact legacy analyzer bindings
airborne12
committed
c8f7b67
[fix](inverted-index) Preserve analyzer bindings and token offsets
airborne12
committed
6b794e9
[test](inverted-index) Record deterministic MATCH regression output
airborne12
committed
b92b994
[fix](inverted-index) Preserve effective IK identities and index bindings
airborne12
committed
4501552
[fix](be) Preserve MATCH index bindings during BE-first upgrades
airborne12
committed
5597615
[fix](inverted-index) Contain analyzer failures and preserve fold identities
airborne12
committed
d1e7f89
[fix](inverted-index) Contain ARRAY analyzer failures
airborne12
committed
afe90dd
[fix](inverted-index) Preserve replayed policy semantics
airborne12
committed
4fbf21b
[fix](inverted-index) Preserve nested tokenizer bindings
airborne12
committed
d76f9a2
[fix](inverted-index) Preserve nested filter compatibility
airborne12
committed
afb3c5a
[fix](inverted-index) Preserve analyzer selection and pinyin offsets
airborne12
committed
ea23758
[fix](inverted-index) Bound ICU offset tracking memory
airborne12
committed
6ecc7e1
[fix](inverted-index) Address analyzer review feedback
airborne12
committed
20c49dd
[fix](inverted-index) Align duplicate analyzer test expectation
airborne12
committed
e9ef0ce
[fix](inverted-index) Close analyzer review findings
airborne12
committed
3145023

Commits on Sep 22, 2026

Commits on Sep 23, 2026

Commits on Sep 24, 2026