chore(sdk): upgrade to Neuron SDK 2.31 - #1113

Open

tengomucho wants to merge 23 commits into

mainfrom

Commits on Aug 20, 2026

chore(deps): move to Neuron SDK 2.31

tengomucho
and
claude
committed
39ad88f
chore: bump version to 0.4.7.dev0 and SDK version to 2.31.0

tengomucho
and
claude
committed
90fe9ed
fix(tests): isolate cache-test exports to fix Hub cache-hit checks
tengomucho
committed
79d0326
fix(generation): break greedy ties with argmax over the full logits

tengomucho
and
claude
committed
ab56830
fix(tests): add known-divergence escape for VLM cross-chunk case
tengomucho
committed
9154434
fix(vllm): port plugin to vllm 0.16.0 module layout
tengomucho
committed
bfd2634
chore(ci): align Neuron runtime pins with SDK 2.31
tengomucho
committed
66bbc4e
chore(deps): move vllm to 0.16.0
tengomucho
committed
ce6b617
fix(gemma3): keep flash attention softmax in fp32 for head_dim > 128
tengomucho
committed
f3e9079
fix(vllm): make ModelConfig parallel-config patch picklable for spawn
tengomucho
committed
a2270b4
fix(vllm): force spawn for EngineCore to avoid NRT fork deadlock

tengomucho
and
claude
committed
534c073
test(exporters): skip conv models crashing the SDK 2.31 tracer

tengomucho
and
claude
committed
26be3cb
ci(workflows): move runners to Ubuntu 24.04

tengomucho
and
claude
committed
1a54834
ci(actions): bump venv python to 3.12 and cpu torch to 2.9

tengomucho
and
claude
committed
b5429cb
docs(contribute): update minimum python to 3.12

tengomucho
and
claude
committed
701df47
fix(inference): compile NxD models from a scratch cwd

tengomucho
and
claude
committed
578d6a7
ci(actions): install libpython3.12 and libarchive13 for SDK 2.31

tengomucho
and
claude
committed
df4c666

Commits on Aug 21, 2026

fix(exporters): do not overwrite the KV cache parameters when reordering

tengomucho
and
claude
committed
eb52946
test(utils): share the SDK 2.31 tracer crash skip helper

tengomucho
and
claude
committed
ff5f6c6
test(inference): skip models crashing the SDK 2.31 tracer

tengomucho
and
claude
committed
0780b30

Commits on Aug 22, 2026

fix(tests): always stop the vLLM container on test failure

tengomucho
and
claude
committed
d5d4c13
test(vllm): retry sampling before comparing it to greedy

tengomucho
and
claude
committed
8d044f8

Commits on Aug 24, 2026

fix(docker): upgrade vLLM image to Ubuntu 24.04

tengomucho
and
claude
committed
4dd58b9