Reduce memory for no-KV KumoTabular - #996

Closed

JingangQu wants to merge 9 commits into

change/default-auto-estimator-batchingfrom

Commits on Sep 28, 2026

Share the device chunk memory limit

JingangQu
authored and
ValterH
committed
10aafeb
Reduce recipe memory on wide contexts

JingangQu
authored and
ValterH
committed
9a21b34
Embed KumoTabular query rows in passes within the chunk memory limit

JingangQu
authored and
ValterH
committed
41c20d5
Transform query rows and model outputs in passes

JingangQu
authored and
ValterH
committed
1f17b35
Fix heterogeneous ensemble row preprocessing

cedric-lorenz
authored and
ValterH
committed
1adb035
Preserve gradients through clipping

cedric-lorenz
authored and
ValterH
committed
64b23ea
Preserve estimator output dtypes

cedric-lorenz
authored and
ValterH
committed
c71f0c3
Reject mismatched ensemble row counts

cedric-lorenz
authored and
ValterH
committed
53e6ae6
cleanup after rebase
ValterH
committed
4e58b39