Skip to content

Use automatic estimator batching by default - #1009

Closed
RBendias wants to merge 0 commit into
cleanup/benchmark-auto-batchingfrom
change/default-auto-estimator-batching
Closed

RBendias wants to merge 0 commit into
cleanup/benchmark-auto-batchingfrom
change/default-auto-estimator-batching

Conversation

@RBendias

Copy link
Copy Markdown
Collaborator

Change the default estimator_batch_size for ICLModel.forward, ICLModel.fit, and the internal member execution path from 1 to "auto".

Explicit 1 remains available for minimum-memory sequential execution, and None still batches as many compatible estimators as possible. The automatic planner itself is introduced and tested separately in #1007; the benchmark integration is in #1008.

Depends on #1007 and #1008. Related: #989 and #994.

@copy-pr-bot

copy-pr-bot Bot commented Sep 28, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@RBendias
RBendias force-pushed the change/default-auto-estimator-batching branch from 651d42b to 9d1e5dd Compare September 28, 2026 14:52
@RBendias
RBendias marked this pull request as ready for review September 28, 2026 15:45
@RBendias
RBendias force-pushed the cleanup/benchmark-auto-batching branch 2 times, most recently from 404be1c to 60dd30e Compare September 29, 2026 10:46
@RBendias RBendias closed this Sep 29, 2026
@RBendias
RBendias force-pushed the change/default-auto-estimator-batching branch from 9d1e5dd to 60dd30e Compare September 29, 2026 10:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant