Workload::validate rejects total_ms > 600_000 with invalid deadline or buffering limits. A 400-token thinking-on prose cell on a 2×GB10 GLM serve runs ~20 tok/s per stream; with concurrency 2 and DFlash2 deferral one wave already took 112 s, and a long-context decode cell can legitimately exceed 10 min. Suggest raising the cap (or making it a CLI override) and improving the error to say which limit failed. Evidence: run dir decode-main-3584-attempt1-idle-timeout on our kit, idle_timeout after 120 s with Waiting: 2, Deferred: 2 on the server.
Workload::validaterejectstotal_ms > 600_000withinvalid deadline or buffering limits. A 400-token thinking-on prose cell on a 2×GB10 GLM serve runs ~20 tok/s per stream; with concurrency 2 and DFlash2 deferral one wave already took 112 s, and a long-context decode cell can legitimately exceed 10 min. Suggest raising the cap (or making it a CLI override) and improving the error to say which limit failed. Evidence: run dirdecode-main-3584-attempt1-idle-timeouton our kit,idle_timeoutafter 120 s withWaiting: 2, Deferred: 2on the server.