feat(plugin): add Future-returning typed LLM intercepts - #732

Closed

afourniernv wants to merge 33 commits into

NVIDIA:mainfrom

afourniernv:feat/typed-future-native-middleware

Commits on Aug 3, 2026

feat(plugin): add native API v2 LLM dispatch
bbednarski9
committed
8d58cce
fix(plugin): bound native API v2 provider streams
bbednarski9
committed
934d2b2
fix(plugin): harden native API v2 streams
bbednarski9
committed
1e15451
refactor(plugin): use targeted HTTP LLM dispatch
bbednarski9
committed
59f59d7
refactor(plugin): clarify LLM continuation types
bbednarski9
committed
de3fd45
refactor(plugin): move targeted LLM dispatch into core
bbednarski9
committed
a455841
fix(plugin): harden targeted LLM continuations
bbednarski9
committed
79d6d1c
feat(plugin): add safe native API v2 continuations
bbednarski9
committed
c960ec9
docs(plugin): document safe native API v2 facade
bbednarski9
committed
2025301
fix(runtime): use registered targeted dispatch log target
bbednarski9
committed
43589ea
fix(plugin): avoid safe callback thread-local teardown
bbednarski9
committed
ec26390
test(plugin): cover safe v2 failure paths
bbednarski9
committed
1821bc4
test(plugin): harden native v2 host failure paths
bbednarski9
committed
007b19b
refactor(plugin): narrow continuation transport contract
bbednarski9
committed
59ca422
refactor(plugin): poll native v2 callbacks cooperatively
bbednarski9
committed
38a11fb
docs(plugin): require executor-neutral native futures
bbednarski9
committed
6b470b0
refactor(plugin): simplify targeted LLM continuations
bbednarski9
committed
c14057b
refactor(plugin): remove native v2 continuation duplication
bbednarski9
committed
fc02743
refactor(plugin): trim native v2 policy surface
bbednarski9
committed
53ba86a
fix(plugin): preserve targets across continuation hops
bbednarski9
committed
5bbbce1
docs(plugin): clarify cooperative continuation semantics
bbednarski9
committed
ad2f60e
fix(runtime): bound targeted buffered responses
bbednarski9
committed
3861d63
refactor(plugin): share bounded native stream capacity
bbednarski9
committed
82141cf
fix(plugin): address native API v2 review findings
bbednarski9
committed
85e72ed
fix(core): bound and preserve targeted SSE frames
bbednarski9
committed
cbd9943
fix(plugin): correct 32-bit host table assertions
bbednarski9
committed
a83f142
docs(plugin): clarify native API v2 compatibility
bbednarski9
committed
5918f8c
test(plugin): cover native stream error cleanup
bbednarski9
committed
ec8f9cd
test(plugin): reconcile native lifecycle coverage
bbednarski9
committed
a5acddf
test(plugin): gate Unix-only native callbacks
bbednarski9
committed
6dac757
test(plugin): split native layout assertions
bbednarski9
committed
6598e0c
test(plugin): split native failure assertions
bbednarski9
committed
3a8f8f0

Commits on Aug 7, 2026

feat(plugin): add Future-returning typed LLM intercepts
afourniernv
committed
a545f6e

Navigation Menu

Uh oh!

feat(plugin): add Future-returning typed LLM intercepts - #732

feat(plugin): add Future-returning typed LLM intercepts#732
afourniernv wants to merge 33 commits into
NVIDIA:mainfrom
afourniernv:feat/typed-future-native-middleware

Commits on Aug 3, 2026

feat(plugin): add native API v2 LLM dispatch

fix(plugin): bound native API v2 provider streams

fix(plugin): harden native API v2 streams

refactor(plugin): use targeted HTTP LLM dispatch

refactor(plugin): clarify LLM continuation types

refactor(plugin): move targeted LLM dispatch into core

fix(plugin): harden targeted LLM continuations

feat(plugin): add safe native API v2 continuations

docs(plugin): document safe native API v2 facade

fix(runtime): use registered targeted dispatch log target

fix(plugin): avoid safe callback thread-local teardown

test(plugin): cover safe v2 failure paths

test(plugin): harden native v2 host failure paths

refactor(plugin): narrow continuation transport contract

refactor(plugin): poll native v2 callbacks cooperatively

docs(plugin): require executor-neutral native futures

refactor(plugin): simplify targeted LLM continuations

refactor(plugin): remove native v2 continuation duplication

refactor(plugin): trim native v2 policy surface

fix(plugin): preserve targets across continuation hops

docs(plugin): clarify cooperative continuation semantics

fix(runtime): bound targeted buffered responses

refactor(plugin): share bounded native stream capacity

fix(plugin): address native API v2 review findings

fix(core): bound and preserve targeted SSE frames

fix(plugin): correct 32-bit host table assertions

docs(plugin): clarify native API v2 compatibility

test(plugin): cover native stream error cleanup

test(plugin): reconcile native lifecycle coverage

test(plugin): gate Unix-only native callbacks

test(plugin): split native layout assertions

test(plugin): split native failure assertions

Commits on Aug 7, 2026

feat(plugin): add Future-returning typed LLM intercepts