rishitdholakia13andCursor ded871201a [Bug][Structured Outputs] Fix bug that leads to unconstrained generations with structural tags (#42452) ...

Signed-off-by: rishitdholakia13 <rishit+github@cohere.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

2026-05-20 07:08:58 -07:00

..

attention

[feat] Add FP8 per-tensor Q scale support to Triton attention backend (#42080)

2026-05-19 09:02:05 -07:00

core

[bug] AsyncScheduler drops first post-resume token after pause_generation + clear_cache (#42117)

2026-05-19 01:06:21 -07:00

engine

[V1][DP][LB] Publish request counts at the start of each engine step (#41626)

2026-05-14 15:39:24 +00:00

executor

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

kv_offload

[KV Offload] Pass OffloadingSpec instead of VllmConfig to secondary tiers (#43076)

2026-05-20 03:32:08 +00:00

metrics

[Bugfix][Metrics] Fix RayPrometheusMetric.labels() returning shared labeled child (#40840)

2026-05-01 08:43:39 +01:00

pool

[chore] Refactor pooling metadata token ID accessors (#42368)

2026-05-13 06:08:01 +00:00

sample

[Perf][4/n] Eliminate various GPU<->CPU syncs (#42347)

2026-05-19 10:35:54 -04:00

simple_kv_offload

[Bugfix][KV Connector] Fix SimpleCPUOffloadScheduler TOCTOU between Phase A and Phase B (#42289)

2026-05-18 21:22:33 -07:00

spec_decode

[Bugfix] DFlash FP8 KV-Cache (#42692)

2026-05-15 08:29:45 -06:00

structured_output

[Bug][Structured Outputs] Fix bug that leads to unconstrained generations with structural tags (#42452)

2026-05-20 07:08:58 -07:00

worker

[Feature] Support manually enabling the cumem allocator (#33648)

2026-05-20 08:58:30 -04:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Experimental] Breakable CUDA graph (#42304)

2026-05-16 22:04:12 +08:00

kv_cache_interface.py

[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative decoding crash (#41233)

2026-05-18 14:54:00 +03:00

outputs.py

[RFC] Replace shared-memory routed experts with ModelRunnerOutput transfer and HTTP support (#39568)

2026-05-14 14:12:30 +00:00

request.py

[bug] AsyncScheduler drops first post-resume token after pause_generation + clear_cache (#42117)

2026-05-19 01:06:21 -07:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862)

2026-03-30 10:16:09 -07:00