Nicolò Lucchesi 5b115bb8a3 [Attention][AMD] Standardize kv layout to blocks first for AMD (#43660) ...

Signed-off-by: NickLucche <nlucches@redhat.com>

2026-05-28 12:28:50 -05:00

..

attention

[Attention][AMD] Standardize kv layout to blocks first for AMD (#43660)

2026-05-28 12:28:50 -05:00

core

[EC Connector] Add shutdown API to EC Connector. (#42423)

2026-05-28 12:28:01 +00:00

engine

Log dummy DP step in iteration details (#41406)

2026-05-28 12:18:39 +00:00

executor

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

kv_offload

[KV Offload] Rename SecondaryTierManager.get_finished() to get_finished_jobs() (#43870)

2026-05-28 16:00:18 +00:00

metrics

[CPU] Migrate cpu_awq into awq_marlin (#43841)

2026-05-28 22:36:31 +08:00

pool

[Misc] Added missing return type annotations to improve mypy and IDE tooling (#43383)

2026-05-23 13:28:22 +08:00

sample

[XPU] Ensure RNG offset alignment with PyTorch requirements in XPU sampler (#43028)

2026-05-26 02:01:30 +00:00

simple_kv_offload

[Feat][KVConnector] Support DSV4 in SimpleCPUOffloadBackend (#42296)

2026-05-25 14:04:30 +08:00

spec_decode

[ROCm] [DSv4] [Perf] Support DeepSeek v4 MTP (#43385)

2026-05-24 18:43:08 +08:00

structured_output

[Bug][Structured Outputs] Fix bug that leads to unconstrained generations with structural tags (#42452)

2026-05-20 07:08:58 -07:00

worker

[Model Refactoring] Remove torch compile dependency in DSv4 (#43746)

2026-05-28 14:26:25 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Experimental] Breakable CUDA graph (#42304)

2026-05-16 22:04:12 +08:00

kv_cache_interface.py

[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative decoding crash (#41233)

2026-05-18 14:54:00 +03:00

outputs.py

[RFC] Replace shared-memory routed experts with ModelRunnerOutput transfer and HTTP support (#39568)

2026-05-14 14:12:30 +00:00

request.py

[bug] AsyncScheduler drops first post-resume token after pause_generation + clear_cache (#42117)

2026-05-19 01:06:21 -07:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Bug] Fix tests/distributed/test_elastic_ep.py - assert False (#43813)

2026-05-28 11:00:56 -04:00