Chen Zhang 17373dcd93 [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) ...

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

2025-08-22 05:05:59 +00:00

..

layers

[Feature] Enable DeepGEMM Linear on B200; 1.5% E2E throughput improvement (#23351)

2025-08-21 21:01:08 -07:00

model_loader

[Bugfix] Fix extra whitespace in strings caused by newline (#23272)

2025-08-20 22:03:00 -07:00

models

[Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154)

2025-08-22 05:05:59 +00:00

warmup

[Kernel] Add nvfp4 gemm flashinfer backends (#22346)

2025-08-14 16:03:55 -04:00

__init__.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

custom_op.py

Optimize configuration access with LRU cache in custom ops (#22204)

2025-08-04 21:43:24 -07:00

parameter.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

pooling_metadata.py

[Performance] V1 Pooling Models E2E Performance Optimization (#23162)

2025-08-21 13:26:09 +00:00

sampling_metadata.py

Revert "Update sampling_metadata.py (#21937)" (#22088)

2025-08-01 05:24:46 -07:00

utils.py

[Quantization] Enable BNB support for InternS1 (#21953)

2025-08-01 11:09:54 +00:00