youkaichaoandWoosuk Kwon 330e82d34a [v1][torch.compile] support managing cudagraph buffer (#10203) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2024-11-11 11:10:27 -08:00

..

__init__.py

[torch.compile] avoid Dynamo guard evaluation overhead (#7898)

2024-08-28 16:10:12 -07:00

backends.py

[v1][torch.compile] support managing cudagraph buffer (#10203)

2024-11-11 11:10:27 -08:00

compile_context.py

[torch.compile] integration with compilation control (#9058)

2024-10-10 12:39:36 -07:00

config.py

[v1][torch.compile] support managing cudagraph buffer (#10203)

2024-11-11 11:10:27 -08:00

counter.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

decorators.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

fusion.py

[torch.compile] Fuse RMSNorm with quant (#9138)

2024-11-08 21:20:08 +00:00

inductor_pass.py

[torch.compile] Fuse RMSNorm with quant (#9138)

2024-11-08 21:20:08 +00:00

levels.py

[torch.compile] rework compile control with piecewise cudagraph (#9715)

2024-10-29 23:03:49 -07:00

reshapes.py

[torch.compile] Fuse RMSNorm with quant (#9138)

2024-11-08 21:20:08 +00:00

wrapper.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00