 Mark McLoughlin
|
46fb056749
|
[V1][Metrics] Add TTFT and TPOT histograms (#12530)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
|
2025-01-29 04:11:16 +00:00 |
|
|
Mark McLoughlin
|
c386c43ca3
|
[V1][Metrics] Add per-request prompt/generation_tokens histograms (#12516)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
|
2025-01-28 22:07:22 +00:00 |
|
|
Nick Hill
|
aea94362c9
|
[Frontend][V1] Online serving performance improvements (#12287)
|
2025-01-22 22:22:12 +00:00 |
|
|
Robert Shaw
|
619ae268c3
|
[V1] [2/n] Logging and Metrics - OutputProcessor Abstraction (#11973)
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
|
2025-01-13 04:54:10 +00:00 |
|