  MOVZXandHinata
|
7e80cc67ee
|
feat: Add pretty vLLM logging scripts
```
[10-15 06:31:36] PP: 0.0 t/s | TG: 4.0 t/s | K/V Cache: 61.5% | Pfx Cache: 0.0% | Draft Acc: 11.1%
[10-15 06:31:37] PP: 0.0 t/s | TG: 5.0 t/s | K/V Cache: 61.5% | Pfx Cache: 0.0% | Draft Acc: 50.0%
[10-15 06:31:38] PP: 0.0 t/s | TG: 6.0 t/s | K/V Cache: 60.7% | Pfx Cache: 0.0% | Draft Acc: 33.3%
[10-15 06:31:39] PP: 0.0 t/s | TG: 10.0 t/s | K/V Cache: 61.5% | Pfx Cache: 0.0% | Draft Acc: 77.8%
[10-15 06:31:40] PP: 0.0 t/s | TG: 6.0 t/s | K/V Cache: 63.2% | Pfx Cache: 0.0% | Draft Acc: 66.7%
[10-15 06:31:41] PP: 0.0 t/s | TG: 5.0 t/s | K/V Cache: 62.3% | Pfx Cache: 0.0% | Draft Acc: 22.2%
[10-15 06:31:42] PP: 0.0 t/s | TG: 8.0 t/s | K/V Cache: 63.2% | Pfx Cache: 0.0% | Draft Acc: 100.0%
[10-15 06:31:43] PP: 0.0 t/s | TG: 11.0 t/s | K/V Cache: 64.8% | Pfx Cache: 0.0% | Draft Acc: 88.9%
```
Co-Authored-By: Hinata <hinata@idihore.id>
Signed-off-by: MOVZX <movzx@yahoo.com>
|
2026-10-15 06:36:24 +00:00 |
|