Chore: Fix minor doc sentence, grammar, quote errors (#40469)

Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
Ashwin Phadke
2026-06-24 18:58:24 +00:00
committed by GitHub
co-authored by Harry Mellor
parent 3c43237233
commit d511b5bae9
3 changed files with 4 additions and 4 deletions
+1 -1
View File
@@ -159,7 +159,7 @@ For simplicity, we assume `block_size=1` in this section.
### High level idea
The block pool uses a dict similar to `tuple(block_hash, group_id) -> block` to catch the full blocks. That means the same tokens of different groups are cached and evicted independently.
The block pool uses a dict similar to `tuple(block_hash, group_id) -> block` to cache the full blocks. That means the same tokens of different groups are cached and evicted independently.
When a new request comes in, we check the cache hit prefix of each group, and return the intersection of these groups as the cached prefix of the request. See below for the detailed algorithm for checking the cache hit of one group & performing the intersection.