Archive
LLM Infrastructure

The Term For Serving Two Calls In One Batch

Archive
Easy
100pts0 solves
The throughput technique where new requests join an ongoing batch at every decode step (instead of waiting for the whole batch to finish) is called what two-word term?
Show hint
'Always-on' + a common plural noun.

Archive — no submissions accepted

This challenge is preserved for reference. Play live challenges at /challenges.