Archive
LLM Infrastructure

No Padding Waste

Archive
Medium
150pts43 solves
Static batching pads short requests to the longest sequence length. What does continuous batching do instead?
Show hint
Requests flow in and out of the batch as they complete.

Archive — no submissions accepted

This challenge is preserved for reference. Play live challenges at /challenges.