inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference
arXiv 2603.16054•0437e83ea23d3baa971ef88a16a86e9c33428965001d7634320906c43885fc0c
CKKSCOCO-EFCPU-GPU integrationCompress-and-RouteGPU accelerationGPU fleet planningLLM inferenceODINP99 SLOSlideFormerTriton kernelsbiased compressioncommunication efficiencycost optimizationdataflow optimizationdiscrete-event simulationdistributed learninggradient codinghomomorphic encryptionmemory managementpre-silicon validation","NoC"queueing theoryreplay-driven validationsingle-GPU fine-tuningstraggler mitigation
Paper metadata
- arXiv ID
- 2603.16054
- Version
- Not specified by this published record
- Category
- Computer Science — Distributed, Parallel, and Cluster Computing (cs.DC)
The PDF link points to arxiv.org. Baitaphish does not expose a private stored PDF.
Evidence and limitations
- Source ID
- arxiv_cs_dc
- Record identifier
- 0437e83ea23d3baa971ef88a16a86e9c33428965001d7634320906c43885fc0c
- Enrichment time
- 2026-03-18T08:52:26Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.