HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity
2026-06-02T08:52:26Z•d04f5a563114cd1f190fae984d16a6a2c6eb36f004c42ea6424ac08170133770
CPU-NPU-heterogeneityGNN-trainingGPU-placementKV-cacheLLM-servingMoE-servingRoPE-correctionagentic-inferenceasynchronous-trainingcarbon-aware-schedulingdistributed-trainingenergy-predictiongeometric-consensushardware-variabilitylow-communicationmicromagneticsmomentum-correctionmulti-GPUmulti-agent-systemsnon-IID-dataonline-routingrequest-routingresiliencescientific-workflowssheaf-theory
What happened
Collection of systems and algorithms for efficient, robust, and energy-aware ML and multi-agent computation under hardware and data heterogeneity. Key contributions include HeLoCo (direction-aware correction for asynchronous low-communication training to mitigate stale/misaligned pseudo-gradients in non-IID and heterogeneous settings); Augur (pre-execution energy prediction for scientific workflows enabling energy/carbon-aware scheduling); the Cartan-Topos Protocol (geometric/categorical framework for resilient multi-agent coordination using manifolds, sheaves, and topos-based temporal logic);
Why it matters
A reviewed impact interpretation has not been published for this record.
Evidence and limitations
- Source ID
- arxiv_cs_dc
- Record identifier
- d04f5a563114cd1f190fae984d16a6a2c6eb36f004c42ea6424ac08170133770
- Enrichment time
- 2026-06-02T08:52:26Z
- AI-assisted enrichment
- Yes
This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.