HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity

2026-06-02T08:52:26Zd04f5a563114cd1f190fae984d16a6a2c6eb36f004c42ea6424ac08170133770
CPU-NPU-heterogeneityGNN-trainingGPU-placementKV-cacheLLM-servingMoE-servingRoPE-correctionagentic-inferenceasynchronous-trainingcarbon-aware-schedulingdistributed-trainingenergy-predictiongeometric-consensushardware-variabilitylow-communicationmicromagneticsmomentum-correctionmulti-GPUmulti-agent-systemsnon-IID-dataonline-routingrequest-routingresiliencescientific-workflowssheaf-theory

What happened

Collection of systems and algorithms for efficient, robust, and energy-aware ML and multi-agent computation under hardware and data heterogeneity. Key contributions include HeLoCo (direction-aware correction for asynchronous low-communication training to mitigate stale/misaligned pseudo-gradients in non-IID and heterogeneous settings); Augur (pre-execution energy prediction for scientific workflows enabling energy/carbon-aware scheduling); the Cartan-Topos Protocol (geometric/categorical framework for resilient multi-agent coordination using manifolds, sheaves, and topos-based temporal logic);

Why it matters

A reviewed impact interpretation has not been published for this record.

Evidence and limitations

Source ID
arxiv_cs_dc
Record identifier
d04f5a563114cd1f190fae984d16a6a2c6eb36f004c42ea6424ac08170133770
Enrichment time
2026-06-02T08:52:26Z
AI-assisted enrichment
Yes

This record may overlap with other records. Its enrichment can be incomplete or wrong, and machine assistance was used. Validate consequential decisions against the linked source and your own environment.