NCCL

Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL

Hugging Face announced an experimental asynchronous variant of GRPO (Generalized Reinforcement Learning from Preferences) using LoRA adapters across distributed training jobs, eliminating NCCL dependencies by introducing a custom bucket-and-proxy coordination layer.