Baidu released its own implementation of the "ring allreduce" algorithm that can make parallel training of neural networks on GPUs significantly more efficient.
