KVStore: Communication for Distributed Training

Horovod

Horovod()

A communication backend using Horovod.

BytePS

BytePS()

BytePS backend for MXNet KVStore interface.

KVStore Interface

KVStore(handle)

A key-value store for synchronization of values, over multiple devices.

KVStoreBase

An abstract key-value store interface for data parallel training.

KVStoreServer(kvstore)

The key-value store server.