KVStore
Related Docs:
object KVStore
| package mxnet
Global barrier among all worker nodes
Global barrier among all worker nodes
For example, assume there are n machines, we want to let machine 0 first init the values, and then pull the inited value to all machines. Before pulling, we can place a barrier to guarantee that the initialization is finished.
Release the native memory.
Release the native memory. The object shall never be used after it is disposed.
Initialize a single or a sequence of key-value pairs into the store.
Initialize a single or a sequence of key-value pairs into the store. For each key, one must init it before push and pull. Only worker 0's (rank == 0) data are used. This function returns after data have been initialized successfully
The keys.
The values.
Load optimizer (updater) state from file
Load optimizer (updater) state from file
Path to input states file.
Get the number of worker nodes
Get the number of worker nodes
The number of worker nodes
Pull a single value or a sequence of values from the store.
Pull a single value or a sequence of values from the store.
Data consistency: 1. this function returns after adding an operator to the engine. But any further read on out will be blocked until it is finished. 2. pull is always called after all previous push and pull on the same key are finished 3. It pulls the newest value from the store.
Keys
According values
The priority of the push operation. The higher the priority, the faster this action is likely to be executed before other push actions.
Push a single or a sequence of key-value pairs into the store.
Push a single or a sequence of key-value pairs into the store. Data consistency: 1. this function returns after adding an operator to the engine. 2. push is always called after all previous push and pull on the same key are finished 3. there is no synchronization between workers. One can use _barrier() to sync all workers
Keys
According values
The priority of the push operation. The higher the priority, the faster this action is likely to be executed before other push actions.
Get the rank of this worker node
Get the rank of this worker node
The rank of this node, which is in [0, get_num_workers())
Save optimizer (updater) state to file
Save optimizer (updater) state to file
Path to output states file.
Whether to do barrier when the kvstore finalizes
Whether to do barrier when the kvstore finalizes
Register an optimizer to the store If there are multiple machines, this process (should be a worker node) will pack this optimizer and send it to all servers.
Register an optimizer to the store If there are multiple machines, this process (should be a worker node) will pack this optimizer and send it to all servers. It returns after this action is done.
the optimizer
Set a push updater into the store.
Set a push updater into the store.
This function only changes the local store. Use setOptimizer for multi-machines.
the updater function