reader of binary recordio from Blob returned by InputSplit This class divides the blob into several independent parts specified by caller, and read from one segment. The part reading can be used together with InputSplit::NextChunk for multi-threaded parsing(each thread take a RecordIOChunkReader)
More...
#include <recordio.h>
reader of binary recordio from Blob returned by InputSplit This class divides the blob into several independent parts specified by caller, and read from one segment. The part reading can be used together with InputSplit::NextChunk for multi-threaded parsing(each thread take a RecordIOChunkReader)
- See also
- RecordIOWriter, InputSplit
dmlc::RecordIOChunkReader::RecordIOChunkReader |
( |
InputSplit::Blob |
chunk, |
|
|
unsigned |
part_index = 0 , |
|
|
unsigned |
num_parts = 1 |
|
) |
| |
|
explicit |
constructor
- Parameters
-
chunk | source data returned by InputSplit |
part_index | which part we want to reado |
num_parts | number of total segments |
read next complete record from stream the blob contains the memory content NOTE: this function is not threadsafe, use one RecordIOChunkReader per thread
- Parameters
-
out_rec | used to store output blob, the header is already removed and out_rec only contains the memory content |
- Returns
- true of read was successful, false if end was reached
The documentation for this class was generated from the following file:
- /work/mxnet/3rdparty/dmlc-core/include/dmlc/recordio.h