Data structure that holds the data Row block iterator interface that gets RowBlocks Difference between RowBlockIter and Parser: RowBlockIter caches the data internally that can be used to iterate the dataset multiple times, Parser holds very limited internal state and was usually used to read data only once.
More...
#include <data.h>
|
static RowBlockIter< IndexType, DType > * | Create (const char *uri, unsigned part_index, unsigned num_parts, const char *type) |
| create a new instance of iterator that returns rowbatch by default, a in-memory based iterator will be returned More...
|
|
template<typename IndexType, typename DType = real_t>
class dmlc::RowBlockIter< IndexType, DType >
Data structure that holds the data Row block iterator interface that gets RowBlocks Difference between RowBlockIter and Parser: RowBlockIter caches the data internally that can be used to iterate the dataset multiple times, Parser holds very limited internal state and was usually used to read data only once.
- See also
- Parser
- Template Parameters
-
IndexType | type of index in RowBlock |
DType | type of label and value in RowBlock Create function was only implemented for IndexType uint64_t and uint32_t and DType real_t and int |
template<typename IndexType, typename DType = real_t>
static RowBlockIter<IndexType, DType>* dmlc::RowBlockIter< IndexType, DType >::Create |
( |
const char * |
uri, |
|
|
unsigned |
part_index, |
|
|
unsigned |
num_parts, |
|
|
const char * |
type |
|
) |
| |
|
static |
create a new instance of iterator that returns rowbatch by default, a in-memory based iterator will be returned
- Parameters
-
uri | the uri of the input, can contain hdfs prefix |
part_index | the part id of current input |
num_parts | total number of splits |
type | type of dataset can be: "libsvm", ... |
- Returns
- the created data iterator
template<typename IndexType, typename DType = real_t>
- Returns
- maximum feature dimension in the dataset
The documentation for this class was generated from the following file:
- /work/mxnet/3rdparty/dmlc-core/include/dmlc/data.h