org.apache.mxnet.io

NDArrayIter

Related Doc: package io

class NDArrayIter extends DataIter

NDArrayIter object in mxnet. Taking NDArray to get dataiter.

Linear Supertypes
DataIter, Iterator[DataBatch], TraversableOnce[DataBatch], GenTraversableOnce[DataBatch], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. NDArrayIter
  2. DataIter
  3. Iterator
  4. TraversableOnce
  5. GenTraversableOnce
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new NDArrayIter(data: IndexedSeq[NDArray], label: IndexedSeq[NDArray] = IndexedSeq.empty, dataBatchSize: Int = 1, shuffle: Boolean = false, lastBatchHandle: String = "pad", dataName: String = "data", labelName: String = "label")

    data

    NDArrayIter supports single or multiple data and label.

    label

    Same as data, but is not fed to the model during testing.

    dataBatchSize

    Batch Size

    shuffle

    Whether to shuffle the data

    lastBatchHandle

    "pad", "discard" or "roll_over". How to handle the last batch

    This iterator will pad, discard or roll over the last batch if the size of data does not match batch_size. Roll over is intended for training and can cause problems if used for prediction.

Type Members

  1. class GroupedIterator[B >: A] extends AbstractIterator[Seq[B]] with Iterator[Seq[B]]

    Definition Classes
    Iterator

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. def ++[B >: DataBatch](that: ⇒ GenTraversableOnce[B]): Iterator[B]

    Definition Classes
    Iterator

  4. def /:[B](z: B)(op: (B, DataBatch) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  5. def :\[B](z: B)(op: (DataBatch, B) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  6. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  7. def addString(b: StringBuilder): StringBuilder

    Definition Classes
    TraversableOnce

  8. def addString(b: StringBuilder, sep: String): StringBuilder

    Definition Classes
    TraversableOnce

  9. def addString(b: StringBuilder, start: String, sep: String, end: String): StringBuilder

    Definition Classes
    TraversableOnce

  10. def aggregate[B](z: ⇒ B)(seqop: (B, DataBatch) ⇒ B, combop: (B, B) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  11. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  12. def batchSize: Int

    Definition Classes
    NDArrayIter → DataIter

  13. def buffered: BufferedIterator[DataBatch]

    Definition Classes
    Iterator

  14. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  15. def collect[B](pf: PartialFunction[DataBatch, B]): Iterator[B]

    Definition Classes
    Iterator
    Annotations
    @migration
    Migration

    (Changed in version 2.8.0) collect has changed. The previous behavior can be reproduced with toSeq.

  16. def collectFirst[B](pf: PartialFunction[DataBatch, B]): Option[B]

    Definition Classes
    TraversableOnce

  17. def contains(elem: Any): Boolean

    Definition Classes
    Iterator

  18. def copyToArray[B >: DataBatch](xs: Array[B], start: Int, len: Int): Unit

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  19. def copyToArray[B >: DataBatch](xs: Array[B]): Unit

    Definition Classes
    TraversableOnce → GenTraversableOnce

  20. def copyToArray[B >: DataBatch](xs: Array[B], start: Int): Unit

    Definition Classes
    TraversableOnce → GenTraversableOnce

  21. def copyToBuffer[B >: DataBatch](dest: Buffer[B]): Unit

    Definition Classes
    TraversableOnce

  22. def corresponds[B](that: GenTraversableOnce[B])(p: (DataBatch, B) ⇒ Boolean): Boolean

    Definition Classes
    Iterator

  23. def count(p: (DataBatch) ⇒ Boolean): Int

    Definition Classes
    TraversableOnce → GenTraversableOnce

  24. var cursor: Int

  25. def defaultBucketKey: AnyRef

    Definition Classes
    DataIter

  26. def drop(n: Int): Iterator[DataBatch]

    Definition Classes
    Iterator

  27. def dropWhile(p: (DataBatch) ⇒ Boolean): Iterator[DataBatch]

    Definition Classes
    Iterator

  28. def duplicate: (Iterator[DataBatch], Iterator[DataBatch])

    Definition Classes
    Iterator

  29. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  30. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  31. def exists(p: (DataBatch) ⇒ Boolean): Boolean

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  32. def filter(p: (DataBatch) ⇒ Boolean): Iterator[DataBatch]

    Definition Classes
    Iterator

  33. def filterNot(p: (DataBatch) ⇒ Boolean): Iterator[DataBatch]

    Definition Classes
    Iterator

  34. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  35. def find(p: (DataBatch) ⇒ Boolean): Option[DataBatch]

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  36. def flatMap[B](f: (DataBatch) ⇒ GenTraversableOnce[B]): Iterator[B]

    Definition Classes
    Iterator

  37. def fold[A1 >: DataBatch](z: A1)(op: (A1, A1) ⇒ A1): A1

    Definition Classes
    TraversableOnce → GenTraversableOnce

  38. def foldLeft[B](z: B)(op: (B, DataBatch) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  39. def foldRight[B](z: B)(op: (DataBatch, B) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  40. def forall(p: (DataBatch) ⇒ Boolean): Boolean

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  41. def foreach[U](f: (DataBatch) ⇒ U): Unit

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  42. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  43. def getData(): IndexedSeq[NDArray]

    get data of current batch

    get data of current batch

    returns

    the data of current batch

    Definition Classes
    NDArrayIter → DataIter

  44. def getIndex(): IndexedSeq[Long]

    the index of current batch

    the index of current batch

    returns

    Definition Classes
    NDArrayIter → DataIter

  45. def getLabel(): IndexedSeq[NDArray]

    Get label of current batch

    Get label of current batch

    returns

    the label of current batch

    Definition Classes
    NDArrayIter → DataIter

  46. def getPad(): MXUint

    get the number of padding examples in current batch

    get the number of padding examples in current batch

    returns

    number of padding examples in current batch

    Definition Classes
    NDArrayIter → DataIter

  47. def grouped[B >: DataBatch](size: Int): GroupedIterator[B]

    Definition Classes
    Iterator

  48. def hardReset(): Unit

    Igore roll over data and set to start

  49. def hasDefiniteSize: Boolean

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  50. def hasNext: Boolean

    Definition Classes
    NDArrayIter → Iterator

  51. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  52. def indexOf[B >: DataBatch](elem: B): Int

    Definition Classes
    Iterator

  53. def indexWhere(p: (DataBatch) ⇒ Boolean): Int

    Definition Classes
    Iterator

  54. val initData: IndexedSeq[(String, NDArray)]

  55. val initLabel: IndexedSeq[(String, NDArray)]

  56. def isEmpty: Boolean

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  57. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  58. def isTraversableAgain: Boolean

    Definition Classes
    Iterator → GenTraversableOnce

  59. def length: Int

    Definition Classes
    Iterator

  60. def map[B](f: (DataBatch) ⇒ B): Iterator[B]

    Definition Classes
    Iterator

  61. def max[B >: DataBatch](implicit cmp: Ordering[B]): DataBatch

    Definition Classes
    TraversableOnce → GenTraversableOnce

  62. def maxBy[B](f: (DataBatch) ⇒ B)(implicit cmp: Ordering[B]): DataBatch

    Definition Classes
    TraversableOnce → GenTraversableOnce

  63. def min[B >: DataBatch](implicit cmp: Ordering[B]): DataBatch

    Definition Classes
    TraversableOnce → GenTraversableOnce

  64. def minBy[B](f: (DataBatch) ⇒ B)(implicit cmp: Ordering[B]): DataBatch

    Definition Classes
    TraversableOnce → GenTraversableOnce

  65. def mkString: String

    Definition Classes
    TraversableOnce → GenTraversableOnce

  66. def mkString(sep: String): String

    Definition Classes
    TraversableOnce → GenTraversableOnce

  67. def mkString(start: String, sep: String, end: String): String

    Definition Classes
    TraversableOnce → GenTraversableOnce

  68. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  69. def next(): DataBatch

    get next data batch from iterator

    get next data batch from iterator

    returns

    Definition Classes
    NDArrayIter → DataIter → Iterator
    Annotations
    @throws( classOf[NoSuchElementException] )

  70. def nonEmpty: Boolean

    Definition Classes
    TraversableOnce → GenTraversableOnce

  71. final def notify(): Unit

    Definition Classes
    AnyRef

  72. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  73. val numData: Int

  74. val numSource: Int

  75. def padTo[A1 >: DataBatch](len: Int, elem: A1): Iterator[A1]

    Definition Classes
    Iterator

  76. def partition(p: (DataBatch) ⇒ Boolean): (Iterator[DataBatch], Iterator[DataBatch])

    Definition Classes
    Iterator

  77. def patch[B >: DataBatch](from: Int, patchElems: Iterator[B], replaced: Int): Iterator[B]

    Definition Classes
    Iterator

  78. def product[B >: DataBatch](implicit num: Numeric[B]): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  79. def provideData: ListMap[String, Shape]

    Definition Classes
    NDArrayIter → DataIter

  80. def provideLabel: ListMap[String, Shape]

    Definition Classes
    NDArrayIter → DataIter

  81. def reduce[A1 >: DataBatch](op: (A1, A1) ⇒ A1): A1

    Definition Classes
    TraversableOnce → GenTraversableOnce

  82. def reduceLeft[B >: DataBatch](op: (B, DataBatch) ⇒ B): B

    Definition Classes
    TraversableOnce

  83. def reduceLeftOption[B >: DataBatch](op: (B, DataBatch) ⇒ B): Option[B]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  84. def reduceOption[A1 >: DataBatch](op: (A1, A1) ⇒ A1): Option[A1]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  85. def reduceRight[B >: DataBatch](op: (DataBatch, B) ⇒ B): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  86. def reduceRightOption[B >: DataBatch](op: (DataBatch, B) ⇒ B): Option[B]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  87. def reset(): Unit

    reset the iterator

    reset the iterator

    Definition Classes
    NDArrayIter → DataIter

  88. def reversed: List[DataBatch]

    Attributes
    protected[this]
    Definition Classes
    TraversableOnce

  89. def sameElements(that: Iterator[_]): Boolean

    Definition Classes
    Iterator

  90. def scanLeft[B](z: B)(op: (B, DataBatch) ⇒ B): Iterator[B]

    Definition Classes
    Iterator

  91. def scanRight[B](z: B)(op: (DataBatch, B) ⇒ B): Iterator[B]

    Definition Classes
    Iterator

  92. def seq: Iterator[DataBatch]

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  93. def size: Int

    Definition Classes
    TraversableOnce → GenTraversableOnce

  94. def slice(from: Int, until: Int): Iterator[DataBatch]

    Definition Classes
    Iterator

  95. def sliding[B >: DataBatch](size: Int, step: Int): GroupedIterator[B]

    Definition Classes
    Iterator

  96. def span(p: (DataBatch) ⇒ Boolean): (Iterator[DataBatch], Iterator[DataBatch])

    Definition Classes
    Iterator

  97. def sum[B >: DataBatch](implicit num: Numeric[B]): B

    Definition Classes
    TraversableOnce → GenTraversableOnce

  98. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  99. def take(n: Int): Iterator[DataBatch]

    Definition Classes
    Iterator

  100. def takeWhile(p: (DataBatch) ⇒ Boolean): Iterator[DataBatch]

    Definition Classes
    Iterator

  101. def to[Col[_]](implicit cbf: CanBuildFrom[Nothing, DataBatch, Col[DataBatch]]): Col[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  102. def toArray[B >: DataBatch](implicit arg0: ClassTag[B]): Array[B]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  103. def toBuffer[B >: DataBatch]: Buffer[B]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  104. def toIndexedSeq: IndexedSeq[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  105. def toIterable: Iterable[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  106. def toIterator: Iterator[DataBatch]

    Definition Classes
    Iterator → GenTraversableOnce

  107. def toList: List[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  108. def toMap[T, U](implicit ev: <:<[DataBatch, (T, U)]): Map[T, U]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  109. def toSeq: Seq[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  110. def toSet[B >: DataBatch]: Set[B]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  111. def toStream: Stream[DataBatch]

    Definition Classes
    Iterator → GenTraversableOnce

  112. def toString(): String

    Definition Classes
    Iterator → AnyRef → Any

  113. def toTraversable: Traversable[DataBatch]

    Definition Classes
    Iterator → TraversableOnce → GenTraversableOnce

  114. def toVector: Vector[DataBatch]

    Definition Classes
    TraversableOnce → GenTraversableOnce

  115. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  116. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  117. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  118. def withFilter(p: (DataBatch) ⇒ Boolean): Iterator[DataBatch]

    Definition Classes
    Iterator

  119. def zip[B](that: Iterator[B]): Iterator[(DataBatch, B)]

    Definition Classes
    Iterator

  120. def zipAll[B, A1 >: DataBatch, B1 >: B](that: Iterator[B], thisElem: A1, thatElem: B1): Iterator[(A1, B1)]

    Definition Classes
    Iterator

  121. def zipWithIndex: Iterator[(DataBatch, Int)]

    Definition Classes
    Iterator

Inherited from DataIter

Inherited from Iterator[DataBatch]

Inherited from TraversableOnce[DataBatch]

Inherited from GenTraversableOnce[DataBatch]

Inherited from AnyRef

Inherited from Any

Ungrouped