grain.experimental.ThreadPrefetchDatasetIterator

grain.experimental.ThreadPrefetchDatasetIterator#

class grain.experimental.ThreadPrefetchDatasetIterator(parent, prefetch_buffer_size)#

Iterator that performs prefetching using a synchronized queue.

Parameters:

  • parent (CheckpointableIterator[T])

  • prefetch_buffer_size (int)

__init__(parent, prefetch_buffer_size)#
Parameters:

  • parent (CheckpointableIterator[T])

  • prefetch_buffer_size (int)

Methods

__init__(parent, prefetch_buffer_size)

close()

Stops the iterator.

get_state()

Returns the current state of the iterator.

load(directory)

Loads the iterator state from a directory.

save(directory)

Saves the iterator state to a directory.

set_state(state)

Sets the current state of the iterator.

start_prefetch()

Starts prefetching elements in background.
Contents