Modules
Structs
A
MutStreamingIterator that reads column chunks one by one,
returning a PageReader per column.Decompressor that allows re-using the page buffer of
PageIterator.A fallible
Iterator of CompressedPage. This iterator leverages page indexes
to skip pages that are not needed. Consequently, the pages from this
iterator always have Some crate::page::CompressedDataPage::selected_rows()This meta is a small part of
ColumnChunkMetaData.A fallible
Iterator of CompressedDataPage. This iterator reads pages back
to back until all pages have been consumed.
The pages from this iterator always have None crate::page::CompressedDataPage::selected_rows() since
filter pushdown is not supported without a
pre-computed page index.A
MutStreamingIterator of pre-read column chunksEnums
State of
MutStreamingIterator.Traits
A special kind of fallible streaming iterator where
advance consumes the iterator.Functions
Decompresses the page, using
buffer for decompression.
If page.buffer.len() == 0, there was no decompression and the buffer was moved.
Else, decompression took place.Parse loaded metadata bytes
Filters row group metadata to only those row groups,
for which the predicate function returns true
Returns a
ColumnIterator of column chunks corresponding to field.Returns all
ColumnChunkMetaData associated to field_name.
For non-nested types, this returns an iterator with a single columnget_page_stream
asyncReturns a stream of compressed data pages
Returns a stream of compressed data pages from a reader that begins at the start of the column
Reads a column chunk into memory
This operation is IO-bounded and allocates the column’s
compressed_size.read_column_async
asyncReads a single column chunk into memory asynchronously
Reads all columns that are part of the parquet field
field_nameread_columns_async
asyncReads all columns that are part of the parquet field
field_nameReads the column indexes of all
ColumnChunkMetaData and deserializes them into Index.
Returns an empty vector if indexes are not availableReads a
FileMetaData from the reader, located at the end of the file.read_metadata_async
asyncAsynchronously reads the files’ metadata
Read
PageLocations from the ColumnChunkMetaDatas.
Returns an empty vector if indexes are not availableType Definitions
Type declaration for a page filter