Struct polars_io::parquet::ParquetWriter

pub struct ParquetWriter<W> { /* private fields */ }

Available on crate feature parquet only.

Write a DataFrame to parquet format

Implementations

impl<W> ParquetWriter<W>where
    W: Write,

pub fn new(writer: W) -> Selfwhere
    W: Write,

Create a new writer

pub fn with_compression(self, compression: ParquetCompression) -> Self

Set the compression used. Defaults to Lz4Raw.

The default compression Lz4Raw has very good performance, but may not yet been supported by older readers. If you want more compatability guarantees, consider using Snappy.

pub fn with_statistics(self, statistics: bool) -> Self

Compute and write statistic

pub fn with_row_group_size(self, size: Option<usize>) -> Self

Set the row group size (in number of rows) during writing. This can reduce memory pressure and improve writing performance.

pub fn with_data_pagesize_limit(self, limit: Option<usize>) -> Self

Sets the maximum bytes size of a data page. If None will be 1024^2 bytes.

pub fn batched(self, schema: &Schema) -> PolarsResult<BatchedWriter<W>>

pub fn finish(self, df: &mut DataFrame) -> PolarsResult<u64>

Write the given DataFrame in the the writer W. Returns the total size of the file.