Skip to content

Create Configuration key for enabling Byte Stream Split Encoding in ParquetWRiter #2815

@asfimport

Description

@asfimport

All of the properties in ParquetWriter have an associated Configuration key (for example, ParquetOutputFormat.DICTIONARY_PAGE_SIZE corresponds to ParquetWriter#withDictionaryPageSize), except for ParquetWriter#withByteStreamSplitEncoding.

 

Can we add a Configuration key for this? Happy to make a PR, given some input on naming convention (parquet.encoding.bytestreamsplit.enabled maybe?)

 

 

 

Reporter: Claire McGinty / @clairemcginty

Note: This issue was originally created as PARQUET-2350. Please see the migration documentation for further details.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions