Skip to content

ThriftMetadataWriter::write_column_indexes cannot handle a ColumnIndexMetaData::NONE #8815

@etseidl

Description

@etseidl

Describe the bug
While testing #8811 I found that trying to concatenate alltypes_tiny_pages.parquet from the parquet-testing repo fails with the error "Cannot serialize NONE index". While creating a Parquet file from scratch, the column index may contain None entries. But when reading from a file with missing indexes, a ColumnIndexMetaData::NONE will be inserted because the current metadata requires a value. When trying to serialize this, the ColumnIndexMetaData::NONE is encountered and triggers the error.

To Reproduce
Use parquet-concat from #8811 on parquet-testing/data/alltypes_tiny_pages.parquet.

Expected behavior
A ColumnIndexMetaData::NONE should simply be skipped.

Additional context

Metadata

Metadata

Assignees

Labels

bugparquetChanges to the parquet crate

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions