Skip to content

[PARQUET] Update parquet writer bench with compression and pagev2#8560

Merged
alamb merged 1 commit intoapache:mainfrom
lilianm:bench_arrow_writer
Oct 6, 2025
Merged

[PARQUET] Update parquet writer bench with compression and pagev2#8560
alamb merged 1 commit intoapache:mainfrom
lilianm:bench_arrow_writer

Conversation

@lilianm
Copy link
Copy Markdown
Contributor

@lilianm lilianm commented Oct 6, 2025

Which issue does this PR close?

Rationale for this change

Add compression and page v2 bench

What changes are included in this PR?

Are these changes tested?

N/A

Are there any user-facing changes?

No

@github-actions github-actions Bot added the parquet Changes to the parquet crate label Oct 6, 2025
@lilianm lilianm force-pushed the bench_arrow_writer branch from 1584746 to e9db109 Compare October 6, 2025 12:20
@lilianm lilianm force-pushed the bench_arrow_writer branch from e9db109 to 1fd38d3 Compare October 6, 2025 12:21
Copy link
Copy Markdown
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @lilianm -- this is a really nice refactoring of the benchmarks and increase in coverage.

I also took some profiling samples and these benchmarks do appear to evaluate the different properties

Screenshot 2025-10-06 at 10 53 04 AM Screenshot 2025-10-06 at 10 56 16 AM

@alamb alamb changed the title [PARQUET] parquet writer bench with compression and pagev2 [PARQUET] Update parquet writer bench with compression and pagev2 Oct 6, 2025
@alamb alamb merged commit 760b7b6 into apache:main Oct 6, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[PARQUET][BENCH] Arrow writer bench with compression and/or page v2

2 participants