Skip to content

The read_record_batch func of the RecordBatchDecoder does not respect the skip_validation property #7508

@nilskch

Description

@nilskch

Describe the bug

We created a StreamReader with with_skip_validation(true) and still ran into validation errors.

We noticed that not all validation steps are skipped. The record_batch_reader
function does not respect the skip_validation property and simply calls RecordBatch::try_new_with_options instead of RecordBatch::new_unchecked.

To Reproduce

Expected behavior
Skip the validation logic by calling RecordBatch::new_unchecked if skip_validation is set to true.

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    arrowChanges to the arrow cratebug

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions