Skip to content

chore: Remove config option for native_iceberg_compat#4019

Open
andygrove wants to merge 10 commits intoapache:mainfrom
andygrove:remove-iceberg-compat
Open

chore: Remove config option for native_iceberg_compat#4019
andygrove wants to merge 10 commits intoapache:mainfrom
andygrove:remove-iceberg-compat

Conversation

@andygrove
Copy link
Copy Markdown
Member

@andygrove andygrove commented Apr 21, 2026

Which issue does this PR close?

Partially address #4020.

Rationale for this change

Removing support for native_iceberg_compat reduces the maintenance burden of the project.

This PR makes it impossible for users to select native_iceberg_compat and stops running tests for that scan impl.

Subsequent PRs will remove the implementation code.

What changes are included in this PR?

  • COMET_NATIVE_SCAN_IMPL config now only allows auto or native_datafusion
  • CometScanRule no longer uses the value of config option COMET_NATIVE_SCAN_IMPL and just uses native_datafusion scan
  • Tests have been updated to stop testing with native_iceberg_compat
  • Tests that were specific to native_iceberg_compat have been removed
  • Golden files regenerated - we no longer generate different versions per scan impl
  • Updated documentation

How are these changes tested?

@andygrove andygrove marked this pull request as ready for review April 21, 2026 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant