Skip to content

[core] Support IsNaN predicate pushdown with Parquet#7875

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/predicate-isnan
Open

[core] Support IsNaN predicate pushdown with Parquet#7875
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/predicate-isnan

Conversation

@ArnavBalyan
Copy link
Copy Markdown
Member

@ArnavBalyan ArnavBalyan commented May 16, 2026

Purpose

  • Paimon has no IsNaN predicate today, add support for the same with Paimon evaluation and parquet pushdown
  • Add IsNaN as a new LeafUnaryFunction, which can evaluate rows and pushdown to Parquet for double and float
  • ParquetFilters pushes down to Parquet via new UserDefinedPredicate.

Tests

  • UT

@ArnavBalyan
Copy link
Copy Markdown
Member Author

cc @JingsongLi thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant