prepare for datafusion 53#108
Closed
friendlymatthew wants to merge 2 commits intodatafusion-contrib:mainfrom
Closed
prepare for datafusion 53#108friendlymatthew wants to merge 2 commits intodatafusion-contrib:mainfrom
friendlymatthew wants to merge 2 commits intodatafusion-contrib:mainfrom
Conversation
…down This allows the ExtractLeafExpressions optimizer to push JSON accessor functions (json_as_text, json_get, etc.) into the Parquet scan projection, where custom PhysicalExprAdapters can rewrite them for shredded/reduced column fallback. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
adriangb
reviewed
Mar 24, 2026
| #[tokio::test] | ||
| async fn test_json_get_equals() { | ||
| let e = run_query(r"select name, json_get(json_data, 'foo')='abc' from test") | ||
| // union comparison now works thanks to the union coercions upport in datafusion |
Collaborator
There was a problem hiding this comment.
Suggested change
| // union comparison now works thanks to the union coercions upport in datafusion | |
| // union comparison now works thanks to the union coercion support in datafusion |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This uses
pydantic-mainwhich is the latest changes on datafusion + a couple of cherry picked commits used in Pydantic's vendored datafusionNote: one of those cherry picks fixes apache/datafusion#10180!