Skip to content

Add gorz extension#2213

Merged
carlopi merged 8 commits into
duckdb:mainfrom
gorfather:add-gorz-extension
Jul 10, 2026
Merged

Add gorz extension#2213
carlopi merged 8 commits into
duckdb:mainfrom
gorfather:add-gorz-extension

Conversation

@gorfather

Copy link
Copy Markdown
Contributor

Adds gorz — read GORpipe .gorz and .gord files and write .gorz as native DuckDB tables.

GORpipe (https://github.com/gorpipe/gor) is a genomic analysis engine; .gorz is its block-compressed, genomically-ordered table format and .gord a dictionary of partition files. This extension exposes them to DuckDB:

  • read_gor / read_gorz / read_gord table functions (projection + parallel scan, WHERE chrom/pos → block seek, range := 'chrN:a-b' GOR -p filter, f/ff partition-tag filters).
  • Replacement scan, so FROM 'x.gorz' works directly.
  • COPY (…) TO 'x.gorz' (FORMAT gorz) — write path (validates GOR order).
  • Object stores via DuckDB's FileSystem (s3://… with httpfs).

Files written are read/seeked natively by gorpipe itself, and vice-versa.

@gorfather

Copy link
Copy Markdown
Contributor Author

Hi @samansmink — gentle nudge on this one when you get a chance. The CI runs are sitting in action_required (external-fork approval). I've built and tested the extension locally against DuckDB v1.5.3 through the standard vcpkg+ninja toolchain (sqllogictests green, including a self-contained .gord bucketization test), so it should be ready for the matrix. Happy to address anything that comes up. Thanks!

@carlopi

carlopi commented Jul 10, 2026

Copy link
Copy Markdown
Member

Thanks!

@carlopi carlopi merged commit 1f242d8 into duckdb:main Jul 10, 2026
16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants