Skip to content

Add: 12-bit and UYVY pix_fmts to mtl_st20p ffmpeg plugin #1612

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Sakoram merged 2 commits into from
Jul 23, 2026
Merged

Add: 12-bit and UYVY pix_fmts to mtl_st20p ffmpeg plugin #1612

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
34d6a03
Add: 12-bit and UYVY pix_fmts to mtl_st20p ffmpeg plugin
Sakoram Jun 15, 2026
77c5f3d
Ci: quick fix auto align job
DawidWesierski4 Jul 22, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .github/actions/validate-host/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -97,6 +97,10 @@ runs:
- name: 'installation: Auto-align host components (ICE driver & SVT-JPEG-XS)'
shell: bash
env:
MTL_INSTALL_PREFIX: ${{ github.workspace }}/.local_install/mtl
PKG_CONFIG_PATH: ${{ github.workspace }}/.local_install/dpdk/lib/x86_64-linux-gnu/pkgconfig:${{ github.workspace }}/.local_install/mtl/lib/x86_64-linux-gnu/pkgconfig
LD_LIBRARY_PATH: ${{ github.workspace }}/.local_install/dpdk/lib/x86_64-linux-gnu:${{ github.workspace }}/.local_install/mtl/lib/x86_64-linux-gnu
run: |
export SETUP_BUILD_AND_INSTALL_ICE_DRIVER=1
export PLUGIN_BUILD_AND_INSTALL_JPEGXS=1
Expand Down
8 changes: 6 additions & 2 deletions ecosystem/ffmpeg_plugin/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,9 +115,13 @@ formats. The same `-pix_fmt` must be used on TX and RX.
| `-pix_fmt` | Wire format | ST 2110-20:2022 §6.2 compliant |
| ------------- | ----------------------------- | ------------------------------ |
| `yuv422p10le` | YUV 4:2:2 10-bit RFC 4175 PG2BE10 | yes (Table 2) |
| `y210le` | YUV 4:2:2 10-bit RFC 4175 PG2BE10 | yes (Table 2) |
| `yuv444p10le` | YUV 4:4:4 10-bit RFC 4175 PG4BE10 | yes (Table 1) |
| `gbrp10le` | RGB 10-bit RFC 4175 PG4BE10 | yes (Table 1) |
| `yuv422p12le` | YUV 4:2:2 12-bit RFC 4175 PG2BE12 | yes (Table 2) |
| `yuv444p12le` | YUV 4:4:4 12-bit RFC 4175 PG2BE12 | yes (Table 1) |
| `y210le` | YUV 4:2:2 10-bit RFC 4175 PG2BE10 | yes (Table 2) |
| `uyvy422` | YUV 4:2:2 8-bit RFC 4175 | yes (Table 2) |
| `gbrp10le` | RGB 4:4:4 10-bit RFC 4175 PG4BE10 | yes (Table 1) |
| `gbrp12le` | RGB 4:4:4 12-bit RFC 4175 PG2BE12 | yes (Table 1) |
| `yuv420p` | Planar I420 passthrough (`ST_FRAME_FMT_YUV420CUSTOM8`) | **no** — MTL-to-MTL only, not interoperable with third-party receivers |

## 3. ST22 compressed video run guide
Expand Down
16 changes: 16 additions & 0 deletions ecosystem/ffmpeg_plugin/mtl_st20p_rx.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,14 @@ static int mtl_st20p_read_header(AVFormatContext* ctx) {
ops_rx.transport_fmt = ST20_FMT_YUV_422_10BIT;
ops_rx.output_fmt = ST_FRAME_FMT_Y210;
break;
case AV_PIX_FMT_YUV422P12LE:
ops_rx.transport_fmt = ST20_FMT_YUV_422_12BIT;
ops_rx.output_fmt = ST_FRAME_FMT_YUV422PLANAR12LE;
break;
case AV_PIX_FMT_UYVY422:
ops_rx.transport_fmt = ST20_FMT_YUV_422_8BIT;
ops_rx.output_fmt = ST_FRAME_FMT_UYVY;
break;
case AV_PIX_FMT_RGB24:
ops_rx.transport_fmt = ST20_FMT_RGB_8BIT;
ops_rx.output_fmt = ST_FRAME_FMT_RGB8;
Expand All @@ -132,10 +140,18 @@ static int mtl_st20p_read_header(AVFormatContext* ctx) {
ops_rx.transport_fmt = ST20_FMT_YUV_444_10BIT;
ops_rx.output_fmt = ST_FRAME_FMT_YUV444PLANAR10LE;
break;
case AV_PIX_FMT_YUV444P12LE:
ops_rx.transport_fmt = ST20_FMT_YUV_444_12BIT;
ops_rx.output_fmt = ST_FRAME_FMT_YUV444PLANAR12LE;
break;
case AV_PIX_FMT_GBRP10LE:
ops_rx.transport_fmt = ST20_FMT_RGB_10BIT;
ops_rx.output_fmt = ST_FRAME_FMT_GBRPLANAR10LE;
break;
case AV_PIX_FMT_GBRP12LE:
ops_rx.transport_fmt = ST20_FMT_RGB_12BIT;
ops_rx.output_fmt = ST_FRAME_FMT_GBRPLANAR12LE;
break;
case AV_PIX_FMT_YUV420P:
/* MTL-to-MTL passthrough only: YUV420CUSTOM8 receives the raw
* ST20_FMT_YUV_420_8BIT payload straight as planar I420 with no RFC4175
Expand Down
16 changes: 16 additions & 0 deletions ecosystem/ffmpeg_plugin/mtl_st20p_tx.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,6 +98,14 @@ static int mtl_st20p_write_header(AVFormatContext* ctx) {
ops_tx.input_fmt = ST_FRAME_FMT_Y210;
ops_tx.transport_fmt = ST20_FMT_YUV_422_10BIT;
break;
case AV_PIX_FMT_YUV422P12LE:
ops_tx.input_fmt = ST_FRAME_FMT_YUV422PLANAR12LE;
ops_tx.transport_fmt = ST20_FMT_YUV_422_12BIT;
break;
case AV_PIX_FMT_UYVY422:
ops_tx.input_fmt = ST_FRAME_FMT_UYVY;
ops_tx.transport_fmt = ST20_FMT_YUV_422_8BIT;
break;
case AV_PIX_FMT_RGB24:
ops_tx.input_fmt = ST_FRAME_FMT_RGB8;
ops_tx.transport_fmt = ST20_FMT_RGB_8BIT;
Expand All @@ -106,10 +114,18 @@ static int mtl_st20p_write_header(AVFormatContext* ctx) {
ops_tx.input_fmt = ST_FRAME_FMT_YUV444PLANAR10LE;
ops_tx.transport_fmt = ST20_FMT_YUV_444_10BIT;
break;
case AV_PIX_FMT_YUV444P12LE:
ops_tx.input_fmt = ST_FRAME_FMT_YUV444PLANAR12LE;
ops_tx.transport_fmt = ST20_FMT_YUV_444_12BIT;
break;
case AV_PIX_FMT_GBRP10LE:
ops_tx.input_fmt = ST_FRAME_FMT_GBRPLANAR10LE;
ops_tx.transport_fmt = ST20_FMT_RGB_10BIT;
break;
case AV_PIX_FMT_GBRP12LE:
ops_tx.input_fmt = ST_FRAME_FMT_GBRPLANAR12LE;
ops_tx.transport_fmt = ST20_FMT_RGB_12BIT;
break;
case AV_PIX_FMT_YUV420P:
/* MTL-to-MTL passthrough only: YUV420CUSTOM8 sends the planar I420
* buffer straight onto the wire as ST20_FMT_YUV_420_8BIT payload
Expand Down
9 changes: 9 additions & 0 deletions tests/validation/common/integrity/video_integrity.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,12 +58,21 @@ def calculate_yuv_frame_size(width: int, height: int, file_format: str) -> int:
pixel_size = 2.5
case "YUV422PLANAR10LE" | "yuv422p10le":
pixel_size = 4
case "yuv422p12le":
# 4:2:2 12-bit planar: Y full + half U + half V, 2 bytes per sample
pixel_size = 4
case "yuv444p10le" | "gbrp10le":
# 3 planes (Y/U/V or G/B/R), 10-bit samples padded to 2 bytes each
pixel_size = 6
case "yuv444p12le" | "gbrp12le":
# 3 planes (Y/U/V or G/B/R), 12-bit samples padded to 2 bytes each
pixel_size = 6
case "yuv420p":
# I420: full Y plane + quarter-size U + quarter-size V
pixel_size = 1.5
case "uyvy422":
# Packed 4:2:2 8-bit, 2 bytes per pixel
pixel_size = 2
case "y210le":
# Packed 4:2:2 10-bit, 2 samples per pixel × 2 bytes per sample
pixel_size = 4
Expand Down
4 changes: 4 additions & 0 deletions tests/validation/tests/single/st20p/test_pix_fmt.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@
"gbrp10le",
"yuv420p",
"y210le",
"uyvy422",
"yuv422p12le",
"yuv444p12le",
"gbrp12le",
]

logger = logging.getLogger(__name__)
Expand Down
Loading