Which Torch for Linux with RX 9070XT?

[joshnoe94]

The installation instructions have 3 different versions of torch/etc compatible with Linux: the stable and nightly releases from the pytorch repo, and the nightly release from the rocm repo for RDNA 4 specifically.

Is one preferred over the other? I assume the version from the rocm repo is more optimized, but not sure about stability.

[bedovyy]

I am using torch from https://rocm.nightlies.amd.com/v2/gfx120X-all/ and flash-attn from https://rocm.frameworks.amd.com/whl/gfx120X-all/

The best option I think is --use-flash-attention --use-triton-backend.
You should set FLASH_ATTENTION_TRITON_AMD_ENABLE=TRUE to use flash-attn btw.

You can get torch from

• https://repo.amd.com/rocm/whl/
• https://rocm.nightlies.amd.com/v2/
• https://rocm.nightlies.amd.com/v2-staging/