[hipBLASLt] add tuned K=1024 grid entries for gfx1151 BF16 GEMMs used by VJEPA-2#9238
[hipBLASLt] add tuned K=1024 grid entries for gfx1151 BF16 GEMMs used by VJEPA-2#9238serged-amd wants to merge 1 commit into
Conversation
Improve V-JEPA2 model throughput by 12% (39.4 -> 44.3 FPS) Changes to gfx1151_Cijk_Alik_Bljk_BBS_BH_Bias_HAS_SAV_UserArgs.yaml: - Add 3072×576×1024: solution 287 (24.5 -> 32.3 TFLOPs) - Fix 1024×576×1024: solution 257→226 (24.3 -> 30.5 TFLOPs) - Fix 1024×576×4096: solution 219→226 (23.9 -> 33.7 TFLOPs)
❌ PR Check — Action Required
📖 Need help? See the Policy FAQ for details on every check and how to fix failures. |
|
🚫 Please fix the failed policies before requesting reviews. The following policy checks failed:
The |
Codecov Report✅ All modified and coverable lines are covered by tests. ❌ Your project status has failed because the head coverage (76.92%) is below the target coverage (80.00%). You can increase the head coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## develop #9238 +/- ##
===========================================
- Coverage 64.99% 64.99% -0.00%
===========================================
Files 2685 2685
Lines 422106 422157 +51
Branches 62705 62717 +12
===========================================
+ Hits 274342 274355 +13
- Misses 127065 127102 +37
- Partials 20699 20700 +1
*This pull request uses carry forward flags. Click here to find out more. 🚀 New features to boost your workflow:
|
Motivation
The GEMM shapes used by the VJEPA-2 model have sub-optimal defaults which cause reduced model throughput.
This PR adds one and modifies two K=1024 grid points to significantly improve GEMM performance in this model.
Technical Details
Changes to
gfx1151_Cijk_Alik_Bljk_BBS_BH_Bias_HAS_SAV_UserArgs.yaml:Grid entry changes:
[3072, 576, 1, 1024] -> [287, 32280.3][1024, 576, 1, 1024] -> [226, 30463.3](was[257, 6.93])[1024, 576, 1, 4096] -> [226, 33695.3](was[219, 6.72])Test Plan
HIPBLASLT_LOG_MASK=32Test Result
V-JEPA2 ViT-L/384: 39.4 -> 44.3 FPS (+12%)
Solution selection verified:
Submission Checklist