Add mosaic normalization kernel - #1101
Conversation
|
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). View this failed invocation of the CLA check for more information. For the most up to date status, view the checks section at the bottom of the pull request. |
Normalization benchmarks: Mosaic GPU vs Pallas-TritonNVIDIA A100-SXM4-40GB, All lines logged an autotuning cache miss, so both backends ran heuristics
|
f98e41d to
58f2598
Compare
5b87df9 to
5e69b56
Compare
163babc to
a42e11e
Compare
|
If the input is of shape |
d6d5776 to
3599af0
Compare
3599af0 to
7e74739
Compare
7e74739 to
a06ffd0
Compare
|
I've edited the code to make use of the warpgroup semantics and emit_pipeline functionality now available for Ampere. |
a06ffd0 to
4abf0f9
Compare
| @@ -214,3 +214,8 @@ __marimo__/ | |||
|
|
|||
There was a problem hiding this comment.
I'll remove these eventually. Currently trying out jj, which means explicitly accounting for all untracked files.
4abf0f9 to
c9aa059
Compare
Adds a Mosaic version of the normalization kernel. Importantly, this implementation does not use any modern GPU features, and works with Ampere GPUs (e.g. A100) too!