diff --git a/docs/hub/model-card-annotated.md b/docs/hub/model-card-annotated.md index a509e084f..90845c735 100644 --- a/docs/hub/model-card-annotated.md +++ b/docs/hub/model-card-annotated.md @@ -174,6 +174,13 @@ _Write 1-2 sentences on what the training data is. Ideally this links to a Datas _Detail tokenization, resizing/rewriting (depending on the modality), etc._ +### Training Hyperparameters + + +`training_regime` + +_The training regime, i.e. the numerical precision the model was actually trained with: `fp32`, `fp16` mixed precision, `bf16` mixed precision, `bf16` non-mixed precision, `fp16` non-mixed precision, or `fp8` mixed precision. This affects training speed and memory footprint, and in some cases the numerical stability of results, so it's useful for anyone trying to reproduce training or understand its resource requirements._ + ### Speeds, Sizes, Times