Skip to content

[Determinism] torch.utils.deterministic.fill_uninitialized_memory default to false for determinism perf #6253

Description

@ZhiyuLi-Nvidia

Describe the bug

Determinism tax reduced from ~15% to ~2%, based on optimizations proposed by Nathan Tuck US

torch.utils.deterministic.fill_uninitialized_memory defaults to true with torch determinism setup but it is too strict not necessary to ensure determinism.

Steps/Code to reproduce bug

Please list minimal steps or code snippet for us to be able to reproduce the bug.

A helpful guide on on how to craft a minimal bug report http://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports.

Expected behavior

A clear and concise description of what you expected to happen.

Additional context

Add any other context about the problem here.

Metadata

Metadata

Labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions