Skip to content

Integrate direct hybrid architectures with training - #6299

Draft
Phlip79 wants to merge 1 commit into
NVIDIA:pull-request/6298from
Phlip79:philip/direct-hybrid-training
Draft

Integrate direct hybrid architectures with training#6299
Phlip79 wants to merge 1 commit into
NVIDIA:pull-request/6298from
Phlip79:philip/direct-hybrid-training

Conversation

@Phlip79

@Phlip79 Phlip79 commented Aug 5, 2026

Copy link
Copy Markdown
Member

Summary

  • Integrate direct architectures with training initialization, FLOPs, MoE reporting, and checkpoints.
  • Attach and serialize architecture state only for the direct path.
  • Keep legacy builder, metrics, FLOPs, and checkpoint behavior on their existing paths.

Stacked on #6298.

@copy-pr-bot

copy-pr-bot Bot commented Aug 5, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Phlip79 commented Aug 5, 2026

Copy link
Copy Markdown
Member Author

/ok to test 5757d6b

@Phlip79

Phlip79 commented Aug 5, 2026

Copy link
Copy Markdown
Member Author

/ok to test 341a7b7

@Phlip79

Phlip79 commented Aug 5, 2026

Copy link
Copy Markdown
Member Author

/ok to test a773a9d

Signed-off-by: Philip Petrakian <ppetrakian@nvidia.com>
@Phlip79
Phlip79 force-pushed the philip/direct-hybrid-training branch from a773a9d to 5cd4586 Compare August 5, 2026 23:18
@copy-pr-bot
copy-pr-bot Bot force-pushed the pull-request/6298 branch from e2734a3 to dff1c46 Compare August 5, 2026 23:19
@Phlip79

Phlip79 commented Aug 5, 2026

Copy link
Copy Markdown
Member Author

/ok to test 5cd4586

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant