Skip to content

[Experimental] MiniMax-H3 LoRA training on B200: 2.5x faster step from three changes, with takeaways for the repo's acceleration - #1680

Draft
TarzanZhao wants to merge 3 commits into
modelscope:mainfrom
TarzanZhao:perf/minimax-h3-lora-training
Draft

[Experimental] MiniMax-H3 LoRA training on B200: 2.5x faster step from three changes, with takeaways for the repo's acceleration#1680
TarzanZhao wants to merge 3 commits into
modelscope:mainfrom
TarzanZhao:perf/minimax-h3-lora-training

MiniMax-H3: selective activation checkpointing, attention output kept

1e8661d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs