torchrun

Here are 2 public repositories matching this topic...

arpitpatel1364 / SsH-Distrib-Train

This is an end-to-end distributed deep learning orchestrator designed to scale model training across multi-node clusters. It simplifies Distributed Data Parallel (DDP), networking, SSH orchestration, and telemetry by unifying them into a seamless workflow with a centralized, real-time web dashboard for monitoring, control, and performance insights.

ssh clustering distributeddataparallel torchrun

Updated Aug 3, 2026
Python

MGhanayim / k8s-distributed-llm-finetuning

Star

Multi-node PyTorch DDP fine-tuning of a causal LM on Nebius GPU Kubernetes, with SkyPilot workload orchestration — a 2-node torchrun job with verified NCCL collectives.

kubernetes gpu k8s distributed-training nccl mlops pytorch-ddp skypilot llm-ops llm-finetuning nebius gpu-orchestration workload-orchestration ml-orchestration torchrun

Updated Jun 26, 2026
Python

Improve this page

Add a description, image, and links to the torchrun topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the torchrun topic, visit your repo's landing page and select "manage topics."

Learn more