diff --git a/pods/choose-a-pod.mdx b/pods/choose-a-pod.mdx index df09d5b2b..6e3d850e8 100644 --- a/pods/choose-a-pod.mdx +++ b/pods/choose-a-pod.mdx @@ -12,16 +12,18 @@ Start by identifying your primary workload type: | Workload | Recommended GPU tier | Minimum VRAM | Notes | |----------|---------------------|--------------|-------| -| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4) | 24 GB | Sufficient for most quantized models | -| **LLM inference** (30B–70B params) | High-end (A100, H100) | 48–80 GB | May require multi-GPU setup | +| **LLM inference** (7B–13B params) | Mid-range (RTX 4090, L4, PRO 6000 MIG 24GB) | 24 GB | Sufficient for most quantized models | +| **LLM inference** (30B–70B params) | High-end (A100, H100, PRO 6000 MIG 48GB) | 48–80 GB | May require multi-GPU setup | | **LLM training/fine-tuning** | High-end (A100, H100) | 40–80 GB | Memory bandwidth critical | -| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4) | 16–24 GB | Benefits from fast inference | +| **Image generation** (SDXL, Flux) | Mid-range (RTX 4090, L4, PRO 6000 MIG 24GB) | 16–24 GB | Benefits from fast inference | | **Computer vision** | Entry to mid-range | 8–16 GB | Depends on model and batch size | | **3D rendering** | Mid-range with RT cores | 16–24 GB | RT cores accelerate ray tracing | | **Data processing** | CPU-focused or entry GPU | 8 GB+ | Prioritize CPU cores and RAM | For a full list of available GPUs and their specifications, see [GPU types](/references/gpu-types). +RTX PRO 6000 Multi-Instance GPU (MIG) slices are partitioned GPU instances with dedicated memory and compute. Available on Secure Cloud only. All MIG slices use Blackwell architecture. Verify your CUDA version and framework versions support Blackwell before deploying. + ## Estimate VRAM requirements VRAM is the most common bottleneck. Use these guidelines: diff --git a/references/gpu-types.mdx b/references/gpu-types.mdx index e250640fb..0ee485ee6 100644 --- a/references/gpu-types.mdx +++ b/references/gpu-types.mdx @@ -52,6 +52,8 @@ This table lists all GPU types available on Runpod: | NVIDIA RTX A6000 | RTX A6000 | 48 | | NVIDIA RTX PRO 4500 Blackwell | RTX PRO 4500 | 32 | | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | RTX PRO 6000 MaxQ | 96 | +| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 1g.24gb | PRO 6000 MIG 24GB | 24 | +| NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 2g.48gb | PRO 6000 MIG 48GB | 48 | | NVIDIA RTX PRO 6000 Blackwell Server Edition | RTX PRO 6000 | 96 | | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | RTX PRO 6000 WK | 96 | | Tesla V100-PCIE-16GB | Tesla V100 | 16 |