Runs
Ubuntu 24.04
dstack's base Docker images have been upgraded from Ubuntu 22.04 to Ubuntu 24.04. This means runs are now executed in the Ubuntu 24.04 containers unless image is specified. See the Ubuntu 24.04 LTS release notes for more details.
Note: If your runs hard-depend on the previous Ubuntu version, specify image in the run configuration explicitly:
type: task
image: dstackai/base:0.13-base-ubuntu22.04
commands: ...Instances
Run configurations now support instances property that allows provisioning runs only on the specified instances:
type: dev-environment
ide: vscode
instances: [{fleet: my-ssh-fleet, instance: 0}]This can be useful if, for example, a run depends on an Instance Volume that exists on a specific SSH instance.
See the reference for different syntax options supported by instances.
Gateways
Replicas
A gateway can now have multiple replicas for improved availability and scalability:
type: gateway
name: example-gateway
backend: aws
region: eu-west-1
domain: example.com
certificate: null
replicas: 2To balance requests between gateway replicas, add DNS records for each replica or set up a load balancer outside of dstack.
Note: Automatic HTTPS is not supported for replicated gateways. Use an external load balancer for TLS termination.
Replicated gateways are an experimental feature. See the docs for all the limitations.
Backends
AWS
NVIDIA B200 and B300
dstack now supports AWS p6-b200 and p6-b300 instance types, with max-throughput EFA networking setup out-of-the-box. p6-b300 is the first instance type natively supported by dstack that comes with NVIDIA Blackwell Ultra B300 GPUs and 6,400 Gbps networking. Give it a try:
✗ dstack apply -f b300-fleet.dstack.yml
...
# BACKEND REGION INSTANCE RESOURCES SPOT PRICE
1 aws us-east-1 p6-b300.48xlarge cpu=192 mem=4096GB disk=100GB gpu=B300:268.6GB:8 yes $33.082
2 aws us-west-2 p6-b300.48xlarge cpu=192 mem=4096GB disk=100GB gpu=B300:268.6GB:8 yes $34.4876
3 aws us-west-2 p6-b300.48xlarge cpu=192 mem=4096GB disk=100GB gpu=B300:268.6GB:8 no $142.416
...
Shown 3 of 4 offers, $142.416 max
What's changed
- Support AWS p6 instances by @r4victor in #3961
- Support targeting specific instances by @peterschmidt85 in #3958
- Support Zed in the UI: add to IDE dropdown and fix Open-in-IDE link by @peterschmidt85 in #3963
- Separate Docker and VM base image versions by @r4victor in #3966
- [Docs]: Tenant isolation guide by @jvstme in #3913
- [Nebius]: Update OS image and add new platforms by @jvstme in #3970
- Update nvidia drivers installation in VM images by @r4victor in #3967
- [Docs]: Revise the SSH proxy section by @peterschmidt85 in #3965
- Add Docker Compose for a Postgres-backed server with SSH proxy by @peterschmidt85 in #3964
- Support gateways with multiple replicas by @jvstme in #3960
- Fix runtime error with grpcio by @Bihan in #3971
- Drop special handling of the Sky gateway by @jvstme in #3974
- Add script to manage dstack AWS AMIs by @r4victor in #3976
- Update docker base image to ubuntu 24.04 by @r4victor in #3972
- Bump base image versions to 0.14 by @r4victor in #3977
- Improve replicated gateway display in older CLIs by @jvstme in #3975
- Replace lsblk fs detection with blkid by @r4victor in #3979
Full changelog: 0.20.24...0.20.25
