Skip to content

Add Docker infrastructure for running TALES experiments#38

Open
MarcCote wants to merge 1 commit into
mainfrom
macote/docker
Open

Add Docker infrastructure for running TALES experiments#38
MarcCote wants to merge 1 commit into
mainfrom
macote/docker

Conversation

@MarcCote

@MarcCote MarcCote commented May 8, 2026

Copy link
Copy Markdown
Contributor

Docker images (vLLM + SGLang):

  • docker/Dockerfile: All-in-one image based on vllm/vllm-openai:latest
  • docker/Dockerfile.sglang: Alternative image based on lmsysorg/sglang:latest
  • docker/entrypoint.sh: Unified entrypoint supporting both inference backends (SERVER_TYPE=vllm|sglang), activity-based startup timeout, parallel execution
  • docker/README.md: Comprehensive documentation with env var reference

Local runner:

  • run_experiment.sh: Launch experiments via local Docker with full CLI (--model, --server, --gpu-count, --envs, --wandb, etc.)
  • .dockerignore: Whitelist-based to minimize build context

Bug fixes:

  • agents/reasoning.py: Fix reasoning_effort parsed as string instead of int, add DeepSeek-V4 thinking tag extraction
  • benchmark.py: Handle incomplete WandB runs in continue-from logic
  • tales/token.py: Improve token counting robustness
  • tales/wandb_utils.py: Better handling of missing summary data

Docker images (vLLM + SGLang):
- docker/Dockerfile: All-in-one image based on vllm/vllm-openai:latest
- docker/Dockerfile.sglang: Alternative image based on lmsysorg/sglang:latest
- docker/entrypoint.sh: Unified entrypoint supporting both inference backends
  (SERVER_TYPE=vllm|sglang), activity-based startup timeout, parallel execution
- docker/README.md: Comprehensive documentation with env var reference

Local runner:
- run_experiment.sh: Launch experiments via local Docker with full CLI
  (--model, --server, --gpu-count, --envs, --wandb, etc.)
- .dockerignore: Whitelist-based to minimize build context

Bug fixes:
- agents/reasoning.py: Fix reasoning_effort parsed as string instead of int,
  add DeepSeek-V4 thinking tag extraction
- benchmark.py: Handle incomplete WandB runs in continue-from logic
- tales/token.py: Improve token counting robustness
- tales/wandb_utils.py: Better handling of missing summary data

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@christopherzc christopherzc self-assigned this Jun 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants