Skip to content

Latest commit

 

History

History
338 lines (273 loc) · 16.3 KB

File metadata and controls

338 lines (273 loc) · 16.3 KB

Workspaces

A workspace is the directory your own content lives in: the workflows you write, the prompt library they reference, the assets they read, and the files they generate.

<workspace>/
  workflows/    your workflows
  prompts/      the stored prompt library ('prompt:' references)
  assets/       input media
  outputs/      generated files

This exists so that day-to-day work does not have to live inside a checkout of this repository. The examples under the repo's workflows/ are still examples — a corpus to read, copy and run — but they are not where your own workflows belong, and generated media does not belong in a source tree at all.

Which directory is used

The workspace is resolved by dw.serve. python -m dw.run is a client of a running dw.serve, so it resolves no directory of its own: its jobs land in the server's workspace. First match wins:

  1. --workspace <dir> on dw.serve
  2. the DW_WORKSPACE environment variable
  3. "workspace" in ~/.diffusers_helper/settings.json
  4. the working directory, when it holds any of workflows/, prompts/ or outputs/
  5. ~/diffusers-workspace

Rule 4 is why nothing changes when you work from a checkout: the repository root holds all three, so it resolves to itself and every default lands exactly where it always has. Only a working directory with none of those folders falls through to the home workspace.

Nothing is created just by resolving. A command that is about to write creates what it needs — dw.serve creates the workspace's workflows/ so the UI has somewhere to save, and a run creates its output directory.

dw.run --workspace NAME is a different thing: it names one of the server's workspaces (the default one, or a named one beside it), not a directory. A path there is refused as a workspace name rather than resolved.

Overriding one folder

The per-directory flags are dw.serve's, and each overrides exactly one folder of the workspace:

python -m dw.serve --workspace ~/studio --output-dir /mnt/big-disk/renders
python -m dw.serve --prompt-dir ~/shared-prompts

dw.run takes none of them - every job it queues writes where the server does.

--output-dir is the one people reach for most: video work fills disks, and the outputs folder is the one worth putting on another volume.

Working in a workspace

mkdir -p ~/studio/{workflows,prompts,assets,outputs}
export DW_WORKSPACE=~/studio

# or, standing, in ~/.diffusers_helper/settings.json
#   { "workspace": "/home/you/studio" }

python -m dw.serve                       # serves ~/studio
python -m dw.run ~/studio/workflows/x.json   # queued on that server

An example from a checkout still runs by path, and writes into the server's workspace's outputs; dw.run itself does not read DW_WORKSPACE:

python -m dw.run ~/src/diffusers-workflow/workflows/templates/text-to-image.json

A file the server cannot read is sent to it inline, and its relative paths then resolve against the server's workflows/.

The server reports what it resolved at GET /api/server, under directories.workspace alongside the three folder paths.

The prompt library

prompt: references resolve to the workspace's prompts/ when a workspace was named explicitly (rules 1–3 above, or DW_PROMPT_DIR, which still wins over everything). A workspace that was merely inferred from the working directory does not preempt the older discovery — ./prompts, then the nearest prompts/ above the workflow file — so a repository workflow keeps reaching the library it lives beside. When the workspace is explicit, its prompts/ becomes the library even if it does not exist yet, so a checkout's ./prompts is no longer found once a standing workspace setting (like DW_WORKSPACE or "workspace" in settings.json) is in place; --prompt-dir and DW_PROMPT_DIR still override it. This follows the "explicit wins" rule. See Prompt References.

Assets

assets/ is the input-media library. A workflow argument written as asset:name.ext (or asset:folder/name.ext) resolves to that file's path, rooted at the library rather than at the workflow file — so a workflow and the media it reads no longer have to sit in the same folder. --asset-dir and DW_ASSET_DIR override the folder, and browser uploads land in assets/uploads/, coming back as asset:uploads/<name> (and served for preview under /inputs/, since the SPA's own bundles own /assets/).

A generated file becomes an input the same way: Keep as asset in the gallery (POST /api/assets/keep, keep_output over MCP) links or copies it out of outputs/ into assets/ under a name you choose, so a later workflow carries asset:<name> rather than a run id that pruning would break. The copy stays inside the workspace — a hard link where the filesystem allows one, so keeping one frame of a large render costs no second copy of it. See Asset References.

Where workflows are read from, and written to

The server reads workflows from a search path and writes them to exactly one place — the front:

<workspace>/workflows/    yours, writable — every save lands here
<--examples-dir>          read-only, repeatable

A name found in an earlier root shadows the same name in a later one, so a workspace copy of an example is the one that runs. Reads — listing, opening, downloading, validating, running — span the whole path. Saves and deletes do not: PUT always writes into the writable root, and deleting something from a read-only root is refused with a 403 that says where it came from.

That makes "open an example, change it, save" do the obvious thing: the copy lands in your library and shadows the example from then on, and the example itself is never touched. It is also what stops an agent's saves landing in a checkout — point --workflow-dir (or --workspace) at your own directory and the repository's workflows at --examples-dir:

python -m dw.serve --workspace ~/studio --examples-dir ~/src/diffusers-workflow/workflows

GET /api/workflows reports the path as libraries ([{origin, root, writable}], in search order) and tags every entry in details with its origin and writable, which is how the UI knows to hide delete and how an MCP client can tell what it may change. The writable root is the libraries entry with writable: true and origin: "workspace"; a copy an example's name hides is listed under shadowed.

The prompts and assets an examples tree brings with it

An example workflow references the prompts and media that live beside its tree, not the ones in your workspace, so each --examples-dir puts those on the back of the two libraries as well: the prompts/ and assets/ folders beside the directory (or inside it, if that is where they are). Both libraries work exactly like the workflow path — your workspace's own is searched first and a name there shadows the example's, reads span everything, and writes only ever reach your own:

<workspace>/prompts/      yours, writable — every save lands here
<--examples-dir>/../prompts   read-only

<workspace>/assets/       yours, writable — uploads and "keep as asset" land here
<--examples-dir>/../assets    read-only

So the command above makes workflows/models/flux-dev.json's "prompt:flux/biomechanical_daffodil" resolve out of the checkout, without copying the prompt library into the workspace. GET /api/prompts and GET /api/assets report the roots as libraries, the same envelope as the workflow listing, and tag each entry with its origin and writable; deleting a prompt that came from a read-only library is refused with a 403, and saving one writes a copy into your workspace the way saving an example workflow does.

The packaged workflows in dw/workflows/ are deliberately not on the path. They are the pieces a builtin: sub-workflow step names, resolved by the engine where that step is read — not workflows to browse or run on their own.

Runs

Each execution writes its own directory under the output folder, named by the workflow and the run:

outputs/
  ltx2/Gyre/
    20260905-181530-a1b2c3d4/
      Gyre-still.0-0.0.png
      Gyre-video.1-0.0.mp4
      manifest.json
      workflow.json

The folder is the workflow's identity — its path under a workflows/ tree when it has one, its file name otherwise, its id for an inline definition. The run id is a timestamp plus a short digest of what actually ran, so two runs of the same workflow sort by time and a rerun of an edited workflow is visibly different; a second run of the same spec in the same second takes a counter rather than sharing a directory.

workflow.json is the realized workflow — the definition with this run's arguments, seed and stored prompts pinned into it, so the directory reproduces itself. manifest.json points at it and lists which prompts were inlined.

manifest.json records the run beside what it made — status, seed, arguments, device, dw version, and each step's files, named relative to the directory so it keeps describing itself if you move or copy it. It is written even when a run fails part way, since the files it did write are on disk either way. A sub-workflow is part of its parent's run: it writes into the same directory and rolls up into the same manifest.

An unchanged rerun still reuses the step cache: it writes no new files and its manifest reports the earlier run's, marked "reused": true. The cache is validated against the output root a run writes into, which is the pinned workspace's own outputs/ - so it is per workspace, not per workflow alone. A run in one workspace does not make validate_workflow's plan.cached_steps come back nonzero for a matching run sitting in another workspace, and deleting a workspace drops its cache entries along with its outputs/ directory. The cache itself is also per process: entries are held in memory by the running server, not read back from outputs/, so a dw.serve restart empties it even though every run directory is still on disk - a plan.cached_steps of 0 right after a restart is expected, not a lost run.

A later workflow names what an earlier run made with an output: reference — output:ltx2/Gyre/latest/Gyre-still.0-0.0.png — so a multi-stage pipeline no longer needs files copied back by hand. See Output References.

To keep the previous layout — everything at the output root, with only a workflows/-mirroring subfolder — use --output-layout flat, DW_OUTPUT_LAYOUT=flat, or "output_layout": "flat" in settings. Scripts that glob the output directory are the reason to.

Several workspaces on one server

Everything above describes one workspace. dw.serve goes one step further: the workspace root can hold several, and a client picks which one it is working in - dw.run --workspace NAME among them.

<workspace root>/
  workflows/  assets/  outputs/    <- the 'default' workspace
  prompts/                         <- shared by all of them
  loras/                           <- the LoRA catalog, shared by all of them
  common/assets/                   <- shared by all of them
  studio/
    workflows/  assets/  outputs/  <- the 'studio' workspace
  scratch/
    workflows/  assets/  outputs/  <- the 'scratch' workspace

The root's own three folders are the workspace named default, so a server that has never heard of named workspaces behaves exactly as it did. A named workspace is a sibling directory holding the same three folders — and not a prompts/, because there is one prompt library: prompt: is shared by reference, and a prompt duplicated per workspace would resolve to different text depending on where a workflow happened to be saved. workflows, prompts, assets and outputs are reserved names for that reason.

Three more names are reserved beside workflows, prompts, assets and outputs: exports, common and loras. loras/ is the LoRA catalog, shared by every workspace like prompts/; a workspace already named loras stops being listed on upgrade, and the server logs a warning at start naming its directory. POST /api/jobs/{id}/export gathers one finished job into <root>/exports/<job id>/, and that folder is never mistaken for a workspace.

The shared asset library. common/assets/ is the one place an asset can live that belongs to no single workspace. Assets are otherwise per workspace, which is right for the inputs of one piece of work and wrong for a recurring cast: a character's portrait and voice clip uploaded while making episode one were invisible from the workspace episode four was made in, and the only way through was to copy the files in. It sits on every workspace's asset search path behind that workspace's own library, so:

  • asset:cast/priya.png resolves in the workspace first, then in the shared library, then in any read-only examples library — a workspace's own name still shadows a shared one
  • GET /api/assets spans all of them and tags each entry's origin: workspace, common, or examples
  • writes still land in the workspace unless they say otherwise: POST /api/uploads?shared=true, POST /api/assets/keep with "shared": true, and over MCP upload_asset(..., shared=True) / keep_output(..., shared=True)

It holds assets only. A prompt is already shared, and workflows and outputs belong to the work that made them.

This is what lets two agents share the server's GPUs without sharing a namespace: each takes a workspace, and neither can save over the other's workflows or delete the other's renders. The queue is shared across workspaces and the engine runs one job per GPU (dw.serve --devices), so two agents' jobs run side by side when there is a free card each fits, and queue otherwise.

How a client picks one. Every scoped route takes an optional ?workspace=<name>; omitting it means default, which is why every pre-workspace call still means what it meant.

Client How
Web UI The sidebar lists every workspace; the selected one is named in the hash (#/ws/<name>/...), so a link and a reload both land where they say. The choice is remembered in localStorage as a fallback for a route that names none (Shared, Server), and Server → Status adds a filter over the all-workspaces queue — job history spans every workspace there and says which one each job ran in
MCP list_workspaces, then use_workspace(name). It is a session default rather than an argument on each call, so switching is one visible step in the transcript instead of a flag that can be forgotten on the call where it mattered
HTTP ?workspace= on the route, or "workspace" in a POST /api/jobs body
Web UI (create/delete) The sidebar's + new creates one; a workspace's own Overview page deletes it (disabled for default)

A job carries its own workflow, asset and output directories, so it stays in the workspace it was submitted from however many others the server serves while it runs — including through a rerun, and when its files are served back from history.

Creating and deleting. POST /api/workspaces (create_workspace over MCP) makes one; creating does not switch to it. Deleting removes everything in it, so it refuses until acknowledged and answers first with what it would remove — file counts and bytes per folder. The default workspace cannot be deleted (it holds the shared prompt library, and there has to be somewhere to work), nor can one with jobs still queued.

A workspace is a namespace, not a security boundary. The API token is all-or-nothing: anything that can reach the server can name any workspace on it. Use them to keep work apart, not to keep it private.

Where this is going

The resolver, the workflow search path with writes confined to the writable root, run directories with an on-disk manifest, asset: and output: references, and server-side named workspaces are all implemented. A further stage was designed but deliberately not built: a client-side workspace (a laptop directory, under version control) that mirrors into a read-only server workspace, so an agent could author offline and only push at submit time. It stayed on the drawing board because source control of creative work is not this project's job — that is already handled on the client, by the user, with the tools they already use — which is what makes a mirroring layer unnecessary rather than merely speculative.