Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -44,15 +44,15 @@ page lists the builds it supports.

InvokeAI recognizes the format from the file's contents, so you install them like any other model. Which format loads for which model is listed in [Model Format Support](/users-guide/models/model-format-support/).

- **GGUF** (`.gguf`, llama.cpp quantization such as Q4_K or Q8_0): weights stay packed in memory and are unpacked layer by layer during generation. Supported for the FLUX.1, FLUX.2, Z-Image, Krea-2, Qwen-Image, Qwen-Image-2.1, Ideogram 4, ERNIE-Image and Wan transformers, and for the T5, Qwen3, Qwen3-VL, Mistral and Gemma 2 text encoders. ComfyUI-GGUF's `Q8_CR` files, which store int8 (`int8_convrot`) layers inside a `.gguf`, load for the Krea-2 transformer; for other models, and for ComfyUI-GGUF's `Q4_CR`, installation is refused with a message saying so.
- **GGUF** (`.gguf`, llama.cpp quantization such as Q4_K or Q8_0): weights stay packed in memory and are unpacked layer by layer during generation. Supported for the FLUX.1, FLUX.2, FLUX.3, Z-Image, Krea-2, Qwen-Image, Qwen-Image-2.1, Ideogram 4, ERNIE-Image and Wan transformers, and for the T5, Qwen3, Qwen3-VL, Mistral and Gemma 2 text encoders. ComfyUI-GGUF's `Q8_CR` files, which store int8 (`int8_convrot`) layers inside a `.gguf`, load for the Krea-2 transformer; for other models, and for ComfyUI-GGUF's `Q4_CR`, installation is refused with a message saying so.
- **NF4** (bitsandbytes): 4-bit, CUDA only.
- **SDNQ**: see [SDNQ Quantization](/configuration/optimization/sdnq-quantization/).
- **int8** (`int8_convrot`, from ComfyUI repackages): the weights stay int8 in memory on every device, including Apple Silicon, and need no setting to turn on. Supported for FLUX.1, FLUX.2 Klein, Z-Image, Krea-2, Qwen-Image-2.1, Ideogram 4, MiniMax H3, LTX-2 and the PiD decoders, and for the Qwen3 8B, Qwen3-VL and LTX-2 Gemma encoders.
- **nvfp4** (4-bit, in ComfyUI's checkpoint format, such as Comfy-Org's builds; other nvfp4 exports such as AWQ are refused): the weights stay packed in memory and are unpacked per layer, so no special GPU is needed. Supported for the Z-Image, Krea-2, Qwen-Image and LTX-2 transformers and for the Qwen3, Qwen2.5-VL and FLUX.2 Mistral encoders; the Ideogram 4 and Qwen-Image-2.1 nvfp4 files are refused at install.
- **fp8** (plain or `fp8_scaled`): InvokeAI keeps the weights in fp8 when [FP8 Storage](/configuration/optimization/fp8-storage/) is on, which installation does for you, or when `fp8_compute` is enabled.
- **MXFP8** (fp8 with one scale per block of 32 weights): loaded by unpacking to BF16. Turn FP8 Storage off for these; see the [FP8 Storage caution](/configuration/optimization/fp8-storage/).

Text encoders for Qwen-Image, Z-Image, Krea-2, Ideogram 4 and Qwen-Image-2.1 bring their tokenizer and configuration with InvokeAI, so single-file and GGUF encoders load without network access.
Text encoders for Qwen-Image, Z-Image, Krea-2, FLUX.3, Ideogram 4 and Qwen-Image-2.1 bring their tokenizer and configuration with InvokeAI, so single-file and GGUF encoders load without network access.

### Converting to Diffusers

Expand All @@ -77,7 +77,7 @@ single-file and quantized installs you often pick some of them
yourself. They appear as separate models in the Model Manager, and
generation panels show slots for them (for example **VAE**, **Text
encoder** or **Model components**) when the selected model needs
them. Several families share components: FLUX.2 and Ideogram 4 use
them. Several families share components: FLUX.2, FLUX.3 and Ideogram 4 use
the same VAE, for example, and Ideogram 4 and Qwen-Image-2.1 the same Qwen3-VL 8B
encoder, so one download can serve both.

Expand Down Expand Up @@ -119,6 +119,7 @@ faster generation.
| **Stable Diffusion 3.5** | Images | Medium and Large transformer models from Stability AI, with three text encoders. | Community, free under $1M revenue | [SD 3.5](/users-guide/models/local-models/sd-3/) |
| **FLUX.1** | Images | Dev, Schnell, Kontext (image editing) and Krea variants, plus Fill (inpainting, workflow editor only) and Redux, with ControlNets and IP-Adapters. | schnell: Apache 2.0; others non-commercial | [FLUX.1](/users-guide/models/local-models/flux-1/) |
| **FLUX.2** | Images | Klein 4B and 9B, and the much larger [dev]. Generates and edits images from reference images; [dev] also takes a ControlNet. | Klein 4B: Apache 2.0; Klein 9B and [dev] non-commercial | [FLUX.2](/users-guide/models/local-models/flux-2/) |
| **FLUX.3** | Images | 5.6B Klein in a fast step-distilled variant and an undistilled Base. Generates and edits images from up to ten reference images. | Kommunity, free under $5M revenue | [FLUX.3](/users-guide/models/local-models/flux-3/) |
| **CogView4** | Images | THUDM's 6B text-to-image model with a GLM text encoder. Basic support, without LoRAs, ControlNets or reference images. | Apache 2.0 | [CogView4](/users-guide/models/local-models/cogview4/) |
| **Z-Image** | Images | 6B model in a fast, few-step Turbo variant and a Base variant. Understands English and Chinese prompts, with ControlNets. | Apache 2.0 | [Z-Image](/users-guide/models/local-models/z-image/) |
| **ERNIE-Image** | Images | Baidu's 8B text-to-image model, in standard and distilled Turbo variants. | Apache 2.0 | [ERNIE-Image](/users-guide/models/local-models/ernie-image/) |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ Ministral 3B encoder. Others are recognized by their layer names and fail, or mi
| [SD 3](/users-guide/models/local-models/sd-3/) | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| [FLUX.1](/users-guide/models/local-models/flux-1/) | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ |
| [FLUX.2](/users-guide/models/local-models/flux-2/) | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | inside the Diffusers folder (FLUX.2 [dev]) |
| [FLUX.3](/users-guide/models/local-models/flux-3/) | ✓ | ✓ | R | R | R | – | ✓ | – | – |
| [CogView4](/users-guide/models/local-models/cogview4/) | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
| [Z-Image](/users-guide/models/local-models/z-image/) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| [Qwen-Image](/users-guide/models/local-models/qwen-image/) | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✗ | ✗ |
Expand Down Expand Up @@ -59,7 +60,7 @@ Ministral 3B encoder. Others are recognized by their layer names and fail, or mi
| T5-XXL | FLUX.1, SD 3 | ✓ | ✗ | ✗ | ✗ | ✗ | ✓ | ✓ (and bitsandbytes int8) |
| CLIP-L / CLIP-G | SD, SDXL, FLUX.1, SD 3 | ✓ | ✓ | R | R | – | ✗ | CLIP-L inside a FLUX.1 SDNQ pipeline |
| Qwen3 0.6B / 4B / 8B | Z-Image (4B), FLUX.2 Klein (4B, 8B), Anima (0.6B) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Qwen3-VL 4B / 8B | Krea-2, Ideogram 4, Qwen-Image-2.1 (8B) | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✗ |
| Qwen3-VL 4B / 8B | Krea-2, FLUX.3, Ideogram 4, Qwen-Image-2.1 (8B) | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✗ |
| Qwen3-VL 32B (truncated) | MiniMax H3 | in the Diffusers folder | ✓ | L | ✓ | L | ✗ | ✗ |
| Qwen3.5 4B | Anima 3.8B | ✗ | ✓ | L | L | L | ✗ | ✗ |
| Qwen2.5-VL | Qwen-Image | ✓ | ✓ | ✓ | L | ✓ | ✗ | ✗ |
Expand All @@ -83,7 +84,7 @@ not recognized.

| VAE | Single file | Diffusers | Used by |
|---|---|---|---|
| SD 1.x, SDXL, SD 3, FLUX.1, FLUX.2 | ✓ | ✓ | its own family; FLUX.1's also by Z-Image, FLUX.2's also by Ideogram 4 and ERNIE-Image |
| SD 1.x, SDXL, SD 3, FLUX.1, FLUX.2 | ✓ | ✓ | its own family; FLUX.1's also by Z-Image, FLUX.2's also by FLUX.3, Ideogram 4 and ERNIE-Image |
| SD 2.x | ✓ | ✗ | SD 2.x |
| Wan (16 and 48 channels) | ✓ | ✓ | Wan 2.2; the Wan 2.1 VAE also by Anima |
| Qwen-Image | ✓ | ✗ | Qwen-Image, Krea-2 |
Expand All @@ -104,7 +105,7 @@ not check, so a quantized file there fails with an unclear error or decodes inco
| FLUX.2, Z-Image | ✓ (LyCORIS, Diffusers) | FLUX.2 [dev] (single-file checkpoint), Z-Image | |
| Qwen-Image, Krea-2, Wan 2.2, Anima | ✓ (LyCORIS/kohya, including LoKR where noted on the family page) | Qwen-Image (single-file checkpoint), Anima (ControlNet-LLLite) | |
| LTX-2, MiniMax H3 | ✓ (plain low-rank; LoKR, LoHA and DoRA are refused) | ✗ | |
| SD 3, CogView4, Ideogram 4, ERNIE-Image, Qwen-Image-2.1 | ✗ | ✗ | |
| SD 3, CogView4, FLUX.3, Ideogram 4, ERNIE-Image, Qwen-Image-2.1 | ✗ | ✗ | |

[PiD decoders](/users-guide/image-generation/advanced-topics/pid-decode/) load for FLUX.1, FLUX.2, SD 3, SDXL and
Qwen-Image (v1 and v1.5, bf16 and int8 builds).
[PiD decoders](/users-guide/image-generation/advanced-topics/pid-decode/) load for FLUX.1, FLUX.2 (whose decoders also decode FLUX.3), SD 3,
SDXL and Qwen-Image (v1 and v1.5, bf16 and int8 builds).
118 changes: 118 additions & 0 deletions docs/src/content/docs/Users Guide/03.Models/Local Models/flux-3.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,118 @@
---
title: FLUX.3
description: Generate and edit images with FLUX.3 Image Klein (step-distilled) and Klein Base, including editing with up to ten reference images and the GGUF / single-file workflow.
lastUpdated: 2026-10-16
sidebar:
order: 6
---

FLUX.3 Image Klein is a 5.6B diffusion transformer from Black Forest Labs that generates images from text
and edits or combines up to ten reference images. InvokeAI supports both published checkpoints:

- **FLUX.3 Klein**: step-distilled, for everyday use. Runs at **16 steps** with **CFG off** (CFG Scale `1.0`).
It always samples without CFG, so Invoke is unavailable while CFG Scale is above 1.
- **FLUX.3 Klein Base**: the undistilled checkpoint. Runs at **50 steps** with **CFG 3.5** and a negative
prompt. It is meant mainly for fine-tuning and LoRA training, but generates normally too.

The variant is detected on install. A new FLUX.3 model starts with the defaults of its variant (steps, CFG,
1024×1024); when you switch from one variant to the other, use **Reset all to model defaults** in the
Generate panel header to take over the new defaults.

## License

Both checkpoints are released under the **FLUX Kommunity License v1.0**: non-commercial use, or commercial use
for companies below US$5M in annual revenue. The Black Forest Labs repositories are gated: accept the license on
the model's HuggingFace page and add your HuggingFace token under **API Keys** in the Model Manager. The GGUF
copies are not gated, but the same license applies.

This is a summary, not legal advice. Read the full license on the model's HuggingFace page before using a model
commercially.

## Hardware

| Transformer build | Transformer size | Notes |
| --------------------------- | ---------------- | --------------------------------------- |
| bf16 (Diffusers or single file) | ≈ 10.3 GiB | reference quality |
| GGUF Q8_0 (starter model) | ≈ 5.6 GiB | close to bf16 |
| GGUF Q4_K_M (starter model) | ≈ 3.1 GiB | lowest VRAM; fine detail differs from bf16 |

The Qwen3-VL 4B encoder (≈ 8.5 GB as bf16, about half as fp8) and the FLUX.2 VAE come on top. The encoder runs
before the transformer, so the two do not have to fit on the GPU at the same time.

Reference images add to the work per step: each 1 MP reference costs about as much as the image itself. On an
RTX 4090 a 1024² image takes about 15 s with Klein, 25 s with one reference, 50 s with three references, and
about 50 s with Klein Base.

## Installing

The **FLUX.3 launchpad bundle** in the Model Manager installs the GGUF Q4_K_M transformer, the Qwen3-VL 4B encoder
and the FLUX.2 VAE. None of these are gated.

FLUX.3 needs three components:

| Component | Diffusers install | GGUF / single-file install |
| ------------------------- | ----------------------- | -------------------------- |
| Transformer | bundled | the `.gguf` or `.safetensors` file |
| VAE (FLUX.2) | bundled | installed separately |
| Text encoder (Qwen3-VL 4B) | bundled | installed separately |

- **Diffusers** (`black-forest-labs/flux-3-image-klein`, `black-forest-labs/flux-3-image-klein-base`): an install
of about 20 GB that bundles the VAE and the text encoder. Installing by repository id downloads only the
Diffusers folders, not the single-file copy that sits next to them in the repository.
- **GGUF / single file**: the file holds only the transformer. Install the **FLUX.2 VAE** and the **Qwen3-VL 4B
encoder** as well. They are the same models FLUX.2 and Krea-2 use, so an existing install serves FLUX.3 too.

When you select a GGUF or single-file FLUX.3 model, pick the VAE and the Qwen3-VL encoder under **Components** if
they are not filled in. A Diffusers model uses its bundled components unless you override them there.

:::note[Quantized single files]
The fp8, int8 and nvfp4 single files from Black Forest Labs and Comfy-Org are not supported yet. Installing one is
refused with a message saying so. Use the bf16 file or a GGUF.
:::

## Reference images

Add up to **ten** reference images on the Generate tab or the Canvas and describe the edit in the prompt. No extra
model is needed. A single reference is used at up to 4 MP; with several, each is limited to 1 MP.

FLUX.3 names its references in the prompt as `<ref_image_0>`, `<ref_image_1>` and so on, for example
`The fox from <ref_image_0> sitting next to the fox from <ref_image_1>`. Each reference card shows its tag; click
the tag to copy it. Only enabled cards with an image are numbered, so turning a card off renumbers the cards below
it.

In the workflow editor, wrap each image in a **Kontext Conditioning - FLUX** node and connect them, or a collection
of them, to the **Reference Images** input of **Denoise - FLUX.3**.

On Nvidia GPUs reference images are encoded whole, as in the reference pipelines, unless the card is too small for a
large reference (a 4 MP reference needs about 8.5 GB to encode whole, so cards below 24 GB tile it). On AMD GPUs and
Apple Silicon, where the encoder's attention would need memory that grows with the square of the image size, they
are always encoded in 512 px tiles. Tiling keeps memory bounded but changes the edit slightly.

## Canvas

Image-to-image, inpainting and outpainting work on the Canvas as they do for FLUX.2. Regional guidance and layout
boxes are not supported yet. Using the canvas itself as a reference image is a manual step: create a reference image
from the bounding box.

## Layout and box edits in the prompt

FLUX.3 also reads object boxes and box edits written as JSON at the end of the prompt. InvokeAI passes the prompt
through unchanged, so a prompt written in the format from the model card works, but there is no editor for it
yet.

## PiD super-resolution decode

FLUX.3 latents are FLUX.2 latents, so the FLUX.2 PiD decoders decode them. See
[PiD Super-Resolution Decode](/users-guide/image-generation/advanced-topics/pid-decode/).

## Workflow nodes

| Node | Purpose |
| --- | --- |
| **Main Model - FLUX.3** | Loads the transformer, encoder and VAE |
| **Prompt - FLUX.3** | Encodes the prompt |
| **Denoise - FLUX.3** | Runs the diffusion; takes the VAE, optional reference images and, for Klein Base, CFG and a negative prompt |
| **Latents to Image - FLUX2** / **Image to Latents - FLUX2** | VAE decode / encode |

**Denoise - FLUX.3** has no scheduler input: Klein steps its own flow map and Klein Base samples with Euler, as in
the reference implementation.
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Ideogram 4
description: Generate images with the Ideogram 4 text-to-image models.
lastUpdated: 2026-10-08
sidebar:
order: 6
order: 7
---
## Ideogram 4

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Krea-2
description: Generate images with the Krea-2 text-to-image models (Turbo and Raw), including the GGUF / single-file workflow, the conditioning enhancers and training-free style reference.
lastUpdated: 2026-10-16
sidebar:
order: 7
order: 8
---

Krea-2 is a ~12B single-stream diffusion-transformer text-to-image family. InvokeAI supports both
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Qwen-Image-2.1
description: Generate images with Qwen-Image-2.1 and its 8-step Turbo variant, from the Diffusers folders or a GGUF transformer, including transparent (RGBA) output.
lastUpdated: 2026-10-17
sidebar:
order: 8
order: 9
---
## Qwen-Image-2.1

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Qwen Image
description: Generate and edit images with the Qwen Image 2512 text-to-image model and the Qwen Image Edit 2511 reference-image editing model, including GGUF installs, the Lightning LoRAs and the Fun-ControlNet-Union.
lastUpdated: 2026-10-18
sidebar:
order: 8
order: 9
---

Qwen Image is a diffusion-transformer image family from the Qwen team that encodes prompts with the
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Stable Diffusion 3.5
description: Generate images with Stability AI's Stable Diffusion 3.5 Medium and Large models, including text encoder options and PiD super-resolution decoding.
lastUpdated: 2026-09-30
sidebar:
order: 11
order: 12
---

Stable Diffusion 3.5 is Stability AI's diffusion-transformer text-to-image family. It encodes prompts
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: SDXL
description: Generate images with Stable Diffusion XL models, including the fp16-fix VAE, ControlNet, T2I-Adapter, IP-Adapter reference images, PiD decoding and the SDXL Refiner.
lastUpdated: 2026-09-30
sidebar:
order: 9
order: 10
---

Stable Diffusion XL (SDXL) is a latent-diffusion UNet model trained at **1024×1024**, with two CLIP
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Stable Diffusion 1.5 / 2.x
description: Generate images with Stable Diffusion 1.5 and legacy SD 2.x models, including inpainting models, ControlNet, T2I-Adapter, IP-Adapter reference images, LoRAs and embeddings.
lastUpdated: 2026-09-30
sidebar:
order: 10
order: 11
---

Stable Diffusion 1.x and 2.x are the original latent-diffusion UNet models. They are small and fast
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ title: Z-Image
description: Generate images with Z-Image Turbo and Z-Image Base, including the GGUF, NVFP4 and SDNQ builds, ControlNets and regional prompting.
lastUpdated: 2026-09-30
sidebar:
order: 12
order: 13
---

Z-Image is a 6B-parameter text-to-image family from Tongyi-MAI that understands both English and Chinese
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ PiD works with these base models:
|---|---|
| FLUX.1 | PiD Decoder FLUX |
| FLUX.2 Klein (4B / 9B) | PiD Decoder FLUX.2 |
| FLUX.3 Klein / Klein Base | **PiD Decoder FLUX.2** (FLUX.3 shares FLUX.2's VAE) |
| Stable Diffusion 3 | PiD Decoder SD3 |
| SDXL | PiD Decoder SDXL |
| Z-Image / Z-Image Turbo | **PiD Decoder FLUX** (Z-Image shares FLUX.1's VAE) |
Expand Down
Loading
Loading