Earngenix Logo
Skip to main content

ComfyUI Workflows · Image Generation · All Levels

Ideogram 4.0 in ComfyUI: Complete Install and Setup Guide (2026)

The best open-weight image model for text rendering and poster design — running locally in ComfyUI. Here's the exact setup, model by model, folder by folder.

9.3B

Parameters

16 GB

Min VRAM

RTX 4090

Tested on

June 2026

Released

By Earngenix Team · · Tested on RTX 4090 (24 GB VRAM)

⚡ Quick Answer

To run Ideogram 4.0 in ComfyUI, download 5 model files from HuggingFace — two diffusion models, two text encoders, and one VAE — and place each file in its specific subfolder inside ComfyUI/models/. Then load the workflow JSON and click Queue Prompt. Unlike FLUX or Stable Diffusion, Ideogram 4.0 uses structured JSON prompts — not plain text — which is what sets it apart and where most of the quality comes from. Minimum 16 GB VRAM required for the FP8 models.

What to Expect from Ideogram 4.0

Before you spend time on setup, here are four real examples generated with the workflow you're about to install. Each one uses a structured JSON prompt — the format this model was trained on. Click View Prompt on any card to see the exact prompt, and hit Copy Prompt to grab it and try it yourself once the workflow is running.

Disney-inspired fantasy adventure poster featuring a young explorer on a floating suitcase beneath giant DREAMBOUND cloud typography🔍 Click to zoomFantasy Movie Poster

Whimsical adventure movie poster combining storybook fantasy, mixed-media collage design, and large-scale cinematic typography.

Luxury fashion portrait of a young woman holding a red rose beside a waterfall surrounded by lush greenery🔍 Click to zoomFashion Editorial Portrait

High-end fashion and travel editorial photography with natural beauty, cinematic lighting, and realistic environmental details.

Ultra-realistic action photograph of a young man riding a sport motorcycle through a busy city street with dramatic motion blur surrounding him🔍 Click to zoomAction Photography

Cinematic high-speed motorcycle photography featuring a perfectly sharp rider against dynamic urban motion blur and light trails.

Epic science-fiction movie poster showing a lone hero witnessing two giant planets colliding above an ancient desert civilization🔍 Click to zoomSci-Fi Movie Poster

Hollywood-scale sci-fi poster featuring planetary collision, cosmic energy, monumental architecture, and cinematic worldbuilding.

Why these look different from other models: Ideogram 4.0 uses a structured JSON prompt format that gives you precise control over color palettes (exact hex codes), element placement (bounding boxes), and in-image text rendering. The Ideogram 4.0 Prompt Guide covers the full JSON format with step-by-step examples. Read the install guide first, then go there.

Ideogram 4.0 is the best open-weight image model available right now for text rendering, poster design, and precise layouts. Getting it running in ComfyUI takes about 20 minutes if you follow the steps below exactly. The biggest pitfall: the file structure is different from FLUX and Stable Diffusion, and the prompt format is completely different from every other model you've used. Both are covered here.

What Is Ideogram 4.0 and Why Does It Work Differently?

Ideogram 4.0 is a 9.3B parameter open-weight text-to-image model released by Ideogram AI on June 3, 2026. "Open-weight" means the model files are publicly downloadable — you run them on your own machine, not through a paid service. It was built entirely from scratch, not fine-tuned from any existing model like FLUX or Stable Diffusion.

Two things make it structurally different from every other model you may have used. First, the text encoder. Most image models use CLIP or T5 — text-only encoders with limited language understanding. Ideogram 4.0 uses Qwen3-VL-8B-Instruct (a full vision-language model) plus Gemma4, and extracts hidden states from 13 of Qwen's intermediate layers. This gives the model far deeper understanding of what you're describing — which is why it renders in-image text, precise layouts, and complex compositions better than models three times its size.

Second, the prompt format. Ideogram 4.0 was trained exclusively on structured JSON captions, not plain text. Plain-text prompts still work, but produce noticeably weaker results because the model was never trained on them. The JSON format is covered in detail in the Ideogram 4.0 Prompt Guide.

How Does Ideogram 4.0 Compare to FLUX and Stable Diffusion?

At 9.3B parameters it outperforms FLUX.2 [dev] (32B) and Qwen-Image (20B) on text rendering benchmarks. In a blind evaluation by professional graphic designers, it ranked #2 overall — behind only GPT Image 2 — and #1 among all open-weight models.

FLUX.1-devStable Diffusion XLIdeogram 4.0
Prompt formatPlain textPlain textStructured JSON
Text encoderCLIP + T5CLIPQwen3-VL-8B + Gemma4
Text renderingModeratePoorBest-in-class
Parameters12B~2.6B9.3B
Free weights licenseNon-commercialOpenNon-commercial
Warning: Don't assume you can drop in the same plain-text prompt you'd use for FLUX and get equivalent quality. You'll get an image, but you'll miss most of what Ideogram 4.0 is capable of. The Ideogram 4.0 Prompt Guide covers the JSON format step by step — read it after you've confirmed the workflow runs.

What Is the Ideogram 4.0 License? Can You Use It Commercially?

There are two license tiers. Get this straight before you download anything.

01 — Non-commercial (free)

Download the quantized weights from HuggingFace free under the Ideogram Open Model Agreement. Personal projects, research, learning, and experimentation. Fine-tuning is allowed.

You cannot use these weights inside a commercial product, for client work, or any paid deliverable.

02 — Commercial (contact sales)

Full-precision weights + right to deploy in production — inside a product, through an API, or for client-facing work.

Visit ideogram.ai/licensing to contact sales.

One important distinction: the inference code on GitHub is Apache 2.0 — free for any use including commercial. The restriction is on the model weights, not the code that runs them. Images you generate are yours — Ideogram does not claim ownership of outputs. You can use generated images commercially as long as you're not using the weights themselves in a commercial deployment.

Warning: "Open weights" doesn't mean free for everything. If you're planning to use Ideogram 4.0 in a client project or paid product, read the full license at ideogram.ai/licensing before you ship anything. What is never permitted under any tier: surveillance, biometric ID, military applications, CSAM, non-consensual intimate imagery.

What You Need Before You Start

Hardware & software checklist

  • GPU VRAM (FP8 models): 16 GB minimum — tested on RTX 4090 (24 GB)
  • GPU VRAM (NVFP4 models): 8–12 GB — lower VRAM option, slight quality trade-off
  • System RAM: 32 GB recommended
  • Disk space: ~25–30 GB for all 5 model files
  • ComfyUI version: Latest stable or nightly that supports Ideogram 4.0 nodes

The 5 Model Files You Need

The table below covers the FP8 versions — recommended for 16 GB+ VRAM cards. If you have less than 16 GB, see the NVFP4 note in the section below.

FileSubfolderSizeNoteDownload
ideogram4_fp8_scaled.safetensorsmodels/diffusion_models/~9.3 GBMain diffusion model (FP8)Download
ideogram4_unconditional_fp8_scaled.safetensorsmodels/diffusion_models/~9.3 GBUnconditional model (FP8) — required pairDownload
qwen3vl_8b_fp8_scaled.safetensorsmodels/text_encoders/~8 GBText encoder 1 (Qwen3-VL)Download
gemma4_e4b_it_fp8_scaled.safetensorsmodels/text_encoders/~4 GBText encoder 2 (Gemma4)Download
flux2-vae.safetensorsmodels/vae/~335 MBVAE — converts latent to pixel imageDownload

⚠ Yellow rows = both text encoders are required. Missing either one causes generation to fail.

Tip: If you already ran a FLUX.2 workflow, check your models/vae/ folder — you may already have flux2-vae.safetensors and don't need to download it again.

FP8 vs NVFP4 — Which Should You Download?

The Comfy-Org HuggingFace repo contains two quantization options for the diffusion models. Here's what each one actually is and when to use it:

FP8 ✓ Recommended

Best image quality. Each model file is ~9.3 GB. Use FP8 if you have 16 GB+ VRAM.

RTX 3090, RTX 4080, RTX 4090, RTX 5080, RTX 5090

NVFP4 — Lower VRAM option

Designed for cards with less VRAM. Some quality reduction — use FP8 for the main model and NVFP4 only for the unconditional model for best results on lower-VRAM setups.

RTX 3070 / 3080, RTX 4060 Ti, RTX 4070

Important NVFP4 note: The NF4 files released by Ideogram directly are NOT ComfyUI-compatible. The NVFP4 files in the Comfy-Org HuggingFace repo were created by Kijai specifically for ComfyUI from the FP8 versions — they keep sensitive layers in FP8 to preserve quality. For best results on lower-VRAM cards: use FP8 for the main model and NVFP4 for the unconditional model. Using NVFP4 for both degrades quality noticeably.

Where to Put the Files in ComfyUI

This is where most beginners run into problems. Ideogram 4.0 does not use the models/checkpoints/ folder that FLUX and SD models go into. It uses three separate subfolders. The ComfyUI root folder is the main folder where ComfyUI is installed — it contains main.py, a models/ folder, a custom_nodes/ folder, and others.

folder structure
📂 ComfyUI/
└── 📂 models/
    ├── 📂 vae/
    │   └── flux2-vae.safetensors
    ├── 📂 diffusion_models/
    │   ├── ideogram4_fp8_scaled.safetensors
    │   └── ideogram4_unconditional_fp8_scaled.safetensors
    │   (or _nvfp4_mixed.safetensors variants for lower VRAM)
    └── 📂 text_encoders/
        ├── qwen3vl_8b_fp8_scaled.safetensors
        └── gemma4_e4b_it_fp8_scaled.safetensors
Warning: Do not put the diffusion model files into models/checkpoints/. ComfyUI will not find them there and the model dropdown in the workflow will show empty. This is the single most common setup mistake with Ideogram 4.0.
Tip: If the diffusion_models/ or text_encoders/ folders don't exist yet, create them manually inside ComfyUI/models/. They're standard subfolders ComfyUI recognizes.
File explorer showing the full ComfyUI/models/ folder structure with all 5 files correctly placed
Screenshot: final folder structure with all 5 files in place before launching ComfyUI.

How to Load and Run the Ideogram 4.0 Workflow in ComfyUI

⬇ Download the Workflow

Download the workflow JSON file, drag it onto the ComfyUI canvas, and it loads automatically. No custom nodes required — Ideogram 4.0 is supported natively in an up-to-date ComfyUI.

Download Ideogram 4.0 ComfyUI Workflow (.json)

Step 1 — Update ComfyUI First

Ideogram 4.0 requires a recent version of ComfyUI. If you're running an older version, some of the workflow nodes won't exist and the canvas loads with red errors.

  1. Open ComfyUI Manager — the Manager button in the top menu bar.
  2. Click Update ComfyUI.
  3. Wait for the update to complete, then restart ComfyUI completely — close the terminal window and relaunch it.
ComfyUI Manager window showing the Update ComfyUI button
Screenshot: ComfyUI Manager with the Update ComfyUI button highlighted.

Step 2 — Load the Workflow JSON

  1. Save the downloaded .json file anywhere — your Downloads folder is fine.
  2. In ComfyUI, drag the JSON file directly onto the canvas. Or click the Load button in the top menu and navigate to the file.
  3. The canvas populates with the workflow nodes connected by wires. You'll see a Load Diffusion Model node, a DualCLIPLoader node, a VAELoader node, and a sampler chain leading to an output node.
The loaded Ideogram 4.0 workflow on the ComfyUI canvas with all nodes visible and connected
Screenshot: the full workflow canvas after loading — all nodes connected and ready.

Step 3 — Check the Model Nodes Are Pointing to the Right Files

Before running anything, confirm each model node is pointing to the correct file. ComfyUI reads from the folder you set up in the previous step — if a file is missing or misplaced, the node dropdown shows nothing.

  1. Click the Load Diffusion Model node. The filename dropdown should show ideogram4_fp8_scaled.safetensors. If it shows "None", the file isn't in models/diffusion_models/ — go back and move it.
  2. Click the DualCLIPLoader node. Both text encoder fields should show the Qwen3 and Gemma4 filenames. These two encoders convert your prompt into something the model understands — without them, generation fails or produces noise.
  3. Click the VAELoader node. It should show flux2-vae.safetensors. The VAE (Variational Autoencoder — the component that converts the model's internal latent image into an actual pixel image you can see and save) is required for output.
Warning: If any dropdown shows "None" after you've placed the files, restart ComfyUI. It only scans model folders on startup — moving files while it's running won't be detected until you relaunch.
Load Diffusion Model node with the filename dropdown open and the correct file selected
Screenshot: the Load Diffusion Model node dropdown showing the correct fp8 file selected.

Step 4 — Write Your First Prompt

Find the prompt text box on the canvas — it's connected to the node chain that feeds into the sampler. For your first run, write a short plain-text description:

first test prompt
a red apple on a white marble table, photorealistic, soft natural light

Plain text works fine here — the model will produce a good result. After you've confirmed the workflow runs cleanly, read the Ideogram 4.0 Prompt Guide to learn the JSON format. That's where you'll see a real jump in quality.

Step 5 — Run and What to Expect

Click the orange Queue Prompt button in the top-right corner of the ComfyUI interface. A progress bar appears below it and the active node highlights as each step runs.

⚙ Generation Settings — RTX 4090

The workflow exposes three parameters you can adjust in the sampler node: num_steps, mu, and std. Three presets cover the most common tradeoffs:

Presetnum_stepsmustdGeneration Time (RTX 4090)Best For
QualityBest output
480.01.5150–190 secUse when image quality is the priority and you are not in a hurry. Recommended for final renders.
DefaultBalanced
200.01.75< 100 secGood balance of speed and quality. Ideal for iterating on prompts and compositions.
TurboFastest
120.51.75< 60 secFastest generation. Some quality reduction. Best for quick prompt testing.
ComfyUI sampler node with num_steps, mu, and std fields highlighted — showing Quality preset values
Screenshot: the sampler node parameters — set num_steps, mu, and std here to switch between Quality, Default, and Turbo presets.
Tip: Start with Default (20 steps) while testing your prompts — fast enough to iterate quickly. Once you have a composition you like, switch to Quality (48 steps) for the final render. The Quality preset on an RTX 4090 takes around 2.5–3 minutes but produces noticeably sharper detail and better text rendering.

The first run is always slower regardless of preset — model files load into VRAM for the first time. From the second generation onward, speed improves because the models stay cached in VRAM. The finished image appears in the output preview node on the right side of the canvas.

Completed output image visible in the ComfyUI preview node
Screenshot: a completed image in the output preview node — first successful generation.

Why Does the Prompt Look Like JSON? (The Prompting Difference Explained)

Every other image model you've used accepts plain text: "a woman standing in a forest at sunset." Ideogram 4.0 was trained on something structurally different — structured JSON captions. JSON (JavaScript Object Notation) is a structured text format that uses { } brackets to organize information into named fields. You don't need to know any code to use it — you're filling in a template, not writing a program.

The JSON format gives Ideogram 4.0 three capabilities that plain text can't match: exact hex color palette control (up to 16 colors per image), bounding-box layout for placing subjects at exact coordinates, and typed text elements that let the model know precisely what characters to render and where. Because the model was trained exclusively on captions structured this way, plain-text prompts sample outside the training distribution and leave quality on the table — especially for composition, color, and typography.

✗ Plain text (works, but weaker)

"a lone sailboat on calm water at sunset, warm light, low horizon"

Model guesses at colors, composition, and style.

✓ JSON prompt (full control)

{ "high_level_description": "...", "style_description": { "color_palette": ["#FF6B35","#004E89"] }, "compositional_deconstruction": { "background": "...", "elements": [...] } }

Exact colors, element placement, and per-element styling.

You can also skip writing JSON entirely using Magic Prompt — a free tool built into the reference pipeline that auto-converts a plain-text prompt into a full JSON caption. It runs server-side using a free Ideogram API key with no local model required. The Ideogram 4.0 Prompt Guide covers every JSON field with real before/after examples, and includes a downloadable skill file that converts your normal prompts to proper Ideogram 4.0 JSON automatically.

Troubleshooting Ideogram 4.0 in ComfyUI

"NODE NOT FOUND" or Red Nodes After Loading the Workflow

What it looks like: One or more nodes on the canvas turn red with a "NODE NOT FOUND" label after you load the workflow JSON.

What causes it: ComfyUI is out of date and doesn't yet support the Ideogram 4.0 node types.

How to fix it:

  1. Open ComfyUI Manager from the top menu.
  2. Click Update ComfyUI.
  3. Restart ComfyUI completely.
  4. Reload the workflow JSON.

If nodes are still red after updating, follow the step-by-step guide to fixing missing nodes in ComfyUI.

Model Files Not Appearing in the Node Dropdowns

What it looks like: The Load Diffusion Model, DualCLIPLoader, or VAELoader node dropdowns show "None" or an empty list.

What causes it: Files are in the wrong subfolder (most common: placed in models/checkpoints/ instead of models/diffusion_models/), or the filenames were modified during download.

How to fix it: Check each file is in the exact subfolder shown in the folder structure diagram. Confirm the filenames match exactly. Restart ComfyUI — it only scans model folders on launch.

"Image Blocked by Safety Filter" — Gray Screen Output

What it looks like: Generation completes but instead of an image you see a plain gray screen with the text "Image blocked by safety filter."

What causes it: The safety filter flagged your prompt. The official Ideogram 4.0 documentation confirms false positive rates are higher for plain-text prompts than for structured JSON prompts.

How to fix it: Rewrite the prompt to be more specific and descriptive. Switch from plain text to a JSON-structured prompt — this alone resolves most false positives. The Ideogram 4.0 Prompt Guide shows you how.

CUDA Out of Memory — Generation Fails Mid-Run

What it looks like: ComfyUI shows a red error in the terminal or on the canvas: "CUDA out of memory" or "RuntimeError: CUDA error."

What causes it: The FP8 model files require at least 16 GB VRAM. If your GPU has less, the model can't fully load.

How to fix it:

  1. Close any other applications using your GPU (games, other AI tools).
  2. Add --lowvram or --medvram to your ComfyUI launch command.
  3. If you have less than 16 GB VRAM, switch to the NVFP4 setup — use FP8 for the main model and NVFP4 for the unconditional model to reduce VRAM usage while preserving most of the quality.

Frequently Asked Questions

The model weights are free to download from HuggingFace for personal projects and research under the Ideogram Non-Commercial license. Commercial use — building a product, generating images for client work, or deploying it in any paid context — requires a separate commercial license. Images you generate are yours to use commercially as long as you're not deploying the weights themselves in a commercial product.

The FP8 models require at least 16 GB VRAM. The NVFP4 models are designed for cards with less VRAM. For best results on lower-VRAM setups, use FP8 for the main model and NVFP4 only for the unconditional model — using NVFP4 for both degrades quality more noticeably.

FP8 is higher-precision quantization — better image quality, ~9.3 GB per file, requires 16 GB+ VRAM. NVFP4 is designed for lower-VRAM cards. Note: the NF4 files released directly by Ideogram are NOT ComfyUI-compatible. The NVFP4 files in the Comfy-Org HuggingFace repo were created specifically for ComfyUI by Kijai and keep sensitive layers in FP8 to preserve quality.

No — plain-text prompts work. But the model was trained exclusively on structured JSON captions, so plain text produces noticeably weaker results, especially for composition, text rendering, and color control. The Ideogram 4.0 Prompt Guide covers the JSON format without requiring any coding knowledge, and includes a downloadable skill file that converts plain prompts to JSON automatically.

LoRA support for Ideogram 4.0 has not been officially confirmed as of June 2026. The model is very new. Check the Ideogram 4.0 GitHub repository for updates as the community builds around it.

Two reasons. First, it uses Qwen3-VL-8B-Instruct as its text encoder — a full vision-language model that provides far richer semantic understanding than CLIP or T5. Second, its JSON prompt format includes a dedicated text element type with an exact string field, which tells the model precisely what characters to render and where they go in the composition. Most models have to guess at text content from description alone.

On an RTX 4090 with the Quality preset (48 steps): roughly 150–190 seconds. With the Default preset (20 steps): under 100 seconds. With the Turbo preset (12 steps): under 60 seconds. The first generation after launching ComfyUI is slower regardless of preset because the model loads into VRAM for the first time. Subsequent generations are faster.

What to Do Next

You have Ideogram 4.0 running. Now learn the prompt format.

Plain-text prompts get you results. The JSON format gets you the quality — color palette control with exact hex codes, bounding-box layout, and per-element styling that makes poster and typography work precise rather than approximate.

Published: 2026-06-03 · Last updated: 2026-06-11 · Tested on RTX 4090 (24 GB VRAM) · ComfyUI version: [ADD VERSION]

Discussion

Join the discussion

Sign in to leave a comment or reply

💬

No comments yet

Be the first to share your thoughts!