Earngenix Logo
Skip to main content

Tutorial · Beginner · Updated August 2026

Install Ostris AI Toolkit for LoRA Training: 3 Steps (2026)

The current official method — the built-in Manager, no manual PyTorch setup, tested and up to date.

Free

Cost

3

Steps

8 GB

Min VRAM

Beginner

Skill level

By Earngenix Team · · Tested on Windows with an RTX 4090

⚡ Quick Answer

The fastest way to install Ostris AI Toolkit is its built-in Manager: clone the repository, run one script for your operating system (run_windows.bat, run_linux.sh, or run_mac.zsh), and it installs Python, PyTorch, Node.js, and FFmpeg for you automatically. When it finishes, it opens a Web UI at http://localhost:8675. You need git installed and an NVIDIA GPU — 8GB VRAM minimum, 24GB+ recommended for training FLUX LoRAs.

Ostris AI Toolkit is a free, open-source training suite for fine-tuning diffusion models with LoRA — a technique that teaches an AI image or video model a specific character, style, or product without retraining the entire model. This guide covers how to install AI Toolkit for LoRA trainingusing its official Manager, the method the project itself now recommends, plus the manual fallback if the Manager doesn't run on your setup. You'll have it installed and its Web UI open in under 20 minutes.

What You Need Before You Start

AI Toolkit's Manager installs almost everything for you, but a few things need to already be on your computer first.

  • Git — the tool GitHub uses to download ("clone") a project's code to your computer. Download it free from git-scm.com if you don't already have it.
  • An NVIDIA GPU with at least 8GB of VRAM (the memory built into your graphics card, separate from your system RAM) for basic LoRA training — 24GB or more if you plan to train LoRAs for FLUX-based models.
  • Around 20–30GB of free disk space for the toolkit itself, plus more per model you download later.
  • Windows, Linux, or macOS on Apple Silicon (macOS support is still experimental — see the warning in Step 2).
Operating SystemGPU MinimumNotes
WindowsRTX 3060 (12GB) or betterFull Manager support
LinuxRTX 3060 (12GB) or betterMost tested platform
macOS (Apple Silicon)M-series chipExperimental — manual install may be needed

Step 1: Clone the AI Toolkit Repository

Cloningdownloads a full copy of AI Toolkit's code from GitHub onto your computer. This is the starting point no matter which install method you use next.

  1. Open a terminal — Command Prompt or PowerShell on Windows, Terminal on Linux or macOS.
  2. Type the following command and press Enter:
    git clone https://github.com/ostris/ai-toolkit.git
    You'll see lines of text scroll by as Git downloads every file in the repository. This takes anywhere from a few seconds to a couple of minutes depending on your connection.
  3. Move into the new folder:
    cd ai-toolkit
    Your terminal prompt changes to show you're now inside the ai-toolkit folder.
Terminal showing git clone finishing and the new ai-toolkit folder open in File Explorer🔍 Click to zoom
What you should see after the clone finishes — the terminal returns to a normal prompt and a new ai-toolkit folder appears.

Step 2: Run the AI Toolkit Manager

The Manager is a built-in script that replaces the old manual pip and PyTorch install entirely. It detects your hardware, then installs the matching PyTorch build, a local Python environment, Node.js, and FFmpeg — all kept inside the ai-toolkit folder, nothing installed system-wide.

Windows

  1. Open the ai-toolkit folder you just cloned in File Explorer.
  2. Double-click run_windows.bat. Or, from the same terminal you used in Step 1, type:
    run_windows.bat
  3. A terminal window opens and the Manager starts detecting your hardware — GPU model, VRAM, OS version — then downloads and configures everything. This is the slowest part of the whole install: expect 5 to 15 minutes depending on your connection.

Linux

  1. In your terminal, inside the ai-toolkit folder, type:
    chmod +x run_linux.sh
    This gives the script permission to run as a program — Linux blocks this by default for downloaded files.
  2. Then run it:
    ./run_linux.sh
    Setup runs the same way as described above for Windows.

macOS (Apple Silicon, experimental)

chmod +x run_mac.zsh
./run_mac.zsh
Warning: Apple Silicon support is still experimental. If you hit errors here, the manual install method further down this page is more likely to work.
Tip: On a headless server with no desktop (SSH only), skip the platform scripts and run the Manager directly: python3 -m manager install to set up, and python3 -m manager launch to start the UI later. python3 -m manager doctor diagnoses install problems at any time.
Terminal mid-install showing the AI Toolkit Manager detecting GPU and installing dependencies🔍 Click to zoom
The Manager mid-install — hardware detection runs first, then PyTorch, Node.js, and FFmpeg download automatically.

Step 3: Open and Verify the Web UI

This last step confirms the install actually worked before you move on to training anything.

  1. Once the Manager finishes, open your browser and go to:
    http://localhost:8675
  2. The AI Toolkit interface loads, with an empty Jobs panel and navigation for Datasets, Jobs, and Settings. If the page loads, your installation is working.
  3. Leave the terminal window open — closing it shuts down the Web UI, though it isn't needed once a training job is already running.
Tip: Run python3 -m manager doctor from inside the ai-toolkit folder any time you want the Manager to check your install for problems.
AI Toolkit Web UI homepage on first successful load at localhost:8675🔍 Click to zoom
What a successful install looks like — the Web UI homepage with an empty Jobs panel.

What If You'd Rather Install Manually?

The Manager above is the recommended path, but the manual method still works if you want full control over each package, or the Manager doesn't run on your setup.

This method uses a Python venv— a self-contained Python environment that keeps AI Toolkit's packages separate from anything else installed on your computer, so nothing conflicts with other projects.

python3 -m venv venv
source venv/bin/activate  # Windows: .\venv\Scripts\activate

pip3 install --no-cache-dir torch==2.13.0 torchvision==0.28.0 torchaudio==2.11.0 --index-url https://download.pytorch.org/whl/cu130
pip3 install -r requirements.txt

The requirements.txt file lists every remaining package AI Toolkit needs — pip installs all of them in one pass.

Warning: Windows manual installs are the least-tested path. The project's own documentation points Windows users who hit problems here toward a separate community installer rather than debugging the manual method by hand — the Manager in Step 2 avoids this entirely.

How Much VRAM Do You Actually Need?

VRAM needs vary a lot depending on which model you're training a LoRA for — there isn't one blanket number that applies to everything.

ModelMinimum VRAMExample Config File
SD 1.5 / SDXL8GB
FLUX.1-dev24GBtrain_lora_flux_24gb.yaml
FLUX.1-schnell24GBtrain_lora_flux_schnell_24gb.yaml
Z-Image Turbo6–8GB (community-reported)

AI Toolkit ships ready-made config files for common setups inside config/examples/. Copy the one matching your model into the configfolder, rename it, and edit the values following the comments already inside it — you don't need to build a config from scratch.

For a full VRAM breakdown across image and video models beyond just AI Toolkit, see the VRAM and hardware guide for AI video and image generation.

Troubleshooting

"'git' is not recognized as an internal or external command"

What causes it: Git isn't installed, or your terminal was already open before you installed it.

How to fix it: Install Git for Windows from git-scm.com, then close and reopen your terminal before trying the clone command again.

Manager update skipped with a warning

What causes it: This is intentional, not a bug — the Manager never overwrites files you've modified yourself. If you've edited config files inside ai-toolkit, running an update skips those files and warns you instead of silently replacing your changes.

How to fix it: If you actually want the fresh version, back up your edited files first, then let the update run or re-clone the repository.

Web UI won't load at localhost:8675

What causes it: Either the Manager is still installing dependencies in the background, or something else on your computer is already using port 8675 (the address your browser needs to reach the Web UI).

How to fix it: Wait until the terminal shows the Manager has finished, then refresh the page. If it still won't load, run python3 -m manager doctor from the ai-toolkit folder to check for problems.

For errors that come from ComfyUI itself rather than AI Toolkit, see the common ComfyUI errors and fixes guide.

Frequently Asked Questions

No. Microsoft’s AI Toolkit is a VS Code extension for working with small language models. Ostris AI Toolkit, covered in this guide, is a separate open-source project for training LoRA models on image and video diffusion models. They share a name but nothing else.

Yes. It’s released under the MIT license, free to use including commercially. Optional paid options like Ostris Cloud or RunPod GPU rentals exist if you don’t have a capable GPU, but neither is required to use the toolkit itself.

No. AI Toolkit is a separate tool that trains LoRA files. ComfyUI is where you load and use those LoRA files afterward to generate images or videos, so you can install AI Toolkit on its own and set up ComfyUI later.

No, training requires an NVIDIA GPU. If you don’t have one, cloud GPU rental services like RunPod let you rent one by the hour instead of buying hardware.

The clone and Manager setup together usually take 10 to 20 minutes, most of it spent downloading PyTorch and its dependencies. A slower internet connection will take longer.

With the Manager, none — it installs the right Python version for you inside the ai-toolkit folder automatically. For the manual install method, use Python 3.10 or newer, with 3.12 recommended.

What to Do Next

Your next step isn't training yet — it's building the image dataset AI Toolkit will train on.

Where to actually get your training images, and the quality checklist to run before you start a job.

Published: 2026-08-17 · Last updated: 2026-08-17

Discussion

Join the discussion

Sign in to leave a comment or reply

💬

No comments yet

Be the first to share your thoughts!