Releases: Acly/krita-ai-diffusion
Version 1.18.1
Download krita_ai_diffusion-1.18.1.zip
Region UI tweaks
Button to toggle focused inpaint mode for the active Layer/Region
This toggle is only available when using regions. It has two effects:
- Generation will only use the text prompt and control layers of the currently active region.
- The active layer's alpha/transparency is used as mask. (But a selection will override this.)
Live mode: Button to apply result in a new Layer
Without regions, this is a simple way to apply a Live result as a new layer instead of replacing contents, same as previous versions.
With regions, the new button will apply the result to the active layer only. This is in contrast to the regular apply, which usually changes things in a small area around the active layer, and "splats" results to all affected regions. If you want the splatting, but as new layers, simply put your region layers in a group.
Other Changes
- Fixed upscale tile layout computation for non-square aspect ratios #791
- Fixed control layers for regions not showing up in Live mode #788
- Fixed (non-region) control layers not being stored/loaded from .kra files #788
- Increased strength threshold where an Inpaint model is used for refinement to 80% (was 50%)
- Changed region tracking in Live mode to be more similar to how it works in Generation workspace
- Disabled auto-hide of control layers in Live mode
- Fixed mask layers (Filter Mask, Transform Mask, Colorize Mask) causing errors #788
- Fixed LoRA folder filter not working in mixed Windows/Linux setup #793
- Improved Undo behavior when applying results by replacing content (can now be undone, but requires 2 actions)
- Fixed active layer changing to a different region when applying results to more than one region
- Workaround for error due to document without active layer #805
- Trim generated layer names for exessively long prompts #804
Version 1.18.0
Download krita_ai_diffusion-1.18.0.zip
Regions
This release allows you collect text prompts, reference images and control layers in Regions, which are linked to paint layers or groups.
- Restrict prompts to areas which are indicated by layer's content (alpha mask)
- Seperate subjects in your image without their descriptions getting mixed up
- Use regions you define as masks for inpaint
- Jump between subjects in your image without having to adjust text prompts each time
- Selections will automatically find the regions they cover when using Fill or Refine
- Live painting focuses on the region which is linked to the active layer
- Keep parts of the image you're not working on fixed
- Work with higher canvas resolutions than before
- Tiled upscale now effectively works with prompts by selecting matching regions for each tile
- Control layers and reference images work with regions!
- Manage complexity with region hierarchies (nested groups)
Thanks to @Danamir for getting this started!
Please watch the video to get started and let us know how it goes. Further tutorial and documentation coming when time permits.
Important
If you are using a custom ComfyUI installation, make sure to update. Latest version of comfyui-tooling-nodes are required.
Changes
- ⚠ Applying results in Live mode now replaces active layer content by default
- Adding a layer per region becomes messy really fast
- Create a group for your layer if you want "non-destructive" apply
- Maybe this will be an option in the future
- Canvas now resizes right away when upscale is triggered (required for correct behavior in some cases)
- Renamed "Blur" control layer to "Unblur" (it takes blurry input and tries to sharpen/add detail)
- Added download option for SDXL version of Unblur control layer
- Added option to select if Unblur is used for tiled upscale (with two strength presets)
- Added seed to generated layer name #727
Cloud
- Full support for regions
- Purchase options also available now for those interested
Contributors
Assets 3
Version 1.17.2
Download krita_ai_diffusion-1.17.2.zip
Changes
- Use Lanczos for scaling images instead of bilinear filtering. This improves image sharpness #679
- Increased the range for alpha blending to get slightly smoother transitions when working with selections
- Minimum step count is now configurable for sampler presets #662 #697 #483
- Default is 4 (unchanged)
- Read here for an explanation how total steps, strength and minimum steps are related
- Tweaked performance presets for high-end GPUs to a more realistic range
- Fixed LoRA auto-completion not triggering at the beginning of a new line #700
- Fixed custom context from selection mask for fill and refine region #669
- Fixed PNG fallback for remote image buffers on Linux systems without WEBP support #702
- Fixed plugin not loading when there is an issue with settings.json file #665
Cloud
- Tweaked token cost to better match computation time
- Show token cost when hovering over Generate button
- Enabled performance settings (batch size, maximum resolution, etc.)
Version 1.17.1
Download krita_ai_diffusion-1.17.1.zip
Sampler preset changes
There was quite a bit of confusion about the changes to samplers in the last release, and a few bugs too. This release will hopefully improve the situation!
The preset name now contains both:
- a descriptive part (default, fast, realtime, ...) which indicates what it might be good for and how it differs from other choices, especially for users who are not familiar with Stable Diffusion
- the technical implementation name of the sampler (Euler A, DPM++ 2M, DPM++ SDE, ...) which you may see mentioned when downloading custom checkpoints
There are two new entries:
- Alternative - Euler Ancestral with normal scheduler and step count
- Lightning Merge - Euler Ancestral with uniform scheduler and low CFG/steps
Related changes:
- "Special" Lora (LCM, Lightning, FaceID) are no longer filtered out, but a warning will be displayed if they are added manually #640
- These are added automatically when needed, eg. when choosing a sampler or control layer that requires them
- Improved error messages for samplers which require a Lora
- Don't auto-convert previous sampler settings to a preset that requires a Lora
- Fixed sampler preset choice not being persisted in some cases #649
- Custom preset link will now open the folder if the preset file cannot be opened
- Added link to format documentation in the custom preset JSON
Please check out the documentation on the Wiki for more information about Samplers and how to customize them!
Other changes
Version 1.17.0
Download krita_ai_diffusion-1.17.0.zip
Style Transfer
There are two new Control layer modes: Style and Composition.
They work similar to the "Reference" mode: the selected image acts as a sort of inspiration, and doesn't have to match resolution or aspect ratio of your canvas. The difference is that Style will extract mostly art style and colors, while Composition focuses on the structural layout.
| Composition | Style | Result |
|---|---|---|
 |
 |
 |
 |
 |
 |
Works best with SDXL. Probably need a different approach for SD1.5.
Important
If you are using a custom ComfyUI installation, make sure to update. Latest version of ComfyUI_IPAdapter_plus is required.
LoRA Search and Auto-Completion
Redesigned the LoRA selection into a searchable drop-down.
There is also an option to filter via folders (applies to all added LoRA).
And adding LoRA in the text prompt will auto-complete now.
Control Presets
This release adds Presets for some Control layer and Sampler settings. The idea is to have a lean, easy to use UI where users can switch between a few recommended configuration options. Presets can be customized for those who want full control (but it may require editing a text file).
Control layer strength is now adjusted with a single slider, from low influence to very strong effect. This will influence the weight as well as the start and end of the interval in which ControlNet or IP-Adapter are applied.
If you want you can also modify those individually. The presets are stored in presets/control.json, it is recommended to copy it to the user data folder before editing.
Sampler Presets
Samplers can now be fully configured by choosing from a few pre-defined options.
As before, the number of steps and guidance strength can be tweaked in the UI. New: you can edit the presets or add your own, and choose from any sampler / scheduler which ComfyUI supports.
Other Changes
- Added option to enable Self-Attention Guidance (advanced checkpoint settings) (by @FeepingCreature)
- This may improve image quality at the cost of some performance
- Fixed LoRA in the text prompt not being stored to history #586
- Fixed error when restoring settings to default values
- Fixed crash when toggling Live Record without generating an image #579
- Fixed error when result images matched the thumbnail size #605
- Correctly update the selected style when the filter changes #564
- Removed [Live] prefix from generated layer name and added the seed value #613
- Use PNG as the format for saving result images from the history #582 #627
- Allow multi-selection when saving images from result history #626
- Added fallback for WEBP images on Linux without the required Qt5 package #582
- Improve robustness of rename during installation on Windows #515
- Make errors during process job attach non-fatal on Windows #616
- Improved folder selection for server installation #620
Contributors
Assets 3
Version 1.16.1
Download krita_ai_diffusion-1.16.1.zip
Bugfixes
- Fixed change of connection URL in the UI not having any effect #533
- Fixed inpaint mode chosen at 100% strength affecting masks even in refine mode (0-99% strength) #535
- Stop live mode polling after the document is closed (previously lead to errors and inconsistent state after opening a new document) #538
- Fixed LoRA not working when added in the text prompt #540
- Fixed selection not working properly in live mode #539
- Re-enabled IP-Adapter with DirectML backend (seems to be working again) #552
- Improved error reporting for missing checkpoints and other models #553 #550 #541 #537
Cloud
- Added SDXL
- Fixed "Remove object" not working
Version 1.16.0
Download krita_ai_diffusion-1.16.0.zip
Important
This release includes an upgrade for ComfyUI and introduces new models.
- If you are using the managed server, the installer will do an upgrade.
- If you are using a custom ComfyUI installation, please update to latest versions!
Per-pixel Strength Masks
This release slightly changes how selections masks are interpreted.
Previously they would be either 1 (selected) or 0 (not selected), with smooth transitions at the edges for blending.
Now you can create masks with any values in between to customize how much the image changes per pixel.
| Original | Mask | Result |
|---|---|---|
 |
 |
 |
"spooky dense forest"
For example, if you paint a selection mask 50% white in a certain region, and set strength to 80%, the actual strength in that region will be half of 80% = 40%. This is also known as "Differential Diffusion" or "Soft Inpainting". You can allow more drastic changes in some regions and only small adjustments in others - with smooth transitions - in one generation.
| Original | Mask | Result |
|---|---|---|
 |
 |
 |
"toxic waste, acid lake"
Hint: enable global selection masks in Krita to easily edit selection masks.
Streamlined Cloud GPU
I've been working on a streamlined online service for those who don't want to install or lack the hardware. It is not complete, but can be tested already. Please look for more information and leave your feedback in this discussion!
Note: Local offline will always be the option with the greatest flexibility. But it's not available to everyone, and sometimes convenient can be nice?
Sponsors
This project is happily eating all of my time, and it feels like it is only getting hungrier! 😵
So I've had to think about sustainability. Cloud GPU is part of that, but it's an experiment and won't appeal to everyone. If you like the project, please consider donating via GitHub ♥. Much appreciated!
Other Changes
- Live mode: check for changes on client side and only send a request to ComfyUI when there are actual changes #414 #509 #512
- Use depth-anything to generate depth images for depth control layers
- Use more recent DWPose models to estimate pose for pose control layers
- Added EasyNegative as negative embedding (not required, but installed by default if SD1.5 is selected for managed installs)
- Added Flat2D-Animerge checkpoint to installer as optional download
- Support SDXL Tile ControlNet as Blur control layer and when upscaling #473
- This is an optional model for now, it will be used if installed
- Changed sampling to use a minimum of 4 steps even at low strength (related: #483)
- Was 6 before for LCM, no minimum for other samplers
- Will never inrease step count beyond what is configured as total steps
- Tiled upscaling now uses same step scaling as other modes
- Added option to filter out built-in styles
- Added link to the folder where settings are stored in the UI
- Added custom hotkey to toggle previews #426
- While the preview browser has focus, press space bar to toggle
- You can also assign a custom hotkey in Krita's hotkey settings which will work without focus (not set by default)
- Scroll to bottom of history when switching canvas or opening documents
- Updated to latest IP-Adapter "V2" nodes #524 #531
- Fixed LoRA path splitting when server runs on Windows and client on Linux/Mac #477
- Removed
--force-fp16as default option for MPS (macOS only) #474 - The download_models.py script can now pre-fetch control pre-processor models
Version 1.15.0
Download krita_ai_diffusion-1.15.0.zip
Discard Images from History
For those images we'd prefer to have never happened. You can multi-select with Ctrl/Shift!
New location for User Data
User files such as settings, custom styles and logs are no longer inside the plugin installation directory. This has some advantages:
- Easier to do a clean update/reinstall of the plugin without losing your settings
- Allows system-wide plugin installation with per-user settings
The settings are now located in a subfolder of Krita's user data. Typical paths:
- Windows:
C:\User\<your-name>\AppData\Roaming\krita\ai_diffusion - Linux:
~/.local/share/krita/ai_diffusion - MacOS:
~/Library/Application Support/krita/ai_diffusion
Depending on your system the location may be different. You can find it via the "View Logs" link in the settings.
Experimental Features
Lightning
SDXL Lightning is a way to speed up generation of images with SDXL, similar to LCM and Turbo. Instructions and Discussion
Animation Workspace
This version contains a first draf for working with animations. Currently it's just a UI for batch processing, but may become a place to integrate animation checkpoints in the future. Overview and Discussion
Other Changes
Version 1.14.1
Download krita_ai_diffusion-1.14.1.zip
Changes
- Improved speed at which preview results are displayed when working with complex documents #391
- Replaced latent upscale during 2-pass generation (was only used for small factors, now uses image upscaling) #407
- Fixed server process not being terminated when Krita is closed in some cases (eg. crash) #196 #360 #390
- Fixed backup folders being copied instead of moved during server upgrade
- Fixed some spin boxes not working properly (eg. line count settings) #393
- Fixed inconsistencies in server UI, it should now report state (started, stopped, connected...) correctly
- Hotkey to start generation now also works for Live mode #414
- Set initial default grow/feather to 5% for new installs
Version 1.14.0
Download krita_ai_diffusion-1.14.0.zip
Important
This release includes an upgrade for ComfyUI and introduces new models.
- If you are using the managed server, the installer will do an upgrade.
- If you are using a custom ComfyUI installation, find the new requirements at the bottom.
Selection Fill & Expand for Stable Diffusion XL
While SD XL has been supported for a long time, its capabilities to seamlessly fill selections were very limited. SD 1.5 almost always had superior results. This release adds the inpaint model developed by Fooocus to dramatically improve results. All SD XL checkpoints, including custom downloads, automatically profit from the change.
The new model will be downloaded as part of the "Stable Diffusion XL" workload, make sure to select it in the installer if you want to make use of it!
New Inpaint Modes
This release introduces more nuanced actions for filling and expanding areas of the image.
This nudges generation into a certain direction depending on what you want to do. Works especially well for SD XL, but also improves consitency for SD 1.5. Some examples are below, you can read the full documentation here.
| Selection | Result | |
|---|---|---|
| Fill |  |
 |
| Expand |  |
 |
| Add Content |  |
 |
| Remove Content |  |
 |
| Replace Background |  |
 |
Discussions and Wiki
Feel free to ask questions, discuss ideas, and share workflows, in the Discussions.
Documentation can now be found in the Wiki. It's a work in progress, contributions are appreciated! (I believe not everybody can edit yet, make a post if you have some content.)
Other Changes
- Added option to enqueue new generations in front so they will run first #380 (by @daniel-richter)
- Fixed crash after using flatten image on a preview layer #381
- Fixed error when using HAT upscale models at certain resolutions #378
- Fixed LoRA not being applied when in a subfolder and connecting to Linux server from Windows #307 #375
- Fixed control layer generate button being visible for "Blur" mode (it does not need generation) #369
- Linux: Prioritize Python 3.11/3.10 over other installed versions (not all dependencies support 3.12 yet) #374
- Load checkpoint first in upscale workflow to enable caching #377
- Fixed error during installation because of encoding issues #370
- Added file extensions to document annotations (makes extracting them from .kra files easier)
New requirements for custom ComfyUI
- New custom node: comfyui-inpaint-nodes
- Required model: MAT_Places512_G_fp16 to
models/inpaint(create folder if needed) - Required models (SDXL only): Fooocus Inpaint (Head) and Fooocus Inpaint (Patch) to
models/inpaint
As usual you can use the download script to fetch models, and the full list is here.
