Skip to content

1.0.12 - Fixes and some Lora love
Compare
Choose a tag to compare
@ArrowM ArrowM released this 06 Mar 18:47
· 487 commits to main since this release
1.0.12
5f7d9b8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Mar 06, 2023 Patch Notes

  • 🙆‍♀️ Simplifying LoRA | newly created .safetensors files can now be used like normal LoRA files. Hooray! See the Details section at the bottom for more info.

  • 🐛 Bug fixes

  • 🗣️ Discord | https://discord.gg/q8dtpfRD5w no actual changes here, just mentioning it to make it easier to find

Feb 28, 2023 Patch Notes

  • 🌱 Seeding | repeat training should produce exact^ model outputs (^similar, if using xformers and/or 8bit adam).

  • 🦁 New optimizer | to use, set Optimizer to Lion on the Settings tab. recommended to reduce LR to 1/10 of Adam's LRs with Lion.

  • 🔊 Offset noise | recommended value: 0.05-0.1, may improve high/low lighting output pictures.

  • 📈 Improved graphs

  • ⏱️ DEIS Scheduler | new and improved schedule. To use for class pic generation uncheck Generate Classification Images Using txt2img on the Settings tab. To use as training scheduler, check Use DEIS for noise scheduler on the Testing tab

  • 🙆‍♀️ New LoRA features | added LoRA Dropout & Conv2d support and custom scaling of ranks for high quality. See cloneofsimo/lora#133 for more info.

  • 🥼 Quality of Life improvements | Add version check notifications to the UI, along with changelogs.

  • 🔦 Removed Flash Attention | In preparation for the release of torch 2, Flash attention has been removed as it's no longer supported by diffusers. When Torch2 is officially released, xformers will be removed as well, as it is supported natively in Torch2!

  • 🐛 Bug fixes

Details

Using LoRA models in A1111 web UI
With the new release, the dreambooth extension can now generate LoRA safetensors files that are compatible with the built in extra networks feature in the web UI. This will be enabled by default for new LoRA models and can be changed in the “Saving” tab with the “Generate LoRA weights for extra networks.”

If you previously used LoRA from dreambooth, the following steps are recommended with the update:

  • move or remove the old .pt models from stable-diffusion-webui\models\LoRA directory. For example, rename that directory LoRA.bak
  • new trainings will create the .pt and _txt.pt files under stable-diffusion-webui\models\dreambooth\{model_name}\LoRAs. If you need to create a checkpoint from a previous run, you will need to copy the appropriate .pt files into this directory.

Within the webui, you should now automatically see the generated LoRA files in the native extra networks feature, or you can directly add it to your prompts using the <LoRA:modelname_steps:1> syntax.

Supporting extended LoRA
The native extra networks in a1111 does not support extended LoRA. However, installing the locon extension: https://github.com/KohakuBlueleaf/a1111-sd-webui-locon will add extended LoRA support (this may get native support in the future).

Other news

This extension updates the GitPython dependency to a newer version that patches a security issue. This may break updating extensions until a code fix is approved by A1111 for the base project. See AUTOMATIC1111/stable-diffusion-webui#8118 for more details.

Upcoming changes

  • Improving the documentation / wiki
  • Cleaning up some of the UI
Assets 2
Loading