v2.17.0 #2590
mudler
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Ahoj! this new release of LocalAI comes with tons of updates, and enhancements behind the scenes!
🌟 Highlights TLDR;
🤖 Automatic model identification for llama.cpp-based models
Just drop your GGUF files into the model folders, and let LocalAI handle the configurations. YAML files are now reserved for those who love to tinker with advanced setups.
🔊 Talk to your LLM!
Introduced a new page that allows direct interaction with the LLM using audio transcription and TTS capabilities. This feature is so fun - now you can just talk with any LLM with a couple of clicks away.
🍏 Apple single-binary
Experience enhanced support for the Apple ecosystem with a comprehensive single-binary that packs all necessary libraries, ensuring LocalAI runs smoothly on MacOS and ARM64 architectures.
ARM64
Expanded our support for ARM64 with new Docker images and single binary options, ensuring better compatibility and performance on ARM-based systems.
Note: currently we support only arm core images, for instance:
localai/localai:master-ffmpeg-core,localai/localai:latest-ffmpeg-core,localai/localai:v2.17.0-ffmpeg-core.🐞 Bug Fixes and small enhancements
We’ve ironed out several issues, including image endpoint response types and other minor problems, boosting the stability and reliability of our applications. It is now also possible to enable CSRF when starting LocalAI, thanks to @dave-gray101.
🌐 Models and Galleries
Enhanced the model gallery with new additions like Mirai Nova, Mahou, and several updates to existing models ensuring better performance and accuracy.
Now you can check new models also in https://models.localai.io, without running LocalAI!
Installation and Setup
A new install.sh script is now available for quick and hassle-free installations, streamlining the setup process for new users.
Installation can be configured with Environment variables, for example:
List of the Environment Variables:
We are looking into improving the installer, and as this is a first iteration any feedback is welcome! Open up an issue if something doesn't work for you!
Enhancements to mixed grammar support
Mixed grammar support continues receiving improvements behind the scenes.
🐍 Transformers backend enhancements
trust_remote_code: trueflagShout-out to @fakezeta for these enhancements!
Install models with the CLI
Now the CLI can install models directly from the gallery. For instance:
This command ensures the model is installed in the model folder at startup.
🐧 Linux single binary now supports rocm, nvidia, and intel
Single binaries for Linux now contain Intel, AMD GPU, and NVIDIA support. Note that you need to install the dependencies separately in the system to leverage these features. In upcoming releases, this requirement will be handled by the installer script.
📣 Let's Make Some Noise!
A gigantic THANK YOU to everyone who’s contributed—your feedback, bug squashing, and feature suggestions are what make LocalAI shine. To all our heroes out there supporting other users and sharing their expertise, you’re the real MVPs!
Remember, LocalAI thrives on community support—not big corporate bucks. If you love what we're building, show some love! A shoutout on social (@LocalAI_OSS and @mudler_it on twitter/X), joining our sponsors, or simply starring us on GitHub makes all the difference.
Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy
Thanks a ton, and.. enjoy this release!
What's Changed
Bug fixes 🐛
pkg/downloadershould respect basePath forfile://urls by @dave-gray101 in fix:pkg/downloadershould respect basePath forfile://urls #2481Exciting New Features 🎉
response_typein the OpenAI API request by @prajwalnayak7 in feat(image): supportresponse_typein the OpenAI API request #2347response_regexto be a list by @mudler in feat(functions): allowresponse_regexto be a list #2447OpaqueErrorsto hide error information by @dave-gray101 in feat:OpaqueErrorsto hide error information #2486local-ai models installto install from galleries by @mudler in feat(gallery): show available models in website, allowlocal-ai models installto install from galleries #2555🧠 Models
📖 Documentation and examples
👒 Dependencies
Other Changes
-j4forbuild-linux:by @dave-gray101 in experiment:-j4forbuild-linux:#2514New Contributors
response_typein the OpenAI API request #2347Full Changelog: v2.16.0...v2.17.0
This discussion was created from the release v2.17.0.
Beta Was this translation helpful? Give feedback.
All reactions