Icon of LocalAI app on Umbrel App Store

LocalAI

Drop-in OpenAI replacement

Ettore Di Giacinto

Open the App Store on your umbrelOS home server to install this app
Screenshot 1 of LocalAI app on Umbrel App Store
Screenshot 2 of LocalAI app on Umbrel App Store
Screenshot 3 of LocalAI app on Umbrel App Store
Screenshot 4 of LocalAI app on Umbrel App Store
About this app

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio locally with consumer grade hardware, supporting multiple model families and architectures. ⚠️ Note Before running a model, make sure your device has enough free RAM to support it. Attempting to run a model that exceeds your available memory could cause your device to crash or become unresponsive. Always check the model requirements before downloading or starting it.

What's newVersion v3.1.1

This release includes several improvements and new features: - Automatically install missing backends along with models - Support for Gemma 3n models (text generation only) - Meta packages in backend galleries for easier GPU-specific setup - Improved backend gallery with descriptions and re-ordering - Various bug fixes and dependency updates Full release notes can be found at https://github.com/mudler/LocalAI/releases

Information