Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

3 models ready to use

gpt-oss-20b

llama-cpp

Chat

Edit

gpt-oss-20b-claude-4-distill-i1

llama-cpp

Chat

Edit

galatolo-Q4_K.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

2 backends ready to use

llama-cpp

User Installed

Alias: llama-cpp

Installed: 2025-11-04T07:34:31Z

Gallery: github:mudler/LocalAI/backend/index.yaml@master

Path: /backends/vulkan-llama-cpp/run.sh

vulkan-llama-cpp

User Installed

Alias: llama-cpp

Installed: 2025-11-04T07:34:31Z

Gallery: github:mudler/LocalAI/backend/index.yaml@master

Path: /backends/vulkan-llama-cpp/run.sh