Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Installed Models

6 models ready to use

gpt-oss-120b

llama-cpp Running

Chat

Edit

gpt-oss-20b

llama-cpp

Chat

Edit

huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe icon

huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe

llama-cpp

Chat

Edit

kokoro

kokoro

Edit

gpt-oss-120b-mxfp4-00002-of-00003.gguf

Auto Backend No Config

Configuration required for full functionality

gpt-oss-120b-mxfp4-00003-of-00003.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

11 backends ready to use

cuda12-diffusers

cuda12-kokoro

cuda12-llama-cpp

cuda12-vllm

cuda12-vllm-development

diffusers

kokoro

llama-cpp

localai@diffusers

localai@vllm

vllm