Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Installed Models

10 models ready to use

gpt-oss-120b

llama-cpp Running

Chat

Edit

gpt-oss-120b-pentest

llama-cpp Running

Chat

Edit

gpt-oss-20b

llama-cpp Running

Chat

Edit

huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe icon

huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe

llama-cpp

Chat

Edit

kokoro

kokoro Running

Edit

lima-new-005-poc-92bde1cd

llama-cpp

Edit

lima-new-005-poc-ef798ccc

llama-cpp

Edit

qwen3.6-35b-a3b-uncensored-heretic-apex-i-balanced

llama-cpp

Chat

Edit

gpt-oss-120b-mxfp4-00002-of-00003.gguf

Auto Backend No Config

Configuration required for full functionality

gpt-oss-120b-mxfp4-00003-of-00003.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

11 backends ready to use

cuda12-diffusers

cuda12-kokoro

cuda12-llama-cpp

cuda12-vllm

cuda12-vllm-development

diffusers

kokoro

llama-cpp

localai@diffusers

localai@vllm

vllm