Model Gallery

Discover and install AI models from our curated collection

113 models available
1 repositories
Documentation

Find Your Perfect Model

Filter by Model Type

Browse by Tags

apodex-1.1-mini-q8
Apodex-1.1-mini in the higher-quality Q8_0 GGUF format, with the shared F16 vision projector for multimodal prompts.

Repository: localaiLicense: apache-2.0

glm-5.3-flash-q8
GLM-5.3-Flash is Z.ai's natively multimodal 320B-parameter mixture-of-experts model with 18B active parameters. It combines sparse and linear attention for coding, agentic work, tool use, vision, and long-context tasks. This entry uses the higher-quality Q8_0 GGUF quantization and enables the model's MTP speculative-decoding head.

Repository: localaiLicense: mit

qwen3.8-flash-next-q8
Qwen3.8-Flash-Next in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector. This build preserves more model quality but needs more memory than the default Q4 variant.

Repository: localaiLicense: other

granite-4.2-3b-q8
IBM Granite 4.2 3B in the higher-fidelity Q8_0 GGUF format. It is a compact multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

granite-4.2-8b-q8
IBM Granite 4.2 8B in the higher-fidelity Q8_0 GGUF format. It is a multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

granite-4.2-30b-q8
IBM Granite 4.2 30B in the higher-fidelity Q8_0 GGUF format. It is the family's flagship multilingual reasoning model for chat, coding, and tool use.

Repository: localaiLicense: apache-2.0

dirk-qwen3.8-27b-q8
Dirk in the higher-quality Q8_K_XL GGUF format, with MTP speculative decoding and the shared F16 vision projector for multimodal prompts.

Repository: localaiLicense: apache-2.0

hy-mt2-1.8b-q8
Hy-MT2-1.8B in the higher-quality 1.9 GB Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

carbon-3b-q8
Carbon-3B in the higher-quality Q8_0 GGUF format for genomic sequence generation and analysis.

Repository: localaiLicense: apache-2.0

carbon-8b-q8
Carbon-8B in the higher-quality Q8_0 GGUF format for genomic sequence generation and analysis.

Repository: localaiLicense: apache-2.0

ornith-1.0-9b-q8
Ornith-1.0-9B in the higher-quality Q8_0 GGUF format, with the shared F16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-q8
Ornith-1.5-9B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-9b-obliterated-q8
Ornith-1.5-9B OBLITERATED in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector. Its safety guardrails are removed, and the publisher recommends this quantization for better behavior fidelity.

Repository: localaiLicense: mit

ornith-1.5-35b-a3b-q8
Ornith-1.5-35B-A3B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

thomson-1.0-small-q8
Thomson-1.0-Small in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: polyform-strict-1.0.0

tiel-coder-35b-a3b-q8
Tiel-Coder-35B-A3B in the higher-quality Q8_K_XL GGUF format, with the BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

ornith-1.5-397b-q8
Ornith-1.5-397B in the higher-quality Q8_0 GGUF format, with the shared BF16 vision projector for multimodal prompts.

Repository: localaiLicense: mit

qwen3.8-27b-obliterated-q8
Qwen3.8-27B OBLITERATED in the higher-quality Q8_0 GGUF format. This model is modified for refusal-removal and red-team research, and its safety guardrails have been removed.

Repository: localaiLicense: apache-2.0

qwen3.8-27b-q8
Qwen3.8-27B in the official Q8_0 GGUF format. This variant provides higher model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.8-9b-q8
Qwen3.8-9B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

qwen3.8-4b-q8
Qwen3.8-4B in the higher-quality Q8_0 GGUF format. This variant preserves more model fidelity for hosts with enough memory.

Repository: localaiLicense: apache-2.0

Page 1 of many