Model Gallery
Discover and install AI models from our curated collection
Find Your Perfect Model
Filter by Model Type
Browse by Tags
humanizer-12b-bf16
Humanizer is a 12B Gemma 4 fine-tune for rewriting English and Chinese text.
This unquantized BF16 GGUF build uses llama.cpp with an 8,192-token context.
This entry uses the completions API with the publisher's exact rewriting prompt.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-q3-k-l
TurinTech Artemis Q3_K_L quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-q3-k-m
TurinTech Artemis Q3_K_M quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-iq3-xxs
TurinTech Artemis IQ3_XXS quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-iq2-m
TurinTech Artemis IQ2_M quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-q4-0
TurinTech Artemis Q4_0 quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-iq3-m
TurinTech Artemis IQ3_M quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-q3-k-m
TurinTech Artemis Q3_K_M quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemmable-4-12b-mtp
## Gemmable 4 12B
Gemmable 4 12B is a GGUF export of Gemma 4 12B fine-tuned on Fable-5 style
reasoning and assistant traces.
## Highlights
- Base model: `google/gemma-4-12B`
- Format: GGUF
- Training style: Fable-5 style reasoning and assistant traces
- Distribution: fp16 GGUF plus matching assistant GGUFs for each quant
- Intended use: local inference, coding, reasoning, and assistant workflows
## How to use
### llama.cpp
Standard load:
```bash
llama-server -m "gemmable-4-12b-fp16.gguf"
```
Speculative / draft-MTP load:
```bash
llama-server -m "gemmable-4-12b-Q4_K_M.gguf" \
--spec-draft-model "gemmable-4-12b-Q4_K_M-mtp.gguf" \
--spec-type draft-mtp \
--spec-draft-n-max 4
```
Use the matching fp16 or quantized main file with its `-mtp` companion.
### LM Studio
1. Search this repo, download target + mtp file.
2. Load target.
3. Load settings → Speculative Decoding → select mtp file file.
(Requires a llama.cpp runtime with Gemma 4 MTP support from ggml-org/llama.cpp#23398. LocalAI's pinned llama.cpp backend already carries it, so this entry runs draft-mtp out of the box.)
## GGUF / local inference notes
...
Repository: localai
gemma-4-12b-qat-hauhaucs-balanced
HauhauCS Balanced is an uncensored Gemma 4 12B model built from
quantization-aware-trained weights for chat, coding, and creative writing.
This Q4_K_M GGUF build includes the vision projector for image input.
Repository: localaiLicense: gemma
gemma-4-12b-qat-hauhaucs-balanced-mtp
HauhauCS Balanced is an uncensored Gemma 4 12B model built from
quantization-aware-trained weights for chat, coding, and creative writing.
This Q4_K_M GGUF build includes the vision projector for image input.
The MTP variant adds the publisher-provided draft head and enables
llama.cpp multi-token-prediction speculative decoding.
Repository: localaiLicense: gemma
gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2
Hugging Face |
GitHub |
Launch Blog |
Documentation
License: Apache 2.0 | Authors: Google DeepMind
> [!Note]
> This model card is for the Gemma 4 12B Unified model, which is part of the Gemma 4 family of open models. Built with the same multimodal functionality as Gemma 4 E2B and E4B (text, audio, image, and video inputs), it brings native audio and vision understanding directly to local environments without the need for separate encoders. This unified approach to multimodality makes the model encoder-free, offering a deployment size that is perfect for consumer devices and streamlined local execution.
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
...
Repository: localaiLicense: apache-2.0
gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2-mtp
Gemma 4 12B Agentic v2 is an Apache-2.0 fine-tune for coding, terminal
work, multi-step tool use, and reasoning. This variant pairs the Q4_K_M
target with the upstream Q8_0 Gemma 4 MTP drafter for faster lossless
generation through llama.cpp speculative decoding.
Repository: localaiLicense: apache-2.0
gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2-q8
Gemma 4 12B Agentic v2 is an Apache-2.0 fine-tune for coding, terminal
work, multi-step tool use, and reasoning. This variant uses the
near-lossless Q8_0 GGUF quantization for higher output fidelity.
Repository: localaiLicense: apache-2.0
gemma-4-12b-coder-fable5-composer2.5-v1
Hugging Face |
GitHub |
Launch Blog |
Documentation
License: Apache 2.0 | Authors: Google DeepMind
> [!Note]
> This model card is for the Gemma 4 12B Unified model, which is part of the Gemma 4 family of open models. Built with the same multimodal functionality as Gemma 4 E2B and E4B (text, audio, image, and video inputs), it brings native audio and vision understanding directly to local environments without the need for separate encoders. This unified approach to multimodality makes the model encoder-free, offering a deployment size that is perfect for consumer devices and streamlined local execution.
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
...
Repository: localaiLicense: gemma
gemma-4-31b-fable-coder-q4
Gemma-4-31B-Fable-Coder is DavidrPatton's Gemma 4 31B fine-tune for
coding and visual interface tasks. This entry uses the Q4_K_M GGUF
with the F16 vision projector and a 32,768-token context.
Repository: localaiLicense: apache-2.0
gemma-4-31b-fable-coder-q8
Gemma-4-31B-Fable-Coder is DavidrPatton's Gemma 4 31B fine-tune for
coding and visual interface tasks. This entry uses the Q8_0 GGUF
with the F16 vision projector and a 32,768-token context.
Repository: localaiLicense: apache-2.0
lythri-4b-a2b-q4
Lythri 4B A2B is a Gemma 4 E2B fine-tune for conversational companionship.
This Q4_K_M GGUF build runs text chat through llama.cpp with the embedded
chat template and a 32,768-token context.
Repository: localaiLicense: apache-2.0
lythri-4b-a2b-q8
Lythri 4B A2B is a Gemma 4 E2B fine-tune for conversational companionship.
This Q8_0 GGUF build runs text chat through llama.cpp with the embedded
chat template and a 32,768-token context.
Repository: localaiLicense: apache-2.0
gemma-4-31b-ortenzya-q4
Ortenzya is a Gemma 4 31B instruction-tuned model from llmfan46 for
creative writing, translation, and roleplay. This entry uses the Q4_K_M
GGUF with the BF16 vision projector and a 32,768-token context.
Repository: localaiLicense: apache-2.0
gemma-4-31b-ortenzya-q8
Ortenzya is a Gemma 4 31B instruction-tuned model from llmfan46 for
creative writing, translation, and roleplay. This entry uses the Q8_0
GGUF with the BF16 vision projector and a 32,768-token context.
Repository: localaiLicense: apache-2.0
Page
1
of many