Model Gallery
Discover and install AI models from our curated collection
Find Your Perfect Model
Filter by Model Type
Browse by Tags
gemma-4-e2b-it-artemis-q3-k-l
TurinTech Artemis Q3_K_L quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-q3-k-m
TurinTech Artemis Q3_K_M quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-iq3-xxs
TurinTech Artemis IQ3_XXS quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e2b-it-artemis-iq2-m
TurinTech Artemis IQ2_M quantization of Gemma 4 E2B from Google's QAT
checkpoint, for local chat and tool calls. Accepts image input through
the bundled F16 vision projector. Uses the embedded chat template and
an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-q4-0
TurinTech Artemis Q4_0 quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-iq3-m
TurinTech Artemis IQ3_M quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-it-artemis-q3-k-m
TurinTech Artemis Q3_K_M quantization of Gemma 4 E4B from Google's QAT
checkpoint, for local chat, reasoning, and tool use. Accepts image
input through the bundled F16 vision projector. Uses the embedded chat
template and an 8192-token context. Thinking is on by default.
Repository: localaiLicense: apache-2.0
qwen3.5-2b-artemis-q5-k-m
TurinTech Artemis Q5_K_M quantization of Qwen3.5 2B for local tool calls,
maths, and instruction following. Accepts image input through the
bundled F16 vision projector. Uses the embedded chat template and an
8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-2b-artemis-q4-k-m
TurinTech Artemis Q4_K_M quantization of Qwen3.5 2B for local tool calls,
maths, and instruction following. Accepts image input through the
bundled F16 vision projector. Uses the embedded chat template and an
8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-4b-artemis-q4-k-m
TurinTech Artemis Q4_K_M quantization of Qwen3.5 4B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-4b-artemis-q5-k-m
TurinTech Artemis Q5_K_M quantization of Qwen3.5 4B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-4b-artemis-q5-k-s
TurinTech Artemis Q5_K_S quantization of Qwen3.5 4B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-9b-artemis-q4-k-m
TurinTech Artemis Q4_K_M quantization of Qwen3.5 9B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-9b-artemis-q5-k-s
TurinTech Artemis Q5_K_S quantization of Qwen3.5 9B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3.5-9b-artemis-iq4-xs
TurinTech Artemis IQ4_XS quantization of Qwen3.5 9B for local chat and
tool calls. Accepts image input through the bundled F16 vision
projector. Uses the embedded chat template and an 8192-token context.
Repository: localaiLicense: apache-2.0
qwen3-4b-dflash
Qwen3-4B paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend. This is the canonical DFlash pairing documented upstream (`z-lab/Qwen3-4B-DFlash` + `Qwen/Qwen3-4B`).
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The Q4_K_M file carries the full Qwen3-4B target; the ~0.5 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0 (Qwen3-4B target) / MIT (z-lab DFlash drafter).
Repository: localaiLicense: apache-2.0
qwen3.5-4b-dflash
Qwen3.5-4B paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend.
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The Q4_K_M file carries the full Qwen3.5-4B target; the ~0.6 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0 (Qwen3.5-4B target) / MIT (z-lab DFlash drafter).
Repository: localaiLicense: apache-2.0
qwen3.5-9b-dflash
Qwen3.5-9B paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend.
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The Q4_K_M file carries the full Qwen3.5-9B target; the ~1 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0 (Qwen3.5-9B target) / MIT (z-lab DFlash drafter).
Repository: localaiLicense: apache-2.0
qwen3.6-27b-dflash
Qwen3.6-27B (dense) paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend. DFlash gives its largest speedups on dense targets like this one.
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The Q4_K_M file carries the full Qwen3.6-27B target; the ~1.8 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
qwen3.6-35b-a3b-dflash
Qwen3.6-35B-A3B (Mixture-of-Experts, ~3B active per token) paired with its DFlash block-diffusion drafter for speculative decoding on the llama.cpp backend. DFlash speedups on MoE targets are smaller than on dense models, but still useful.
DFlash produces a whole block of draft tokens in a single forward pass and injects the target model's hidden states into the drafter's attention, which keeps the drafter tiny while making drafting GPU-friendly. The UD-Q4_K_M file carries the full Qwen3.6-35B-A3B target; the ~0.4 GB Q8_0 drafter (`draft-dflash`) accelerates generation without changing the target's outputs. The drafter is not a standalone chat model: it only runs paired with the target, which is why both are bundled here.
Flash attention is required for DFlash and is enabled in this config. A GPU is recommended.
License: Apache 2.0.
Repository: localaiLicense: apache-2.0
gemma-4-e4b-hauhaucs-aggressive-q4
HauhauCS Aggressive is an uncensored derivative of Google's Gemma 4 E4B
instruction model. This Q4_K_M GGUF supports text chat and image input
through the publisher's bundled F16 multimodal projector.
Uses the embedded chat template and the publisher's sampling settings.
The default context is 8192 tokens. The publisher declares the Gemma license.
Repository: localaiLicense: gemma
Page
1
of many