Model Gallery

Discover and install AI models from our curated collection

2 models available
1 repositories
Documentation

Find Your Perfect Model

Filter by Model Type

Browse by Tags

qwen3.8-flash-next-unsloth-ud-iq4_xs
Qwen3.8-Flash-Next, a 125B-parameter hybrid mixture-of-experts model, in Unsloth's Dynamic quantization (UD-IQ4_XS, about 4-bit i-quant) (about 95 GB to download). It reads images through the vision projector published for the original model, and the Strata backend parses its reasoning and tool calls. Needs about 72 GB of RAM to keep every expert in memory; with less, the mapped experts are read from the SSD while it answers, which works and is much slower. Keep the files on an SSD. Needs a GPU the strata backend supports; NVIDIA with 12 GB of VRAM or more is the class Strata tests. Runs only on the experimental strata backend. On the first load the strata backend builds the Strata pack from the GGUF files (a few minutes, a few GB of extra disk); a finished pack is never rebuilt. The experts are read from the GGUF files in place (mapped); add --resident-experts to engine_args to copy them into RAM when there is room. Licensed under the Qwen Community License 1.0 (inherited from Qwen/Qwen3.8-Flash-Next): free use, but a Model as a Service or AI Work Assistant business needs a licence from Qwen. Read the LICENSE file in the repository first. The GGUF files are the Unsloth quantization; the vision projector is ISTA-DASLab's file for the original model; Strata is by Niko1221. The MTP draft layer is not configured here.

Repository: localaiLicense: qwen-community-1.0

q3.5-bluestar-27b

Repository: localaiLicense: mit