swift-1.5-qwen3.8-flash-next-iq2_xs
Qwen3.8-Flash-Next, a 125B-parameter hybrid mixture-of-experts model, in
UkisAI's Swift 1.5 fine-tune, which thinks much shorter before it answers, at
2-bit i-quant (IQ2_XS) (about 69 GB to download).
It reads images through the vision projector published for the original model,
and the Strata backend parses its reasoning and tool calls.
Needs about 39 GB of RAM and VRAM together for the model (the same as the same
size of the original), and fast SSD storage for the n-gram table. Needs a GPU
the strata backend supports; NVIDIA with 12 GB of VRAM or more is the class
Strata tests. Runs only on the experimental strata backend.
On the first load the strata backend builds the Strata pack from the GGUF
files (a few minutes, a few GB of extra disk); a finished pack is never
rebuilt. The experts are read from the GGUF files in place (mapped); add
--resident-experts to engine_args to copy them into RAM when there is room.
Two licences apply: UkisAI's Swift Open License 1.0 for the fine-tune, and the
Qwen Community License 1.0 for the Qwen3.8-Flash-Next parts it is built from.
Read both before you offer the model to other people.
The GGUF files are the quantization by UkisAI of its Swift 1.5 fine-tune;
Strata is by Niko1221. The MTP draft layer is not configured here.