Discover and install AI models from our curated collection
Repository: localaiLicense: other

LFM2.5-2.6B with LiquidAI's DSpark speculative drafter. This build pairs the Q4_K_M target with the compact Q4_K_M draft sidecar for lower-memory hosts. DSpark proposes blocks of tokens that the target model verifies, which preserves the target model's output while accelerating generation.
Links
Tags
Repository: localaiLicense: other

LFM2.5-2.6B with LiquidAI's DSpark speculative drafter. This build pairs the higher-quality Q8_0 target with the recommended F16 draft sidecar for the best acceptance length. DSpark proposes blocks of tokens that the target model verifies, which preserves the target model's output while accelerating generation.
Links
Tags
Repository: localaiLicense: other

LFM2.5-8B-A1B with LiquidAI's DSpark speculative drafter. This build pairs the Q4_K_M target with the compact Q4_K_M draft sidecar for lower-memory hosts. DSpark proposes blocks of tokens that the target model verifies, which preserves the target model's output while accelerating generation.
Links
Tags
Repository: localaiLicense: other

LFM2.5-8B-A1B with LiquidAI's DSpark speculative drafter. This build pairs the higher-quality Q8_0 target with the recommended F16 draft sidecar for the best acceptance length. DSpark proposes blocks of tokens that the target model verifies, which preserves the target model's output while accelerating generation.
Links
Tags
Repository: localaiLicense: apache-2.0
MiniCPM-OCR 1.0 with OpenBMB's DSpark speculative drafter. DSpark proposes blocks of tokens that the target verifies, which speeds up generation without changing the target model's output. This entry pairs the Q8_0 target with the matching Q8_0 draft and the required F16 4x vision projector, with an 8,192-token default context.
Links
Tags