Articles tagged "Requirements"

Fish Audio Drama 3 (Oct 2026): 35B MoE open-weight TTS. No official minimum; 48GB GPU advised. Free commercial use under $500K revenue, API cost, SGLang-Omni.

Holo4-35B-A3B (Apache-2.0) needs ~20GB at 4-bit and ~80GB in BF16 (estimates): RTX 4090/5090 or a 32GB Mac. vLLM and GGUF setup, API cost. Updated Oct 2026.

Janas-LLM is a C engine that streams MoE experts from SSD, running an 80B model on 32GB RAM at 24 tokens/s. Specs, llama.cpp comparison, setup, caveats.

EmbeddingGemma 2 runs in 191MB RAM (text only) and about 1.5GB BF16 for all modalities, no GPU. Memory table, setup, local RAG. October 2026.

Mistral Large 4 (1T MoE, 49B active) needs an estimated ~1TB at FP8, ~500-580GB at 4-bit. GPU, Mac and API cost compared. Updated Oct 2026; weights due soon.

Reflection Beam (501B MoE, 23B active) needs an estimated ~501GB at FP8, ~250-290GB at 4-bit. GPU, Mac and CPU-offload fits as of October 2026; weights not out.

Index-Translate needs about 2GB VRAM (2B), 6GB (9B) or 21GB (35B-A3B) at 4-bit. bilibili's 150-language models: GPU, Mac, CPU specs and setup. Oct 2026.

Ternary Bonsai 2 27B (PrismML, Sep 2026): Qwen3.8-27B at 1.76-bit weights, 5.9GB, 16GB RAM or a 24GB GPU, 98.2% of FP16 score. Apache 2.0, updated Sep 2026.

MiMo-V2.6 Flash needs ~170-190GB at 4-bit, ~320-350GB at FP8; Pro ~550-600GB at 4-bit; the 9B distill ~6-7GB. Updated Sep 2026: specs, benchmarks, API prices.

Atria Dawn Preview needs an estimated ~400GB at 4-bit, ~780GB at FP8, or ~1,500GB at BF16. A rundown of this 744B MoE model's specs, vendor-reported benchmarks, API options, and comparison with other open MoE models.

Qwen-Image-2.1, Alibaba's open model (Sep 20, 2026), unifies 7B gen and editing with transparent PNG, 10-image edits. VRAM unofficial; non-commercial license.

Released Sep 2026, Edge0-35B-A3B-preview 4-bit-quantizes Qwen3.5-MoE 35B-A3B and streams experts off SSD on demand, running at under 3GiB of active memory and roughly 15-18 tok/s on MLX. Here's how it works, what hardware you need, how to run it, and how it compares to llama.cpp mmap offload and Colibri.

As of Sep 7, 2026, OpenBMB's MiniCPM5-2B (2.52B dense, 131K context, Apache-2.0) needs roughly 1.5GB to 5GB of RAM/VRAM depending on quantization. Here is a GGUF size table, how to run it with Ollama and llama.cpp, and a comparison with Qwen3.5-4B.

As of Sep 2026, Nex-AGI's agentic Nex-N2.5 family (Mini 35B, Pro 397B, Max 1.6T), released Sep 8, needs anywhere from roughly 22GB to over a terabyte of VRAM depending on model and quantization. Here is a per-model, per-quantization sizing table plus GPU and Apple Silicon build guidance.

DeepSeek V4.1-Flash launched Sep 10, 2026: 552B MoE, 8B/16B active params, 890-byte/token KV cache, quarter prior gen, MIT license. Pricing and VRAM specs.

As of Sep 2026, K2 Horizon from MBZUAI's Institute of Foundation Models spans 0.9B to 375B parameters, needing anywhere from under 1GB to roughly 750GB of VRAM depending on quantization. Here is a per-model, per-quantization sizing table plus GPU and Apple Silicon build guidance.

Solar-Open2-250B (15B active MoE): GGUF IQ4_XS ~127GB, Q2_K ~89GB, Q6_K ~191GB. Official spec is 4-8x H200, but a single 96GB GPU works too. As of Sep 2026.

Qwen3.8-Flash-Next needs roughly 75GB (1-bit) to 354GB (BF16) of memory depending on quantization. This 125B-total/6B-active open-weight MoE has been run on a single 24GB RTX 4090 via MoE expert offloading, while the official vLLM/SGLang FP8 recipe needs ~250GB across multiple datacenter GPUs. VRAM and GPU tables inside. Updated August 2026.

Hy4 preview needs about 385GB VRAM at 4-bit and 1.54TB at BF16. Tencent open-weighted this 770B MoE with 1M context in Aug 2026. VRAM tables, GPUs, API cost.

GLM-5.3-Flash needs about 190GB VRAM at 4-bit, 740GB at BF16. VRAM and GPU tables for this 320B/18B open MoE, plus local vs API costs. Updated August 2026.

Ornith 1.5 is an MIT open-weight LLM needing 8GB to 800GB VRAM. Compare GPU picks and quantized VRAM needs for 9B, 35B-A3B and 397B. As of August 2026.

MiniMax-Music3 is an open-weight text-to-music model that generates up to 5-minute tracks as 32kHz/16-bit stereo WAV. The reference setup targets 24GB+ VRAM, with CPU offloading fitting ~22GB and layer-by-layer streaming reaching down to 8GB cards. As of August 2026, this article lays out the confirmed hardware requirements, license terms, and the paid API's new-user sunset starting August 20, 2026.

LTX-2.5 (22B DiT, Gemma 4 encoder) is an open video+audio model out Aug 11, 2026. VRAM: 16-80GB; files: 35.9-71.4GB by quant. See table and GPU picks.

Qwen3.8-27B weights landed on August 15, 2026. This at-a-glance requirements guide maps VRAM needs to the actual published file sizes: Q4_K_M is 17.1GB and won't fit a 16GB GPU, making IQ4_XS (15.7GB) the practical floor. Licensed Apache-2.0 for commercial use.

Liquid AI's LFM2.5-2.6B is a 2.69B on-device agent model under 2.5GB with 128K context. This guide covers VRAM sizing, benchmarks, throughput, and licensing.

Shieldstral 1.0 3B is Mistral AI's Apache 2.0 moderation model, released Aug 4, 2026. It needs ~16GB VRAM in BF16 and screens both text and images together.

MiniMax H3, an open video+audio model, released weights Aug 3, 2026. ComfyUI needs ~42.5GB files, ~24GB VRAM (12GB may work). Covers quantization, GPU sizing.

WASTE is a dependency-free C engine running Kimi K3 (2.78T params) on 29GB RAM by streaming MoE experts from NVMe. Covers real throughput, setup, and limits.

LG AI Research's K-EXAONE 2.0 750B-A37B needs ~1.5TB weights at BF16, ~750GB at FP8, and 375-420GB at 4-bit — hardware math and Apache 2.0 self-host limits.

Moonshot released Kimi K3 open weights on July 26, 2026. At MXFP4 the weights alone are ~1.4TB — self-hosting means a multi-node cluster, not one GPU.

LongCat-2.0 is Meituan's 1.6T-parameter, MIT-licensed MoE model. Running it locally needs roughly 3,800GB in BF16 or about 970GB even at INT4 — no personal PC can hold it. Requirements tables and API pricing ($0.75/$2.95 per 1M tokens), updated July 2026.

DeepSeek V4-Flash needs roughly 160GB at 4-bit and V4-Pro about 920GB. The July 31 V4-Flash-0731 build keeps the same footprint while beating V4-Pro on agent benchmarks. VRAM, RAM and GPU tables by quantization, API pricing, and the legacy model retirement. Updated August 2026.

Nemotron 3 Nano runs in about 18GB at 4-bit, Super needs 8x H100-80GB, Ultra needs 4x B200 at NVFP4. VRAM, GPU and quantization tables for NVIDIA's open-weight MoE family. Updated July 2026.

GLM-5.2 needs roughly 430GB at 4-bit and about 1.5TB at BF16 in combined memory. Quick-lookup VRAM, RAM and quantization tables for running Z.ai's 753B / ~40B-active open-weight MoE (MIT-licensed) locally. Updated July 2026.

Inkling needs from ~280GB (1-bit) to ~600GB (4-bit) combined memory, and 1.9TB at BF16. Quick-lookup VRAM, RAM, disk and quantization tables for running this 975B / 41B-active open-weight MoE locally. Updated July 2026.

Kimi K3 is a 2.8-trillion-parameter open-weight MoE (weights due July 27, 2026), ranked #1 on the frontend-code arena. API pricing is $3 input / $15 output per million tokens. Local runs are estimated at 650GB–1TB, needing server-class hardware. How it differs from K2.

Gemma 4 minimum: 5GB RAM (E2B Q4), recommended: 24GB VRAM (31B Dense Q4). Quick-lookup tables covering VRAM, RAM, and GPU requirements for all variants: E2B, E4B, 26B MoE, and 31B Dense.