GigaChat3.5-432B-A28B Released with Day-0 GGUF Support
WHY IT MATTERS
New model GigaChat3.5-432B with 28B active parameters released with immediate GGUF quantization support. Enables local deployment from launch.
Yandex released GigaChat3.5-432B with 28B active parameters in GGUF format on day-one, enabling immediate local quantization and inference without waiting for community conversion pipelines.
GGUF availability at launch compresses the timeline between model release and practical deployment. Community builders typically wait weeks for quantization formats; eliminating that lag reduces friction for benchmarking, fine-tuning experiments, and integration testing. This signals vendor investment in local-first accessibility as a release expectation rather than afterthought.
For operators, immediate GGUF support reduces vendor lock-in friction during evaluation phases. Teams can run inference locally on consumer hardware during initial testing, deferring cloud infrastructure decisions. This shifts cost-benefit analysis earlier in procurement cycles—local cost-of-compute becomes a direct comparison point at announcement rather than days later. The 28B active parameter design targets the consumer-grade deployment window (8-16GB VRAM machines), suggesting competitive positioning against similarly-scoped open models in cost-per-inference scenarios.
SOURCE
Reddit r/LocalLLaMA
SHARE
MORE FROM STUFFINSIDER
Tencent Releases Hy3 Model – 295B Total with 21B Active Parameters
Jul 6MODELSDeepSeek DSpark Breakthrough: Significantly Faster Than MTP
Jul 3MODELSDeepSeek V4 Flash Full 1M Token Context Running Locally on RTX 5090
Jul 3MODELSDeepSeek V4 Flash Achieves Sonnet-Level Quality at Higher Speed Locally
Jul 3