May 10, 2026· ~6 min readAtlas Engine: Sub-2-Minute Cold Start for Multi-Model Orchestration on DGX Spark A pure Rust inference engine achieves 96 tok/s on Qwen3.5-35B-A3B—a 3× speedup over vLLM's 31 tok/s, with cold startup in 15 seconds versus vLLM's 10
April 25, 2026· ~6 min readDeepSeek V4: 1.6T Parameters, FP4 Precision, and the Huawei NPU Question DeepSeek V4 arrives with two models: a 1.6-trillion-parameter Pro variant and a 284-billion-parameter Flash variant. The headline number is the Pro m
April 13, 2026· ~7 min readvLLM vs SGLang: Choosing an LLM Inference Framework in 2026 Serving large language models at production scale boils down to one problem: getting the most tokens out of your GPU per second, per dollar. Two open
February 25, 2026· ~6 min readSelf-Hosted LLM Inference: A Complete vLLM Setup Guide Running your own LLM inference server gives you complete control over data privacy, latency, and costs. This guide walks through deploying a producti