BitDelta: 1-Bit Behavioral Compression Across the Zen Model Family
BITDELTA PAPER MONOSOUP PAPER K-MERGE PAPER ZEN MODELS The Zen model family has a deployment problem that is not immediately obvious from the outside. We publish 14+ distinct model variants — from zen-nano at 0.6B parameters to zen4-ultra at 1.04T. Each variant carries fine-tuned behavioral characteristics: different personas, different task specializations, different safety postures. In a naive serving architecture, each variant is a separate set of weights. Loading all of them onto a GPU cluster is economically impossible....