Like image coding in visual data transmission, feature coding is essential for the distributed deployment of large models by significantly reducing transmission and storage burden. However, prior studies have mostly targeted task- or model-specific scenarios, leaving the challenge of universal feature coding across diverse large models largely unexplored. In this paper, we present the first systematic study on universal feature coding for large models. The key challenge lies in the inherently diverse and distributionally incompatible nature of features extracted from different models. For example, features from DINOv2 exhibit highly peaky, concentrated distributions, while those from Stable Diffusion 3 (SD3) are more dispersed and uniform. This distributional heterogeneity severely hampers both compression efficiency and cross-model generalization. To address this, we propose a learned peaky-to-balanced …
本文首次系统研究大模型通用特征编码问题，旨在降低分布式部署中的传输与存储开销。针对不同模型提取特征分布差异显著（如DINOv2特征高度集中、SD3特征分散均匀）导致压缩效率低、跨模型泛化难的问题，提出一种从峰值分布到平衡分布的变换方法，实现通用且高效的特征压缩与传输。