Token-Wise Attention-Guided Semantic Quality Assessment for Compressed Visual Features

Abstract

In collaborative and distributed intelligent systems, compressed intermediate features are routinely transmitted and reused, making semantic quality assessment (SQA) crucial for reliable deployment. Recent compressed feature quality assessment (CFQA) benchmarks, however, show that conventional similarity measures often correlate poorly with downstream semantic utility and lack robustness across diverse feature codecs. In this paper, we propose a token-wise, attention-guided method for assessing the semantic quality of compressed features. First, motivated by the observation that many downstream heads normalize and process tokens largely independently, we assess quality at the token level. This token-wise formulation exploits the intrinsic correspondence between the original and reconstructed tokens while reducing cross-token interference. Second, since tokens contribute unequally to downstream …

Publication
In QoMEX

本文针对协作与分布式智能系统中压缩中间特征的语义质量评估问题,提出了一种基于Token级注意力引导的评估方法。该方法利用原始与重建Token之间的内在对应关系,在Token层面进行质量度量,以减少跨Token干扰;同时通过注意力机制区分不同Token对下游任务的重要性,从而更准确地反映压缩特征的语义效用。实验表明,该方法在多种特征编解码器上均优于传统相似性度量,具有良好的鲁棒性。