Abstract
We introduce D-FINE, a powerful real-time object detector that achieves outstanding localization precision by redefining the bounding box regression task in DETR models. D-FINE comprises two key components: Fine-grained Distribution Refinement (FDR) and Global Optimal Localization Self-Distillation (GO-LSD). FDR transforms the regression process from predicting fixed coordinates to iteratively refining probability distributions, providing a fine-grained intermediate representation that significantly enhances localization accuracy. GO-LSD is a bidirectional optimization strategy that transfers localization knowledge from refined distributions to shallower layers through self-distillation, while also simplifying the residual prediction tasks for deeper layers. Additionally, D-FINE incorporates lightweight optimizations in computationally intensive modules and operations, achieving a better balance between speed and accuracy. Specifically, D-FINE-L/X achieves 54.0%/55.8% AP on the COCO dataset at 124/78 FPS on an NVIDIA T4 GPU. When pretrained on Objects365, D-FINE-L/X attains 57.1%/59.3% AP, surpassing all existing real-time detectors. Furthermore, our method significantly enhances the performance of a wide range of DETR models by up to 5.3% AP with negligible extra parameters and training costs. Our code and models: https://github. com/Peterande/D-FINE.
D-FINE是一种实时目标检测器，通过重新定义DETR中的边界框回归任务实现高精度定位。其核心包含细粒度分布细化（FDR）和全局最优定位自蒸馏（GO-LSD）。FDR将回归从预测固定坐标改为迭代细化概率分布，提供细粒度中间表示；GO-LSD通过自蒸馏将定位知识从最终层传递到浅层，并简化深层残差预测。在COCO上达到54.0%/55.8% AP，124/78 FPS，预训练后达57.1%/59.3% AP，超越现有实时检测器，并显著提升多种DETR模型性能。