Performance Bounds for Computational Models of Visual Saliency in 360 Videos

Aline F. G. Sousa, Clebson I. S. Silva, Ronaldo F Zampolo

DOI: 10.14209/sbrt.2025.1571142924

Evento: XLIII Simpósio Brasileiro de Telecomunicações e Processamento de Sinais (SBrT2025)

Keywords: Visual attention modeling immersive video performance bounds performance metrics

Abstract

Estimating performance bounds can improve the comparative analysis of saliency models by exposing their strengths and weaknesses. This paper evaluates two approaches for estimating bounds on immersive videos: Equator Bias and Saliency Sum. For validation, we compare them with outputs from two attention models - Spherical U-Net and DAVE - using three metrics: AUC-Judd, NSS, and CC. Experiments were conducted on 6 videos from the PAVS10K dataset, which includes eye-tracking data from ~20 observers. Saliency Sum achieved the best scores across all metrics, while Equator Bias scored the lowest, indicating that both approaches have significant potential for representing upper and lower performance bounds, respectively.

Download