View in EDS

PD-RC: Perception-driven rate control for panoramic video coding based on energy distribution optimization.

Saved in:
Bibliographic Details
Title: PD-RC: Perception-driven rate control for panoramic video coding based on energy distribution optimization.
Authors: Liu, Linyun1 (AUTHOR) liuly@hust.edu.cn, Li, Tiansong2 (AUTHOR) tiansongli@cqnu.edu.cn, Zhao, Huijuan1,3 (AUTHOR) hjzhao03@hust.edu.cn, He, Shuangjiang1,3 (AUTHOR) sjhe81@hust.edu.cn, Zhu, Jiabao1 (AUTHOR) zhujiabao@hust.edu.cn, Kuang, Jinhao1 (AUTHOR) jinhaokuang@hust.edu.cn, Yu, Li1,3 (AUTHOR) hustlyu@hust.edu.cn
Source: Displays. Jan2026, Vol. 91, pN.PAG-N.PAG. 1p.
Subjects: Bit rate, Video coding, Data distribution, Visual perception, Panoramic cameras, Sensory perception
Abstract: In immersive panoramic video (PV) encoding scenarios, PV exhibits larger flat regions compared to traditional videos. The existing intra-rate control methods in Versatile Video Coding (VVC) allocate the bitrate based on the construction of weights according to the energy distribution characteristics of different encoding blocks. However, in reality, the human visual system (HVS) is not sensitive to blocks with many flat regions in perception, which leads to excessive allocation of bitrate in insensitive regions. On the contrary, insufficient bitrate allocation in sensitive regions leads to the inability to achieve better reconstruction quality. To address this challenge, we propose a Perception-Driven Rate Control (PD-RC) strategy for panoramic video encoding based on energy distribution optimization, which makes the intra-rate control closer to the perception habits of HVS. Firstly, we propose a low-complexity filtering method guided by rate–distortion performance to optimize the energy distribution of I-frame features. Subsequently, leveraging the optimized perception features of the energy distribution, a perception-driven intra-mode coding-tree-unit-level rate control strategy is proposed to improve the coding performance for PV. Extensive evaluations show the performance of PD-RC over the state-of-the-art rate control methods of VVC. Specifically, in all-intra encoding mode, the average bitrate savings of PD-RC is −5.002%, while the average gain in weighted-spherically quality is 0.239 dB, with a rate exceeding the upper limit as low as 2%, and a reduction in encoding complexity gain of −0.163%. PD-RC effectively improves the rate control performance of PV intra-frame coding while saving computational overhead. It is significant for optimizing data transmission efficiency, enhancing video quality, and reducing storage costs. The source code will be available at https://github.com/liulinyun324/PD-RC. • We present a PD-RC algorithm for panoramic video coding. • We propose a low-complexity filtering guided by R-D performance to reduce noise. • We propose a CTU-level RC strategy driven by perceptual features to optimize bitrate. • We have proposed a new code control evaluation metric exceeding the limit rate (Er). [ABSTRACT FROM AUTHOR]
Copyright of Displays is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:In immersive panoramic video (PV) encoding scenarios, PV exhibits larger flat regions compared to traditional videos. The existing intra-rate control methods in Versatile Video Coding (VVC) allocate the bitrate based on the construction of weights according to the energy distribution characteristics of different encoding blocks. However, in reality, the human visual system (HVS) is not sensitive to blocks with many flat regions in perception, which leads to excessive allocation of bitrate in insensitive regions. On the contrary, insufficient bitrate allocation in sensitive regions leads to the inability to achieve better reconstruction quality. To address this challenge, we propose a Perception-Driven Rate Control (PD-RC) strategy for panoramic video encoding based on energy distribution optimization, which makes the intra-rate control closer to the perception habits of HVS. Firstly, we propose a low-complexity filtering method guided by rate–distortion performance to optimize the energy distribution of I-frame features. Subsequently, leveraging the optimized perception features of the energy distribution, a perception-driven intra-mode coding-tree-unit-level rate control strategy is proposed to improve the coding performance for PV. Extensive evaluations show the performance of PD-RC over the state-of-the-art rate control methods of VVC. Specifically, in all-intra encoding mode, the average bitrate savings of PD-RC is −5.002%, while the average gain in weighted-spherically quality is 0.239 dB, with a rate exceeding the upper limit as low as 2%, and a reduction in encoding complexity gain of −0.163%. PD-RC effectively improves the rate control performance of PV intra-frame coding while saving computational overhead. It is significant for optimizing data transmission efficiency, enhancing video quality, and reducing storage costs. The source code will be available at https://github.com/liulinyun324/PD-RC. • We present a PD-RC algorithm for panoramic video coding. • We propose a low-complexity filtering guided by R-D performance to reduce noise. • We propose a CTU-level RC strategy driven by perceptual features to optimize bitrate. • We have proposed a new code control evaluation metric exceeding the limit rate (Er). [ABSTRACT FROM AUTHOR]
ISSN:01419382
DOI:10.1016/j.displa.2025.103198