https://www.immersivecomputinglab.org/publication/color-perception-guided-display-power-reduction-for-virtual-reality/ * Twitter * Google_scholar * Internal Login Immersive Computing Lab * Home * Members * Research * Press * Courses * Search * Menu Menu [NYU-Immers] [kERLm8K433pRmoH1-1-845x321] Color-Perception-Guided Display Power Reduction for Virtual Reality September 22, 2022/in Publications Color-Perception-Guided Display Power Reduction for Virtual Reality Budmonde Duinkharjav*, Kenneth Chen*, Abhishek Tyagi, Jiayi He, Yuhao Zhu, Qi Sun ACM Transactions on Graphics (SIGGRAPH Asia 2022) PDF Video All Research Abstract Battery life is an increasingly urgent challenge for today's untethered VR and AR devices. However, the power efficiency of head-mounted displays is naturally at odds with growing computational requirements driven by better resolution, refresh rate, and dynamic ranges, all of which reduce the sustained usage time of untethered AR /VR devices. For instance, the Oculus Quest 2, under a fully-charged battery, can sustain only 2 to 3 hours of operation time. Prior display power reduction techniques mostly target smartphone displays. Directly applying smartphone display power reduction techniques, however, degrades the visual perception in AR/VR with noticeable artifacts. For instance, the "power-saving mode" on smartphones uniformly lowers the pixel luminance across the display and, as a result, presents an overall darkened visual perception to users if directly applied to VR content. Our key insight is that VR display power reduction must be cognizant of the gaze-contingent nature of high field-of-view VR displays. To that end, we present a gaze-contingent system that, without degrading luminance, minimizes the display power consumption while preserving high visual fidelity when users actively view immersive video sequences. This is enabled by constructing 1) a gaze-contingent color discrimination model through psychophysical studies, and 2) a display power model (with respect to pixel color) through real-device measurements. Critically, due to the careful design decisions made in constructing the two models, our algorithm is cast as a constrained optimization problem with a closed-form solution, which can be implemented as a real-time, image-space shader. We evaluate our system using a series of psychophysical studies and large-scale analyses on natural images. Experiment results show that our system reduces the display power by as much as 24% (14% on average) with little to no perceptual fidelity degradation. [kERLm8K433] Bibtex @article{Duinkharjav:2022:VRPowerSaver, title = {Color-Perception-Guided Display Power Reduction for Virtual Reality}, author = {Duinkharjav, Budmonde and Chen, Kenneth and Tyagi, Abhishek and He, Jiayi and Zhu, Yuhao and Sun, Qi}, journal = {ACM Trans. Graph. (Proc. SIGGRAPH Asia)}, volume = {41}, number = {6}, pages = {144:1-144:16}, year = {2022} } Share this entry * Share on Twitter * Share on LinkedIn * Share by Mail https://www.immersivecomputinglab.org/wp-content/uploads/2022/09/ kERLm8K433pRmoH1-1.jpg 667 1000 Qi Sun https:// www.immersivecomputinglab.org/wp-content/uploads/2021/01/ nyu-logo-1.jpg Qi Sun2022-09-22 02:59:572022-09-23 18:50:19 Color-Perception-Guided Display Power Reduction for Virtual Reality Research Color-Perception-Guided Display Power Reduction for Virtual Reality Force-aware interface via electromyography for natural VR/AR interaction FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency Joint Neural Phase Retrieval and Compression for Energy- and Computation-efficient Holography on the Edge Tailored Reality: Perception-Aware Scene Restructuring for Adaptive VR Navigation Larger visual changes compress time: The inverted effect of asemantic visual features on interval time perception Modeling and Optimizing Human-in-the-Loop Visual Perception Using Immersive Displays: A Review Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming Leveraging Human Visual Perception for an Optimized Virtual Reality Experience Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays Deep Multi Depth Panoramas for View Synthesis Has Half the Time Passed? Investigating Time Perception at Long Scales DiffTaichi: Differentiable Programming for Physical Simulation NYU tandon logo QI SUN Assistant Professor Computer Science and Engineering Center for Urban Science and Progress NYU Tandon School of Engineering 370 Jay Street Brooklyn, NY 11201 qisun@nyu.edu (c) Copyright Immersive Computing Lab. Site by Academic Web Pages * Twitter * Google_scholar Scroll to top