IP Library Granted Patent US 10,628,912
Granted Patent B2
US 10,628,912 · App. 16/392,561 · Granted Apr 21, 2020

Graphics energy profiling system and method

Inventors: Yu Charlie Hu (West Lafayette, IN); Ning Ding (Santa Clara, CA)
Assignee: Purdue Research Foundation
G06T1/20G06F1/28G06F9/451G06F11/3024G06F11/3058G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,912
App. No.
16/392,561
Granted
Apr 21, 2020
Kind
B2
Abstract

A method for profiling energy usage in graphics user interface (UI) update in handheld mobile devices is disclosed. The method includes mapping the pixel changes of each frame to a responsible UI update, identifying method invocations at all layers of the UI rendering stack, tracking asynchronous dependence across all layers of the UI rendering stack corresponding to each UI update by assigning a unique frame identification (ID) per frame refresh to track asynchronous dependence between UI updates and corresponding callbacks across all layers of the UI rendering stack, tracking information flow across a corresponding graphics processing unit (GPU) by using an OpenGL record-and-replay method, reconstructing the frames by replaying the OpenGL calls on the GPU during post processing, comparing frames to account for pixel changes, and tracking and attributing the energy usage during UI operations to individual UI updates.

Claims (15)

1. A method for profiling energy usage and visual effect of a graphics user interface (UI) update in handheld mobile devices, comprising:

mapping pixel changes of each frame to a responsible UI update;

identifying method invocations at all layers of a UI rendering stack corresponding to each UI update, comprising:

tracking asynchronous dependence across all of the layers of the UI rendering stack corresponding to each UI update by assigning a unique frame identification (frame-ID) per frame refresh and a unique view identification (view-ID) to track the asynchronous dependence between the UI update and its corresponding callbacks across all of the layers of the UI rendering stack

tracking information flow across a corresponding graphics processing unit (GPU) by using an OpenGL record-and-replay method, comprising:

recording OpenGL calls along with associated view-IDs and frame-IDs but not the frames during energy profiling,

reconstructing the frames by replaying the OpenGL calls on the corresponding GPU during post processing; and

comparing the frames to account for the mapped pixel changes by each UI update, and;

tracking and accounting the energy usage during each frame rendering interval, comprising:

tracking a corresponding central processing unit (CPU) energy usage,

tracking the corresponding GPU energy usage, and

accounting the energy usage to the individual UI updates to an associated frame.

2. The method of claim 1 , wherein accounting the energy usage to the individual UI updates to an associated frame comprises:

tracking and adding up the CPU energy usage by all the identified method invocations corresponding to each UI update, and

splitting the GPU energy among the UI updates based on the corresponding OpenGL call view-IDs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2020
From: HU, Y. CHARLIE; DING, NING
To: PURDUE RESEARCH FOUNDATION
Reel/Frame 052068/0307 →
Continuity (2)
Provisional Application 62661314 · Apr 23, 2018
Related Publication 20190325550A1 · Oct 24, 2019