IP Library Granted Patent US 12,205,192
Granted Patent B2
US 12,205,192 · App. 17/398,480 · Granted Jan 21, 2025

Reduce power by frame skipping

Inventors: Balaji Vembu (Folsom, CA); Nikos Kaburlasos (Lincoln, CA); Josh B. Mastronarde (Sacramento, CA)
Assignee: INTEL CORPORATION
G06T1/20G06F1/3203G06F1/3231G06F1/3234G06F1/3265G06T1/60G09G2330/021G09G2340/0435G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,192
App. No.
17/398,480
Granted
Jan 21, 2025
Kind
B2
Abstract

In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive an input from one or more detectors proximate a display to present an output from a graphics pipeline, determine that a user is not interacting with the display, and in response to a determination that the user is not interacting with the display, to reduce a frame rendering rate of the graphics pipeline. Other embodiments are also disclosed and claimed.

Claims (58)

1. An apparatus comprising:

processor circuitry coupled to a memory, the processor circuitry to:

receive an input from a camera communicatively coupled to the processor circuitry;

determine, based on the input, lack of interaction with an object approaching the apparatus, wherein the input includes an image input representing the object, wherein whether the object is within a predetermined distance of the apparatus is determined based on a proximity indication; and

upon determining the lack of interaction, terminate graphics workload on a first set of processing resources;

receive a first indication or a second indication, wherein the first indication to indicate that the object approaching the apparatus is within a predetermined distance of the apparatus; and

in response to the first indication, process the graphics workload on a second set of processing resources to reduce a frame rendering rate of a graphics pipeline communicatively coupled to a display, or in response to a second indication that the object is not within the predetermine distance of the apparatus, continue to process the graphics workload on the first set of processing resources.

2. The apparatus of claim 1 , wherein the processor circuitry is further to:

determine whether the input of the camera includes a human input, and in response to the input not being the human input, process the graphics workload on the second set of processing resources;

convert image data from the camera to a histogram, wherein the image data relates to and represents the object; and

compare the histogram to preconfigured histogram data in a local memory.

3. The apparatus of claim 1 , wherein the processor circuitry is further to:

determine whether the input of the camera includes the human input, and in response to the input being the human input activate at least one face-recognition module;

convert the image data from the camera to the histogram, wherein the image data relates to and represents the object; and

compare the histogram to preconfigured histogram data in the local memory.

4. The apparatus of claim 1 , wherein the processor circuitry is further to:

determine whether the input includes an image of a face interacting with the display, and in response the image not including the face interacting with the display, process the graphics workload on the second set of processing resources; and

in response to the image including the face interacting with the display, process the graphics workload on the first set of processing resources at the first frame rate to maintain a full frame rendering rate of the graphics pipeline.

5. The apparatus of claim 4 , wherein the processor circuitry is further to:

determine whether the face is that of an authorized user, and in response to the face not being that of the authorized user, terminate frame rendering of the graphics pipeline, wherein the processor circuitry includes graphics processor circuitry coupled to application processor circuitry.

6. A method comprising

receiving, by a processor of a computing device, an input from a camera communicatively coupled to the computing device;

determining, based on the input, lack of interaction with an object approaching the computing device, wherein the input includes an image input representing the object, wherein whether the object is within a predetermined distance of the computing device is determined based on a proximity indication; and

upon determining the lack of interaction, terminating graphics workload on a first set of processing resources;

receiving a first indication or a second indication, wherein the first indication to indicate that the object approaching the apparatus is within a predetermined distance of the apparatus; and

in response to the first indication, processing the graphics workload on a second set of processing resources to reduce a frame rendering rate of a graphics pipeline communicatively coupled to a display, or in response to a second indication that the object is not within the predetermine distance of the apparatus, continuing to process the graphics workload on the first set of processing resources.

7. The method of claim 6 , further comprising:

determining whether the input of the camera includes a human input, and in response to the input not being the human input, process the graphics workload on the second set of processing resources;

converting image data from the camera to a histogram, wherein the image data relates to and represents the object; and

comparing the histogram to preconfigured histogram data in a local memory.

8. The method of claim 6 , further comprising:

determining whether the input of the camera includes the human input, and in response to the input being the human input activate at least one face-recognition module;

converting the image data from the camera to the histogram, wherein the image data relates to and represents the object; and

comparing the histogram to preconfigured histogram data in the local memory.

9. The method of claim 6 , further comprising:

determining whether the input includes an image of a face interacting with the display, and in response the image not including the face interacting with the display, process the graphics workload on the second set of processing resources; and

in response to the image including the face interacting with the display, processing the graphics workload on the first set of processing resources at the first frame rate to maintain a full frame rendering rate of the graphics pipeline.

10. The method of claim 9 , further comprising:

determining whether the face is that of an authorized user, and in response to the face not being that of the authorized user, terminate frame rendering of the graphics pipeline, wherein the processor includes a graphics processor coupled to an application processor.

11. The computer-readable medium of claim 6 , wherein the operations further comprise:

determining whether the face is that of an authorized user, and in response to the face not being that of the authorized user, terminate frame rendering of the graphics pipeline, wherein the processor includes a graphics processor coupled to an application processor.

12. At least one computer-readable medium having stored thereon instructions which, when executed, cause a computing device to perform operations comprising:

receiving an input from a camera communicatively coupled to the computing device;

determining, based on the input, lack of interaction with an object approaching the computing device, wherein the input includes an image input representing the object, wherein whether the object is within a predetermined distance of the computing device is determined based on a proximity indication;

upon determining the lack of interaction, terminating graphics workload on a first set of processing resources;

receiving a first indication or a second indication, wherein the first indication to indicate that the object approaching the apparatus is within a predetermined distance of the apparatus; and

in response to the first indication, processing the graphics workload on a second set of processing resources to reduce a frame rendering rate of a graphics pipeline communicatively coupled to a display, or in response to a second indication that the object is not within the predetermine distance of the apparatus, continuing to process the graphics workload on the first set of processing resources.

13. The computer-readable medium of claim 12 , wherein the operations further comprise:

determining whether the input of the camera includes a human input, and in response to the input not being the human input, process the graphics workload on the second set of processing resources;

converting image data from the camera to a histogram, wherein the image data relates to and represents the object; and

comparing the histogram to preconfigured histogram data in a local memory.

14. The computer-readable medium of claim 12 , wherein the operations further comprise:

determining whether the input of the camera includes the human input, and in response to the input being the human input activate at least one face-recognition module;

converting the image data from the camera to the histogram, wherein the image data relates to and represents the object; and

comparing the histogram to preconfigured histogram data in the local memory.

15. The computer-readable medium of claim 12 , wherein the operations further comprise:

determining whether the input includes an image of a face interacting with the display, and in response the image not including the face interacting with the display, process the graphics workload on the second set of processing resources; and

in response to the image including the face interacting with the display, processing the graphics workload on the first set of processing resources at the first frame rate to maintain a full frame rendering rate of the graphics pipeline.

Continuity (3)
Continuation 16791138 · Feb 14, 2020
Continuation 15495956 · Apr 24, 2017
Related Publication 20220067874A1 · Mar 3, 2022
References Cited (37)
US 7873812B1 · Mimar · 2011 [cited by applicant]
US 9275601B2 · Kaburlasos et al. · 2016 [cited by applicant]
US 9633251B2 · Yi et al. · 2017 [cited by applicant]
US 10528864B2 · Dally et al. · 2020 [cited by applicant]
US 10565671B2 · Vembu · 2020 [cited by applicant]
US 10860922B2 · Dally et al. · 2020 [cited by applicant]
US 10891538B2 · Dally et al. · 2021 [cited by applicant]
US 11094033B2 · Vembu · 2021 [cited by examiner]
US 20130342537A1 · Vorhies · 2013 [cited by applicant]
US 20140160136A1 · Kaburlasos et al. · 2014 [cited by applicant]
US 20140267034A1 · Krulce · 2014 [cited by examiner]
US 20140372737A1 · Yang · 2014 [cited by examiner]
US 20150128256A1 · Nakao · 2015 [cited by applicant]
US 20150362986A1 · Lee et al. · 2015 [cited by applicant]
US 20160062947A1 · Chetlur et al. · 2016 [cited by applicant]
US 20170235357A1 · Leung · 2017 [cited by examiner]
US 20180004275A1 · Tubbs et al. · 2018 [cited by applicant]
US 20180046245A1 · Schwarz et al. · 2018 [cited by applicant]
US 20180046906A1 · Dally et al. · 2018 [cited by applicant]
CN 101800018A1 · 2010 [cited by applicant]
CN 105518746A · 2016 [cited by applicant]
CN 108734639A · 2018 [cited by applicant]
EP 2315439A1 · 2011 [cited by applicant]
EP 3396490A1 · 2018 [cited by applicant]
Goodfellow, et al. “Adaptive Computation and Machine Learning Series”, Book, Nov. 18, 2016, pp. 98-165, Chapter 5, The MIT Press, Cambridge, MA. [cited by applicant]
Ross, et al. “Intel Processor Graphics: Architecture & Programming”, Power Point Presentation, Aug. 2015, 78 pages, Intel Corporation, Santa Clara, CA. [cited by applicant]
Shane Cook, “CUDA Programming”, Book, 2013, pp. 37-52, Chapter 3, Elsevier Inc., Amsterdam Netherlands. [cited by applicant]
Nicholas Wilt, “The CUDA Handbook; A Comprehensive Guide to GPU Programming”, Book, Jun. 22, 2013, pp. 41-57, Addison-Wesley Professional, Boston, MA. [cited by applicant]
Stephen Junking, “The Compute Architecture of Intel Processor Graphics Gen9”, paper, Aug. 14, 2015, 22 pages, Version 1.0, Intel Corporation, Santa Clara, CA. [cited by applicant]
Communication Pursuant to Article 94(3) EPC for EP Application No. 18 162 606.0 mailed Sep. 9, 2020, 10 pages. [cited by applicant]
Nixon Kent W et al: “Scope—quality retaining display rendering workload scaling based on user-smartphone distance”, 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD), ACM, Nov. 7, 2016 (Nov. 7, 201… [cited by applicant]
Minkyu Kim et al: “Cost-effective frame rate control for mobile GPUs”, Nov. 28, 2016; 1077952576-1077952576, Nov. 28, 2016 (Nov. 28, 2016), pp. 1-2, XP058307652, DOI: 10.1145/3005274.3005325, ISBN: 978-1-4503-4540-8. [cited by applicant]
Liu X et al: “Face Detection Using Spectral Histograms and SVMs”, IEEE Transactions on Systems, Man and Cybernetics. Part B:Cybernetics, IEEE Service Center, Piscataway, Nu, US, vol. 35, No. 3, Jun. 1, 2005 (Jun. 1, 200… [cited by applicant]
Extended European Search Report for Application No. 18162606.0-1221, mailed Sep. 24, 2018, 9 pages. [cited by applicant]
1st Office Action and Search Report in CN Application No. 201810366058.6, mailed Feb. 18, 2024, 12 pages. No translation available. [cited by applicant]
2nd Office Action in CN Application No. 201810366058.6, mailed Jul. 5, 2024, 12 pages. [cited by applicant]
Translation of Third Office Action and Search Report issued in CN Application No. 201810366058.6, mailed Sep. 29, 2024, 15 pages. [cited by applicant]