IP Library Granted Patent US 12,189,122
Granted Patent B2
US 12,189,122 · App. 18/413,714 · Granted Jan 7, 2025

Head-mounted display systems with power saving functionality

Inventors: Carlos A. Rivera Cintron (Lake Worth, FL); Gregory Link (Charlotte, NC); Jeffrey Scott Sommers (Mountain View, CA); Matthew Thomas Hull (Parkland, FL); Jose Felix Rodriguez (Hialeah, FL); Ricardo Martinez Perez (Plantation, FL)
Assignee: MAGIC LEAP, INC.
G02B27/0093G02B27/017G06F1/3218G06F1/3231G06F1/3265
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,122
App. No.
18/413,714
Granted
Jan 7, 2025
Kind
B2
Abstract

Head-mounted display systems with power saving functionality are disclosed. The systems can include a frame configured to be supported on the head of the user. The systems can also include a head-mounted display disposed on the frame, one or more sensors, and processing electronics in communication with the display and the one or more sensors. In some implementations, the processing electronics can be configured to cause the system to reduce power of one or more components in response to at least in part on a determination that the frame is in a certain position (e.g., upside-down or on top of the head of the user). In some implementations, the processing electronics can be configured to cause the system to reduce power of one or more components in response to at least in part on a determination that the frame has been stationary for at least a threshold period of time.

Claims (37)

1. A head-mounted display system configured to project light to an eye of a user to display augmented reality image content in a vision field of said user, said head-mounted display system comprising:

a frame configured to be supported on a head of the user in an upright position;

a head-mounted display disposed on the frame, said display configured to project light into said user's eye to display augmented reality image content to the user's vision field, at least a portion of said display being transparent and disposed at a location in front of the user's eye when the user wears the frame in the upright position such that said transparent portion transmits light from a portion of the environment in front of the user and said head-mounted display to the user's eye to provide a view of said portion of the environment in front of the user and said head-mounted display;

one or more sensors comprising an inward-facing imaging system and/or an outward-facing imaging system; and

processing electronics in communication with the display and the one or more sensors, the processing electronics configured to:

receive a signal from the one or more sensors;

determine whether the frame is on top of the head of the user based at least in part on the signal received from the one or more sensors by:

receiving images from the inward-facing imaging system and/or the outward-facing imaging system; and

analyzing the images to determine whether the frame is on top of the head of the user; and

cause the head-mounted display system to reduce power of one or more components of the head-mounted display system in response to at least in part on a determination that the frame is on the top of the head of the user.

2. The display system of claim 1 , wherein the processing electronics is further configured to:

determine whether the frame has been stationary for a period of time greater than or equal to a threshold period of time; and

cause the head-mounted display system to reduce the power of the one or more components of the head-mounted display system in response to at least in part on a determination that the frame has been stationary for the period of time greater than or equal to the threshold period of time.

3. The display system of claim 2 , wherein the one or more sensors comprise one or more motion sensors configured to measure change in position of the frame.

4. The display system of claim 3 , wherein the processing electronics is configured to determine whether the frame has been stationary for the period of time greater than or equal to the threshold period of time by:

receiving measurements from the one or more motion sensors; and

analyzing the received measurements to determine whether the frame has not moved for the period of time greater than or equal to the threshold period of time, wherein the frame has been stationary for the period of time greater than or equal to the threshold period of time if the frame has not changed position for at least the threshold period of time.

5. The display system of claim 1 , wherein the processing electronics is configured to determine whether the frame has been stationary for the period of time greater than or equal to the threshold period of time by:

receiving images in sequence from the inward-facing imaging system and/or the outward-facing imaging system; and

analyzing the received images to determine whether the frame has not moved for the period of time greater than or equal to the threshold period of time, wherein the frame has been stationary for the period of time greater than or equal to the threshold period of time if the images have not changed for at least the threshold period of time.

6. The display system of claim 1 , wherein processing electronics is configured to cause the display system to reduce the power of the one or more components by dimming or turning off a light source of the display.

7. The display system of claim 1 , wherein processing electronics is configured to cause the display system to reduce the power of the one or more components by reducing a refresh rate associated with the display.

8. The display system of claim 1 , wherein processing electronics is configured to cause the display system to reduce the power of the one or more components by reducing the power of the one or more sensors.

9. The display system of claim 1 , wherein processing electronics is configured to cause the display system to reduce the power of the one or more components by causing the display system to enter a sleep mode.

10. The display system of claim 1 , wherein the display system is configured to provide an alert to the user indicating that the display system is reducing the power of the one or more components of the display system.

11. The display system of claim 1 , wherein the processor is further configured to cause the display system to increase the power of the one or more components in response to at least in part on a determination that the frame is no longer on top of the head of the user.

12. The display system of claim 11 , where the processor is configured to cause the display system to increase the power of the one or more components in response to at least in part on a determination that the frame is supported on the head of the user such that said display is configured to project light into said user's eye to display augmented reality image content to the user's vision field.

13. The display system of claim 1 , wherein the inward-facing imaging system and/or the outward-facing imaging system is/are configured to sense the user and/or the surroundings of the user even when the power of the one or more components has been reduced.

14. A head-mounted display system configured to project light to an eye of a user to display augmented reality image content in a vision field of said user, said head-mounted display system comprising:

a frame configured to be supported on a head of the user in an upright position;

a head-mounted display disposed on the frame, said display configured to project light into said user's eye to display augmented reality image content to the user's vision field, at least a portion of said display being transparent and disposed at a location in front of the user's eye when the user wears the frame in the upright position such that said transparent portion transmits light from a portion of the environment in front of the user and said head-mounted display to the user's eye to provide a view of said portion of the environment in front of the user and said head-mounted display;

one or more sensors comprising an inward-facing imaging system configured to sense one or more facial features of the user; and

processing electronics in communication with the display and the one or more sensors, the processing electronics configured to:

receive a signal from the one or more sensors;

determine whether the frame is on top of the head of the user based at least in part on the signal received from the one or more sensors by:

receiving images from the inward-facing imaging system; and

analyzing the images to identify one or more periocular features, wherein the frame is not on the top of the head of the user if the one or more periocular features are identified in the images.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2024
From: RIVERA CINTRON, CARLOS A.; LINK, GREGORY MICHAEL; SOMMERS, JEFFREY SCOTT; HULL, MATTHEW THOMAS; RODRIGUEZ, JOSE FELIX; PEREZ, RICARDO MARTINEZ
To: PACCAR INC
Reel/Frame 068806/0923 →
Continuity (4)
Continuation 18176333 · Feb 28, 2023
Continuation 17252099
Provisional Application 62686586 · Jun 18, 2018
Related Publication 20240151965A1 · May 9, 2024
References Cited (116)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US D514570S · Ohta · 2006 [cited by applicant]
US 9081177B2 · Wong et al. · 2015 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9185062B1 · Yang et al. · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US D752529S · Loretan et al. · 2016 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US 9355315B2 · Vugdelija et al. · 2016 [cited by applicant]
US D759657S · Kujawski et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US D794288S · Beers et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US D805734S · Fisher et al. · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 10163011B2 · Kaehler et al. · 2018 [cited by applicant]
US 10187607B1 · Delachanal · 2019 [cited by applicant]
US 10262462B2 · Miller et al. · 2019 [cited by applicant]
US 10986270B2 · Smith et al. · 2021 [cited by applicant]
US 11237409B2 · Lore et al. · 2022 [cited by applicant]
US 20040104864A1 · Nakada · 2004 [cited by applicant]
US 20050237230A1 · Bejean · 2005 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20080125288A1 · Case · 2008 [cited by applicant]
US 20110221913A1 · Nagai et al. · 2011 [cited by applicant]
US 20120062445A1 · Haddick et al. · 2012 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120206443A1 · Kimura · 2012 [cited by examiner]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130100601A1 · Griffin et al. · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130119255A1 · Dickinson et al. · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20130293447A1 · Bickerstaff et al. · 2013 [cited by applicant]
US 20130335301A1 · Wong et al. · 2013 [cited by applicant]
US 20140003762A1 · Macnamara · 2014 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140145914A1 · Latta et al. · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140256303A1 · Jones · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150084857A1 · Kimura · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150116453A1 · Hirata et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150190052A1 · Vaitaitis · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150277121A1 · Fridental · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · Tekolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160025971A1 · Crow et al. · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160072540A1 · Davis et al. · 2016 [cited by applicant]
US 20160249864A1 · Kang et al. · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20170109984A1 · Child et al. · 2017 [cited by applicant]
US 20170255259A1 · Mor · 2017 [cited by applicant]
US 20180005034A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180053284A1 · Rodriguez et al. · 2018 [cited by applicant]
US 20180088340A1 · Amayeh et al. · 2018 [cited by applicant]
US 20180096503A1 · Kaehler et al. · 2018 [cited by applicant]
US 20180196934A1 · Löthgren et al. · 2018 [cited by applicant]
US 20180205773A1 · Miller · 2018 [cited by applicant]
US 20180206062A1 · Jain et al. · 2018 [cited by applicant]
US 20180239413A1 · Ishikawa · 2018 [cited by examiner]
US 20180341811A1 · Bendale et al. · 2018 [cited by applicant]
US 20180376045A1 · Weckel et al. · 2018 [cited by applicant]
US 20190243472A1 · Stafford et al. · 2019 [cited by applicant]
US 20190365285A1 · Kashimoto et al. · 2019 [cited by applicant]
US 20190387168A1 · Smith et al. · 2019 [cited by applicant]
US 20210263309A1 · Rivera Cintron et al. · 2021 [cited by applicant]
JP 2017102946A · 2017 [cited by applicant]
WO 2016073734A1 · 2016 [cited by applicant]
WO 2016107963A1 · 2016 [cited by applicant]
WO 2017031246A1 · 2017 [cited by applicant]
WO 2017153772A1 · 2017 [cited by applicant]
WO 2017153778A1 · 2017 [cited by applicant]
WO 2018104732A1 · 2018 [cited by applicant]
WO 2018217008A1 · 2018 [cited by applicant]
WO 2019246044A1 · 2019 [cited by applicant]
WO 2019246058A1 · 2019 [cited by applicant]
WO 2019246129A2 · 2020 [cited by applicant]
ARToolKit: htpps://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” [cited by applicant]
Azuma, “Predictive Tracking for Augmented Reality,” TR95-007, Dissertation, Doctor of Philosophy, UNC-Chapel Hill, North Carolina, Department of Computer Science, Feb. 1995. (262 pages). [cited by applicant]
Bimber et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005. (393 pages). [cited by applicant]
International Preliminary Report on Patentability, dated Dec. 22, 2020 for International Application No. PCT/US2019/037773. (7 pages). [cited by applicant]
International Preliminary Report on Patentability, dated Dec. 22, 2020, for International Application No. PCT/US2019/037661. (6 pages). [cited by applicant]
International Search Report and Written Opinion, dated Oct. 17, 2019 for PCT Application No. PCT/US2019/037676. (15 pages). [cited by applicant]
International Search Report and Written Opinion, dated Sep. 4, 2019 for PCT Application No. PCT/US2019/037773. (9 pages). [cited by applicant]
International Search Report and Written Opinion, dated Sep. 4, 2019, for International Application No. PCT/US2019/037661. (13 pages). [cited by applicant]
Jacob, “Eye Tracking in Advance Interface Design,” [cited by applicant]
Office Action, dated Jan. 5, 2022, for U.S. Appl. No. 16/973,004, Pedroza et al., “Systems and Methods for Temporarily Disabling User Control Interfaces During Attachment of an Electronic Device”. (25 pages). [cited by applicant]
Office Action, dated Jun. 8, 2022, for U.S. Appl. No. 16/973,004, Pedroza et al., “Systems and Methods for Temporarily Disabling User Control Interfaces During Attachment of an Electronic Device”. (28 pages). [cited by applicant]
Office Action, dated Oct. 27, 2022, for U.S. Appl. No. 16/973,004, Pedroza et al., “Systems and Methods for Temporarily Disabling User Control Interfaces During Attachment of an Electronic Device”. (26 pages). [cited by applicant]
Tanriverdi et al., “Interacting with Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, Ma, [cited by applicant]
Cited By (1)
US 12,591,135