Granted Patent B2

US 12,481,160 · App. 18/627,219 · Granted Nov 25, 2025

Inventors: Heather Michelle Martin (Wilton Manors, FL); Kevin John O'Brien (Plantation, FL); Pedro Luis Arroyo (Fort Lauderdale, FL); Flavio Deoliveira (Redding, CA)

Assignee: Magic Leap, Inc.

G02B27/0172G02B27/0093G02B2027/0127G02B2027/0138G02B2027/014G02B2027/0178

Abstract

Claims (34)

1 . A head mounted display system for displaying image content to a user, the display system comprising:

a frame;

a wearable display coupled to the frame and configured to present virtual content to first and second eyes of a user;

a speaker coupled to the frame and positioned in proximity to a first or second ear of the user;

a first inward facing camera configured to image the first eye of the user;

a second inward facing camera configured to image the second eye of the user; and

a processing module coupled to the frame and in electronic communication with the first and second inward facing cameras and the wearable display, the processing module comprising one or more processing electronics configured to:

present virtual content to the user on the wearable display in a first configuration;

using the first inward facing camera or the second inward facing camera, determine that the user has performed a gesture; and

based on determining that the user has performed the gesture, present virtual content to the user on the wearable display in a second configuration,

wherein presenting virtual content to the user on the wearable display in a second configuration comprises altering a state of the head mounted display system to modify a manner in which virtual content is presented to the user, and

wherein the manner in which virtual content is presented to the user includes a color palette used to provide color to the virtual content.

2 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises:

determining that at least one of the first eye or the second eye of the user is at least partially closed for longer than a threshold time.

3 . The display system of claim 2 , wherein the processing module is configured to use glints on the first and second eyes to determine whether the first and second eyes are at least partially closed.

4 . The display system of claim 2 , wherein based on the determination that the first and second eyes of the user are at least partially closed, the processing module is configured to alter a state of the head mounted display system so as to modify a performance feature of the head mounted display system apparent to the user.

5 . The display system of claim 4 , wherein a performance feature of the head mounted display system apparent to the user includes audio characteristics.

6 . The display system of claim 5 , wherein the audio characteristics include volume, which speaker a particular sound emanates from, balance between speakers, or any combination thereof.

7 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises:

determining a gaze direction of at least one of the first eye or the second eye; and

determining a vergence of the first eye and of the second eye.

8 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises:

determining that at least one of the first eye or the second eye are fully closed for longer than a threshold time.

9 . The display system of claim 8 , wherein the threshold time is in a range from 500 milliseconds to 1.5 seconds.

10 . The display system of claim 8 , wherein the threshold time is in a range from 750 milliseconds to 2 seconds.

11 . The display system of claim 8 , wherein the threshold time is in a range from 1 second to 3 seconds.

12 . The display system of claim 8 , wherein the threshold time is in a range from 3 seconds to 10 seconds.

13 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises:

determining that at least one of the first eye or the second eye blinked.

14 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises:

determining that at least one of the first eye or the second eye squinted.

15 . The display system of claim 1 , wherein determining that the user has performed a gesture comprises determining, by the first inward facing camera or the second inward facing camera, whether a pupil or iris of the user is partially or fully blocked.

16 . The display system of claim 1 , wherein presenting virtual content to the user on the wearable display in a second configuration comprises altering a state of the head mounted display system to modify the virtual content presented to the user.

17 . The display system of claim 1 , wherein the processing module is configured to display buttons, knobs, windows, menu items, or other regions toward which the user can direct a gaze to make a selection.

Assignments (4)

Continuity (4)

References Cited (253)