IP Library Granted Patent US 12,067,209
Granted Patent B2
US 12,067,209 · App. 18/148,316 · Granted Aug 20, 2024

Light-emitting user input device for calibration or pairing

Inventors: James M. Powderly (Ft. Lauderdale, FL); Savannah Niles (Ft. Lauderdale, FL); Christopher David Nesladek (San Francisco, CA); Isioma Osagbemwenorue Azu (Ft. Lauderdale, FL); Marshal Ainsworth Fontaine (St. Augustine, FL); Haney Awad (Miami, FL); William Wheeler (Ft. Lauderdale, FL); Brian David Schwab (Sunrise, FL); Brian Edward Oliver Bucknor (Miramar, FL)
Assignee: Magic Leap, Inc.
G06F3/04815G02B27/0172G06F3/011G06F3/016G06F3/017G06F3/02G06F3/0308G06F3/0346G06F3/03547G06F3/038G06F3/041G06F3/04847G06F3/04883G06F3/04886G06T19/006G06V10/145G06V20/20G06V40/18G09G3/32G02B2027/0178G06F2203/0384G06F2203/04103G06F2203/04105G09G2320/0626G09G2354/00H04W4/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,067,209
App. No.
18/148,316
Granted
Aug 20, 2024
Kind
B2
Abstract

A light emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Claims (35)

1. A light-emitting user input device for providing user input to a display system including a wearable display device, the light-emitting user input device comprising:

a plurality of interactable regions, including a central touch surface, configured to receive user inputs;

a light-emitting assembly comprising a light guide outside of and surrounding the central touch surface; and

a hardware processor communicatively coupled to the plurality of interactable regions and the light emitting assembly, the hardware processor to:

detect an actuation of the light-emitting user input device by a user of the wearable display device;

access contextual information indicating a virtual object that is being presented through the wearable display device and that the user is currently interacting with;

determine an interactable region among the plurality of interactable regions corresponding to the actuation;

based at least partly on the contextual information, translate the actuation into a user input for performing a user interface operation associated with the virtual object being interacted with, wherein the user interface operation is based at least on the virtual object being interacted with, a type of the actuation, and the interactable region associated with the actuation; and

instruct the light emitting assembly to illuminate a light pattern in response to the user input.

2. The light-emitting user input device of claim 1 , wherein

the plurality of interactable regions comprises

a first interactable region associated with the light guide and

a second interactable region associated with the central touch surface.

3. The light-emitting user input device of claim 2 , wherein in response to a detection that the user actuated the first interactable region, the hardware processor is programmed to cause the light emitting assembly to illuminate a first light pattern associated with the user input in the first interactable region, and wherein in response to a detection that the user actuated the second interactable region, the hardware processor is programmed to cause the light emitting assembly to illuminate a second light pattern associated with the user input in the second interactable region.

4. The light-emitting user input device of claim 1 , wherein the light pattern is determined based at least partly on the contextual information.

5. The light-emitting user input device of claim 1 , wherein the actuation comprises at least one of: a swipe, a tap, a press, or a touch gesture.

6. The light-emitting user input device of claim 1 , wherein the light pattern comprises an arcuate region having one or more of a color, an arcuate length, or a visual effect.

7. The light-emitting user input device of claim 1 , wherein the hardware processor is further programmed to communicate with display system causing the display system to perform the user interface operation based on the user input.

8. A method comprising:

under control of a hardware processor:

detecting an actuation of a light-emitting user input device by a user of a wearable display device,

wherein the light-emitting user input device is configured to provide user input to a display system including the wearable display device, and

wherein the light-emitting user input device comprises a plurality of interactable regions, including a central touch surface, configured to receive inputs, and a light emitting assembly comprising a light guide outside of and surrounding the central touch surface;

accessing contextual information indicating a virtual object that is being presented through the wearable display device and that the user is currently interacting with;

determining an interactable region among the plurality of interactable regions corresponding to the actuation;

translating the actuation into a user input for performing a user interface operation based at least on the contextual information, wherein the user interface operation is associated with the virtual object being interacted with, and wherein the user interface operation is determined based at least on the virtual object being interacted with, a type of the actuation, and the interactable region associated with the actuation; and

causing the light emitting assembly to illuminate a light pattern in response to the user input.

9. The method of claim 8 , wherein the plurality of interactable regions comprises a first interactable region supporting a first type of user input and a second interactable region supporting a second type of user input.

10. The method of claim 9 , wherein in response to a detection that the user actuated the first interactable region, the hardware processor is programmed to cause the light emitting assembly to illuminate a first light pattern associated with the user input in the first interactable region, and wherein in response to a detection that the user actuated the second interactable region, the hardware processor is programmed to cause the light emitting assembly to illuminate a second light pattern associated with the user input in the second interactable region.

11. The method of claim 9 , wherein at least one of the first type of user input or the second type of user input is dependent on the contextual information, and wherein the contextual information comprises at least one of a type of application with which a user is interacting, available user inputs supported by the plurality of interactable regions, or a virtual environment of the user.

12. The method of claim 8 , wherein the light-emitting user input device comprises the central touch surface which is divided into one or more interactable regions.

13. The method of claim 8 , wherein the light pattern is determined based at least partly on the contextual information.

14. The method of claim 8 , wherein the plurality of interactable region comprises the light emitting assembly of the light-emitting user input device.

15. The method of claim 8 , wherein the actuation comprises at least one of: a swipe, a tap, a press, or a touch gesture.

16. The method of claim 8 , wherein the light pattern comprises an arcuate region having one or more of a color, an arcuate length, or a visual effect.

Assignments (4)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2023
From: POWDERLY, JAMES M; NILES, SAVANNAH; NESLADEK, CHRISTOPHER DAVID; AZU, ISIOMA OSAGBEMWENORUE; FONTAINE, MARSHAL AINSWORTH; AWAD, HANEY; SCHWAB, BRIAN DAVID; BUCKNOR, BRIAN EDWARD OLIVER
To: MAGIC LEAP, INC.
Reel/Frame 063036/0345 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2023
From: WHEELER, WILLIAM
To: MAGIC LEAP, INC.
Reel/Frame 063036/0442 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
Continuity (5)
Continuation 15965696 · Apr 27, 2018
Continuation 17384663 · Jul 23, 2021
Continuation 15965702 · Apr 27, 2018
Provisional Application 62490863 · Apr 27, 2017
Related Publication 20230221831A1 · Jul 13, 2023
Cited By (1)
US 12,394,115