IP Library Granted Patent US 11,573,677
Granted Patent B2
US 11,573,677 · App. 17/384,663 · Granted Feb 7, 2023

Light-emitting user input device for calibration or pairing

Inventors: James M. Powderly (Ft. Lauderdale, FL); Savannah Niles (Ft. Lauderdale, FL); Christopher David Nesladek (San Francisco, CA); Isioma Osagbemwenorue Azu (Ft. Lauderdale, FL); Marshal Ainsworth Fontaine (St. Augustine, FL); Haney Awad (Ft. Lauderdale, FL); William Wheeler (Ft. Lauderdale, FL); Brian David Schwab (Sunrise, FL); Brian Edward Oliver Bucknor (Miramar, FL)
Assignee: Magic Leap, Inc.
G06F3/04815G02B27/0172G06F3/011G06F3/016G06F3/017G06F3/02G06F3/0308G06F3/038G06F3/0346G06F3/03547G06F3/041G06F3/04847G06F3/04883G06F3/04886G06T19/006G06V10/145G06V20/20G06V40/18G09G3/32G02B2027/0178G06F2203/0384G06F2203/04103G06F2203/04105G09G2320/0626G09G2354/00H04W4/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,573,677
App. No.
17/384,663
Granted
Feb 7, 2023
Kind
B2
Abstract

A light emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

Claims (48)

1. A headmounted device for pairing with a light-emitting user input device, the headmounted device comprising:

a display configured to direct images to an eye of a user wearing the headmounted device;

an outward-facing optical imaging system configured to image an environment; and

a hardware processor in communication with the outward-facing imaging system, and programmed to:

receive an image acquired by the outward-facing optical imaging system wherein the image comprises a spatial light pattern illuminated by the light-emitting user input device to be paired with the headmounted device;

analyze the image to identify the spatial light pattern which encodes information associated with pairing the light-emitting user input device with the headmounted device;

extract the information encoded in the spatial light pattern for pairing the light-emitting user input device with the headmounted device; and

pair the light-emitting user input device with the headmounted device based at least in part on the extracted information.

2. The headmounted device of claim 1 , wherein the hardware processor is further programmed to:

determine whether the pairing between the light-emitting user input device and the headmounted device is successful; and

in response to a determination that the pairing is successful, instruct the light-emitting user input device to illuminate another spatial light pattern indicative of a successful pairing.

3. The headmounted device of claim 1 , wherein the hardware processor is further programmed to communicate with the light-emitting user input device via a wireless connection in response to a determination that the pairing is successful.

4. The headmounted device of claim 3 , wherein the wireless connection comprises a Bluetooth connection.

5. The headmounted device of claim 1 , wherein the information encoded by the spatial light pattern comprises device information of the light-emitting user input device.

6. The headmounted device of claim 1 , wherein the spatial light pattern encodes the information in a binary form.

7. The headmounted device of claim 1 , wherein the spatial light pattern comprises one or more colors which encode the information associated with the pairing.

8. The headmounted device of claim 1 , wherein a portion of the spatial light pattern includes light in a non-visible portion of the electromagnetic spectrum.

9. A method for pairing a light-emitting user input device, the method comprising:

under control of a hardware processor:

broadcasting a wireless signal indicating a request for communication with nearby electronic devices;

in response to identifying an electronic device available for pairing, initiating a pairing process between the light-emitting user input device and the electronic device;

accessing an image acquired by a camera wherein the image comprises a light pattern illuminated by the light-emitting user input device to be paired with the electronic device;

analyzing the image to identify the light pattern which encodes information associated with pairing the light-emitting user input device with the electronic device;

extracting the information encoded in the light pattern for pairing the light-emitting user input device with the electronic device; and

pairing the light-emitting user input device with the electronic device based at least in part on the extracted information.

10. The method of claim 9 , wherein the electronic device comprises a component of a wearable system for presenting virtual content in a mixed reality environment.

11. The method of claim 10 , wherein the electronic device comprises another user input device or a head-mounted display.

12. The method of claim 9 , further comprising: establishing a wireless connection between the light-emitting user input device and the electronic device in response to a determination that the pairing process is successful.

13. The method of claim 9 , wherein the information encoded by the light pattern comprises device information of the light-emitting user input device, wherein the device information comprises at least one of a device identifier, identification information for the light-emitting user input device, or a key for pairing the light-emitting user input device with the electronic device.

14. The method of claim 9 , wherein a portion of the light pattern includes light in a non-visible portion of the electromagnetic spectrum.

15. A system for pairing a light-emitting user input device, the system comprising:

a plurality of light emitting diodes (LEDs) configured to output light patterns; and

a hardware processor programmed to:

broadcast a wireless signal indicating a request for communication with nearby electronic devices;

receive a response from an electronic device indicating that the electronic device is available for pairing;

initiate a pairing process with the electronic device by causing one or more LEDs of the plurality of LEDs to illuminate a first light pattern encoding information for the pairing process; and

in response to a determination that the electronic device is successfully paired, illuminate a second light pattern indicating the pairing is successful.

16. The system of claim 15 , wherein the first light pattern encodes at least one of: device information associated with the user input device or a trigger message causes the electronic device to initiate a pairing process.

17. The system of claim 15 , wherein the hardware processor is programmed to:

receive a response from the electronic device during the pairing process; and

cause second one or more LEDs of the plurality of LEDs to illuminate a third light pattern encoding a reply message in reply to the response.

18. The system of claim 15 , wherein colors associated with illuminations of the one or more LEDs encode the information of the pairing process.

19. The system of claim 15 , wherein a portion of the first light pattern or the second light pattern includes light in a non-visible portion of the electromagnetic spectrum.

20. The headmounted device of claim 1 , wherein during the pairing, the light pattern comprises a spin animation comprising a circular motion of an illuminated region of a ring.

21. The headmounted device of claim 2 , wherein the another light pattern comprises a pulse animation comprising illumination of a ring.

22. The system of claim 15 , wherein the light-emitting user input device further comprises a circular light guide and the first light pattern comprises illuminated regions of the light guide.

23. The system of claim 22 , wherein the second pattern comprises a pulse animation comprising illumination of the light guide.

24. The method of claim 9 , wherein the wireless signal comprises a Bluetooth signal.

Assignments (4)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2022
From: WHEELER, WILLIAM
To: MAGIC LEAP, INC.
Reel/Frame 061982/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2022
From: POWDERLY, JAMES M.; NILES, SAVANNAH; NESLADEK, CHRISTOPHER DAVID; AZU, ISIOMA OSAGBEMWENORUE; FONTAINE, MARSHAL AINSWORTH; AWAD, HANEY; SCHWAB, BRIAN DAVID; BUCKNOR, BRIAN EDWARD OLIVER
To: MAGIC LEAP, INC.
Reel/Frame 062065/0863 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →