IP Library Granted Patent US 10,838,207
Granted Patent B2
US 10,838,207 · App. 16/220,630 · Granted Nov 17, 2020

Systems and methods for augmented reality

Inventors: Samuel A. Miller (Hollywood, FL); Michael J. Woods (Mountain View, CA); David C. Lundmark (Los Altos, CA)
Assignee: MAGIC LEAP, INC.
G02B27/017G01B7/14G01S13/42G01S17/08G06T19/006G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,838,207
App. No.
16/220,630
Granted
Nov 17, 2020
Kind
B2
Abstract

An augmented reality display system includes an electromagnetic field emitter to emit a known magnetic field in a known coordinate system. The system also includes an electromagnetic sensor to measure a parameter related to a magnetic flux at the electromagnetic sensor resulting from the known magnetic field. The system further includes a depth sensor to measure a distance in the known coordinate system. Moreover, the system includes a controller to determine pose information of the electromagnetic sensor relative to the electromagnetic field emitter in the known coordinate system based at least in part on the parameter related to the magnetic flux measured by the electromagnetic sensor and the distance measured by the depth sensor. In addition, the system includes a display system to display virtual content to a user based at least in part on the pose information of the electromagnetic sensor relative to the electromagnetic field emitter.

Claims (26)

1. An augmented reality (AR) display system, comprising:

a hand-held component comprising an electromagnetic field emitter, the electromagnetic field emitter emitting a magnetic field;

a head mounted component having a display system that displays virtual content to a user, the head mounted component comprising a first electromagnetic sensor measuring a first parameter related to a first magnetic flux at the first electromagnetic sensor resulting from the magnetic field, wherein a head pose of the head-mounted component in a known coordinate system is known;

a body-worn component comprising a second electromagnetic sensor measuring a second parameter related to a second magnetic flux at the second electromagnetic sensor resulting from the magnetic field;

a controller communicatively coupled to the hand-held component, the head mounted component, and the body-worn component, the controller receiving the first and second parameters related to the first and second magnetic flux at the respective first and second electromagnetic sensors from the head mounted and body-worn components and receiving a distance in the known coordinate system,

an additional localization resource to provide additional information,

wherein the controller determines at least a position and an orientation of the hand-held component relative to the known coordinate system based at least in part on the first and second parameters related to the first and second magnetic flux measured by the respective first and second electromagnetic sensors, the distance, and the additional information provided by the additional localization resource.

2. The AR display system of claim 1 , wherein the additional localization resource comprises a WiFi transceiver.

3. The AR display system of claim 1 , wherein the additional localization resource comprises an additional electromagnetic emitter.

4. The AR display system of claim 1 , wherein the additional localization resource comprises an additional electromagnetic sensor.

5. The AR display system of claim 1 , wherein the additional localization resource comprises a cellular network transceiver.

6. The AR display system of claim 1 , wherein the additional localization resource comprises a RADAR emitter.

7. The AR display system of claim 1 , wherein the additional localization resource comprises a RADAR detector.

8. The AR display system of claim 1 , wherein the additional localization resource comprises a LIDAR emitter.

9. The AR display system of claim 1 , wherein the additional localization resource comprises a LIDAR detector.

10. The AR display system of claim 1 , wherein the additional localization resource comprises a GPS transceiver.

11. The AR display system of claim 1 , wherein the additional localization resource comprises a poster having a known detectable pattern.

12. The AR display system of claim 1 , wherein the additional localization resource comprises a marker having a known detectable pattern.

13. The AR display system of claim 1 , wherein the additional localization resource comprises an inertial measurement unit.

14. The AR display system of claim 1 , wherein the additional localization resource comprises a strain gauge.

15. The AR display system of claim 1 , wherein the display system displays virtual content to the user based at least in part on the determined position and orientation of the hand-held component relative to the known coordinate system.

16. The AR display system of claim 1 , wherein the additional localization resource comprises a reflector.

17. The AR display system of claim 16 , wherein the reflector reflects radiation.

18. The AR display system of claim 1 , wherein the additional localization resource comprises a beacon.

19. The AR display system of claim 18 , wherein the beacon emits radiation.

20. The AR display system of claim 19 , wherein the radiation is infrared radiation, and wherein the beacon comprises an infrared LED.

Assignments (5)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NUMBER 16/220,620 TO CORRECT SERIAL NUMBER 16/220,630 PREVIOUSLY RECORDED ON REEL 048050 FRAME 0726. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 23, 2019
From: MILLER, SAMUEL A.; WOODS, MICHAEL J.; LUNDMARK, DAVID C.
To: MAGIC LEAP, INC.
Reel/Frame 048117/0678 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2019
From: MILLER, SAMUEL A.; WOODS, MICHAEL J.; LUNDMARK, DAVID C.
To: MAGIC LEAP, INC.
Reel/Frame 048050/0726 →
Continuity (6)
Continuation 15425837 · Feb 6, 2017
Continuation In Part 15062104 · Mar 5, 2016
Provisional Application 62292185 · Feb 5, 2016
Provisional Application 62298993 · Feb 23, 2016
Provisional Application 62128993 · Mar 5, 2015
Related Publication 20200192094A1 · Jun 18, 2020
Cited By (1)
US 12,465,438