IP Library Granted Patent US 10,198,864
Granted Patent B2
US 10,198,864 · App. 14/705,924 · Granted Feb 5, 2019

Running object recognizers in a passable world model for augmented or virtual reality

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,198,864
App. No.
14/705,924
Granted
Feb 5, 2019
Kind
B2
Abstract

An augmented reality system comprises one or more databases storing a passable world model data comprising a set of points pertaining to real objects of the physical world, and one or more object recognizers configured for running on the passable world model data. Each of the object recognizer(s) is programmed to recognize a predetermined object of the real world based on a known geometry of a corresponding set of points. The augmented reality system further comprises a head-worn augmented reality display system configured for displaying virtual content to a user based at least in part on the recognized object.

Claims (16)

1. An augmented reality system, comprising: one or more databases storing a passable world model data comprising sets of points respectively pertaining to real objects of the physical world; a plurality of object recognizers configured for simultaneously running on the passable world model data independent of each other, each of the object recognizers being programmed to recognize an object of the real world based on a known geometry of the object corresponding to a set of points of the passable world model data; and a head-worn augmented reality display system configured for displaying virtual content to a user based at least in part on the recognized object;

wherein each of the object recognizers is dedicated to recognize a predetermined object;

wherein each of the object recognizers is autonomic and autonomous; and

wherein the object recognizers comprise a basic object recognizer configured for running on the passable world model data to identify a generic object, and a detailed object recognizer configured for running non the passable world model data on the generic objects to identify a specific object.

2. The augmented reality system of claim 1 , wherein the passable world model data comprises parametric geometric data corresponding to the physical world.

3. The augmented reality system of claim 1 , wherein the passable world model data is constructed from data received from a plurality of augmented reality display systems, wherein the plurality of augmented reality display systems capture data pertaining to a plurality of locations in the physical world.

4. The augmented reality system of claim 1 , wherein the map points are 2D points.

5. The augmented reality system of claim 1 , wherein each of the recognizers utilizes captured depth information to recognize the respective object.

6. The augmented reality system of claim 1 , wherein the map points correspond to one or more images captured by one or more augmented reality display systems, and wherein each of the object recognizers is configured for identifying the known geometry of the respective recognized object relative to a known position of the one or more augmented reality display systems.

7. The augmented reality system of claim 1 , wherein each of the object recognizers is configured for synchronizing a parametric geometry of the respective recognized object to the passable world model.

8. The augmented reality system of claim 7 , wherein each of the object recognizers is configured for attaching semantic information to the parametric geometry of the respective recognized object.

9. The augmented reality system of claim 8 , wherein the semantic information may be utilized to estimate a future position of the respective recognized object.

10. The augmented reality system of claim 8 , wherein the semantic information is a taxonomical descriptor.

11. The augmented reality system of claim 1 , wherein each of the object recognizers is configured for receiving sparse points collected from one or more images of the physical world.

12. The augmented reality system of claim 11 , wherein each of the object recognizers is configured for outputting a parametric geometry of the respective recognized object.

13. The augmented reality display system of claim 1 , wherein the object recognizers comprise a ring of object recognizers that run on the passable world model data, wherein the ring of object recognizers comprises at least two object recognizers, and wherein a first object recognizer of the at least two object recognizers recognizes a first object, and wherein a second object recognizer of the at least two object recognizers recognizes a subset of the first object.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2017
From: MILLER, SAMUEL A.
To: MAGIC LEAP, INC.
Reel/Frame 043232/0860 →