IP Library Granted Patent US 11,510,027
Granted Patent B2
US 11,510,027 · App. 17/257,814 · Granted Nov 22, 2022

Systems and methods for virtual and augmented reality

Inventor: David Charles Lundmark (Plantation, FL)
Assignee: Magic Leap, Inc.
H04W4/023G02B27/0172G06K7/1408G06T19/006H04W4/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,510,027
App. No.
17/257,814
Granted
Nov 22, 2022
Kind
B2
Abstract

This disclosure describes techniques for receiving information that is wirelessly transmitted to a mobile computing system by wireless devices that are proximal to a route being travelled by the mobile computing system, and presenting at least a portion of the received information through a display of the mobile computing system. The information can be displayed according to a computing experience that is determined for a user of the mobile computing system (e.g., user-selected, inferred based on a stored schedule of the user, and so forth). Different sets of location-based information can be transmitted to the mobile computing system from different wireless devices that the mobile computing system comes into proximity with while traveling along a route. In some instances, the information can be locally stored on the wireless device(s) to reduce latency.

Claims (49)

1. A method performed by a mobile computing system, the method comprising:

determining a computing experience for a user of the mobile computing system;

establishing a wireless connection between the mobile computing system and each of a plurality of wireless devices, wherein each respective wireless device is in proximity to a travel route of the mobile computing system;

receiving, over each respective wireless connection between the mobile computing system and a respective wireless device, location-based information that is associated with a respective location of the respective wireless device in proximity to the travel route, wherein at least a portion of the location-based information that is associated with the respective location of the respective wireless device is stored locally on the respective wireless device before establishing the wireless connection; and

presenting, through a display of the mobile computing system, the location-based information received from each of the plurality of wireless devices, wherein the location-based information is presented according to the determined computing experience.

2. The method of claim 1 , wherein determining the computing experience includes receiving a selection of the computing experience that is made by the user through the mobile computing system.

3. The method of claim 1 , wherein determining the computing experience includes:

accessing at least one data source that stores a schedule of the user; and

inferring the computing experience based at least partly on the schedule of the user.

4. The method of claim 1 , wherein:

at least two of the plurality of wireless devices are at different locations in proximity to the travel route; and

the respective location-based information received from each of the at least two wireless devices is presented, through the display, during different periods of time.

5. The method of claim 1 , wherein:

the computing experience includes at least one regulation that indicates at least: i) a first type of content to be displayed while the computing experience is employed, and ii) a second type of content to not be displayed while the computing experience is employed; and

presenting the location-based information includes presenting the first type of content and not presenting the second type of content.

6. The method of claim 1 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is presented to the user as an outline of a feature within the location.

7. The method of claim 1 , wherein the mobile computing system is a wearable computing device.

8. The method of claim 1 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is communicated to the mobile computing system responsive to the mobile computing system scanning a marker that is proximal to the location.

9. The method of claim 8 , wherein at least the portion of the location-based information is communicated to the mobile computing system from a cloud-based storage system.

10. The method of claim 1 , wherein:

the display of the mobile computing system is an augmented reality display or a mixed reality display;

the location-based information sent from the respective wireless device includes geometric information associated with a feature in proximity to the location of the respective wireless device; and

presenting the location-based information includes using the geometric information to present a virtual representation of the feature in the display.

11. A mobile computing system comprising:

a display;

at least one processor communicatively coupled to the display; and

memory communicatively coupled to the at least one processor, the memory storing instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

determining a computing experience for a user of the mobile computing system;

establishing a wireless connection between the mobile computing system and each of a plurality of wireless devices, wherein each respective wireless device is in proximity to a travel route of the mobile computing system;

receiving, over each respective wireless connection between the mobile computing system and a respective wireless device, location-based information that is associated with a location of the respective wireless device in proximity to the travel route, wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is stored locally on the respective wireless device before establishing the wireless connection; and

presenting, through the display, the location-based information received from each of the plurality of wireless devices, wherein the location-based information is presented according to the determined computing experience.

12. The system of claim 11 , wherein determining the computing experience includes receiving a selection of the computing experience that is made by the user through the mobile computing system.

13. The system of claim 11 , wherein determining the computing experience includes:

accessing at least one data source that stores a schedule of the user; and

inferring the computing experience based at least partly on the schedule of the user.

14. The system of claim 11 , wherein:

at least two of the plurality of wireless devices are at different locations in proximity to the travel route; and

the respective location-based information received from each of the at least two wireless devices is presented, through the display, during different periods of time.

15. The system of claim 11 , wherein:

the computing experience includes at least one regulation that indicates at least: i) a first type of content to be displayed while the computing experience is employed, and ii) a second type of content to not be displayed while the computing experience is employed; and

presenting the location-based information includes presenting the first type of content and not presenting the second type of content.

16. The system of claim 11 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is presented to the user as an outline of a feature within the location.

17. The system of claim 11 , wherein the mobile computing system is a wearable computing device.

18. The system of claim 11 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is communicated to the mobile computing system responsive to the mobile computing system scanning a marker that is proximal to the location.

19. The system of claim 18 , wherein at least the portion of the location-based information is communicated to the mobile computing system from a cloud-based storage system.

20. The system of claim 11 , wherein:

the display of the mobile computing system is an augmented reality display or a mixed reality display;

the location-based information sent from the respective wireless device includes geometric information associated with a feature in proximity to the location of the respective wireless device; and

presenting the location-based information includes using the geometric information to present a virtual representation of the feature in the display.

Assignments (3)
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2021
From: LUNDMARK, DAVID CHARLES
To: MAGIC LEAP, INC.
Reel/Frame 054803/0836 →
Continuity (2)
Provisional Application 62693891 · Jul 3, 2018
Related Publication 20210297808A1 · Sep 23, 2021
Cited By (2)
US 12,379,820 US 12,672,022