IP Library Granted Patent US 11,856,479
Granted Patent B2
US 11,856,479 · App. 17/822,279 · Granted Dec 26, 2023

Systems and methods for virtual and augmented reality along a route with markers

Inventor: David Charles Lundmark (Plantation, FL)
Assignee: Magic Leap, Inc.
H04W4/023G02B27/0172G06K7/1408G06T19/006H04W4/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,856,479
App. No.
17/822,279
Granted
Dec 26, 2023
Kind
B2
Abstract

This disclosure describes techniques for receiving information that is wirelessly transmitted to a mobile computing system by wireless devices that are proximal to a route being travelled by the mobile computing system, and presenting at least a portion of the received information through a display of the mobile computing system. The information can be displayed according to a computing experience that is determined for a user of the mobile computing system (e.g., user-selected, inferred based on a stored schedule of the user, and so forth). Different sets of location-based information can be transmitted to the mobile computing system from different wireless devices that the mobile computing system comes into proximity with while traveling along a route. In some instances, the information can be locally stored on the wireless device(s) to reduce latency.

Claims (48)

1. A method performed by a mobile computing system, the method comprising:

determining a computing experience for a user of the mobile computing system, wherein determining the computing experience includes:

accessing at least one data source that stores a schedule of the user; and

inferring the computing experience based at least partly on the schedule of the user;

establishing a wireless connection between the mobile computing system and each of a plurality of wireless devices, wherein each respective wireless device is in proximity to a travel route of the mobile computing system;

scanning a visible marker that is proximal to a location along the travel route;

receiving, over each respective wireless connection between the mobile computing system and a respective wireless device, location-based information that is associated with a location of the respective wireless device in proximity to the travel route, wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is communicated to the mobile computing system responsive to the mobile computing system scanning the visible marker that is proximal to the location; and

presenting, through a display of the mobile computing system, the location-based information received from each of the plurality of wireless devices, wherein the location-based information is presented according to the determined computing experience.

2. The method of claim 1 , wherein determining the computing experience includes receiving a selection of the computing experience that is made by the user through the mobile computing system.

3. The method of claim 1 , wherein:

at least two of the plurality of wireless devices are at different locations in proximity to the travel route; and

the respective location-based information received from each of the at least two wireless devices is presented, through the display, during different periods of time.

4. The method of claim 1 , wherein:

the computing experience includes at least one regulation that indicates at least: i) a first type of content to be displayed while the computing experience is employed, and ii) a second type of content to not be displayed while the computing experience is employed; and

presenting the location-based information includes presenting the first type of content and not presenting the second type of content.

5. The method of claim 1 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is stored locally on the respective wireless device.

6. The method of claim 1 , wherein the mobile computing system is a wearable computing device.

7. The method of claim 1 , wherein the visible markers are different between all the locations so as to differentiate the locations from one another.

8. The method of claim 1 , wherein at least the portion of the location-based information is communicated to the mobile computing system from a cloud-based storage system.

9. The method of claim 1 , wherein the display of the mobile computing system is an augmented reality display or a mixed reality display;

the location-based information sent from the respective wireless device includes geometric information associated with a feature in proximity to the location of the respective wireless device; and

presenting the location-based information includes using the geometric information to present a virtual representation of the feature in the display.

10. A mobile computing system comprising:

a display;

at least one processor communicatively coupled to the display; and

memory communicatively coupled to the at least one processor, the memory storing instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

determining a computing experience for a user of the mobile computing system, wherein determining the computing experience includes:

accessing at least one data source that stores a schedule of the user; and

inferring the computing experience based at least partly on the schedule of the user;

establishing a wireless connection between the mobile computing system and each of a plurality of wireless devices, wherein each respective wireless device is in proximity to a travel route of the mobile computing system;

scanning a visible marker that is proximal to a location along the travel route;

receiving, over each respective wireless connection between the mobile computing system and a respective wireless device, location-based information that is associated with a location of the respective wireless device in proximity to the travel route, wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is communicated to the mobile computing system responsive to the mobile computing system scanning the visible marker that is proximal to the location; and

presenting, through the display, the location-based information received from each of the plurality of wireless devices, wherein the location-based information is presented according to the determined computing experience.

11. The system of claim 10 , wherein determining the computing experience includes receiving a selection of the computing experience that is made by the user through the mobile computing system.

12. The system of claim 10 , wherein:

at least two of the plurality of wireless devices are at different locations in proximity to the travel route; and

the respective location-based information received from each of the at least two wireless devices is presented, through the display, during different periods of time.

13. The system of claim 10 , wherein:

the computing experience includes at least one regulation that indicates at least: i) a first type of content to be displayed while the computing experience is employed, and ii) a second type of content to not be displayed while the computing experience is employed; and

presenting the location-based information includes presenting the first type of content and not presenting the second type of content.

14. The system of claim 10 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is stored locally on the respective wireless device.

15. The system of claim 10 , wherein the mobile computing system is a wearable computing device.

16. The system of claim 10 , wherein at least a portion of the location-based information that is associated with the location of the respective wireless device is communicated to the mobile computing system responsive to the mobile computing system scanning a marker that is proximal to the location.

17. The system of claim 16 , wherein at least the portion of the location-based information is communicated to the mobile computing system from a cloud-based storage system.

18. The system of claim 10 , wherein:

the display of the mobile computing system is an augmented reality display or a mixed reality display;

the location-based information sent from the respective wireless device includes geometric information associated with a feature in proximity to the location of the respective wireless device; and

presenting the location-based information includes using the geometric information to present a virtual representation of the feature in the display.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2022
From: LUNDMARK, DAVID CHARLES
To: MAGIC LEAP, INC.
Reel/Frame 060900/0846 →