IP Library Granted Patent US 11,861,796
Granted Patent B2
US 11,861,796 · App. 17/376,748 · Granted Jan 2, 2024

Virtual location selection for virtual content

Inventors: Silas Warren (Plantation, FL); Omar Khan (Plantation, FL); Samuel A. Miller (Hollywood, FL); Tushar Arora (Hollywood, FL)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/011G06T19/20G06T2200/24G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,861,796
App. No.
17/376,748
Granted
Jan 2, 2024
Kind
B2
Abstract

A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

Claims (40)

1. A computer-implemented method, comprising:

providing, by an augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user;

providing, for display by the augmented reality system, a notification on the augmented reality system indicating that new content is available;

in response to receiving a confirmation input from the user, removing, by the augmented reality system, the notification from display on the augmented reality system;

receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, location information that indicates an assigned location within the physical environment that the user has selected for new content to be displayed;

determining, by the augmented reality system and based on the location information, a display location on a display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed at the assigned location within the physical environment; and

providing, by the augmented reality system, the new content for display on the display of the augmented reality system at the display location.

2. The computer-implemented method of claim 1 , wherein the mobile device of the user at which the user selects the assigned location is a mobile telephone of the user.

3. The computer-implemented method of claim 1 , comprising generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system indicating that the new content is available.

4. The computer-implemented method of claim 2 , comprising:

identifying candidate locations in the physical environment for display of the new content,

wherein information provided to the mobile device identifies the candidate locations.

5. The computer-implemented method of claim 1 , wherein the information provided to the mobile device comprises a static representation of the physical environment surrounding the user.

6. A non-transitory computer-readable storage medium comprising instructions, which, when executed by one or more computer processors, cause the one or more computer processors to perform operations, comprising:

providing, by an augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user;

providing, for display by the augmented reality system, a notification on the augmented reality system indicating that new content is available;

in response to receiving a confirmation input from the user, removing, by the augmented reality system, the notification from display on the augmented reality system;

receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, location information that indicates an assigned location within the physical environment that the user has selected for new content to be displayed;

determining, by the augmented reality system and based on the location information, a display location on a display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed at the assigned location within the physical environment; and

providing, by the augmented reality system, the new content for display on the display of the augmented reality system at the display location.

7. The non-transitory computer-readable storage medium of claim 6 , wherein the mobile device of the user at which the user selects the assigned location is a mobile telephone of the user.

8. The non-transitory computer-readable storage medium of claim 6 , wherein the operations comprise generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system indicating that the new content is available.

9. The non-transitory computer-readable storage medium of claim 6 , wherein the operations comprise:

identifying candidate locations in the physical environment for display of the new content,

wherein information provided to the mobile device identifies the candidate locations.

10. The non-transitory computer-readable storage medium of claim 6 , wherein the information provided to the mobile device comprises a static representation of the physical environment surrounding the user.

11. A system comprising:

one or more processors; and

one or more non-transitory machine-readable storage devices storing instructions that are executable by the one or more processors to perform operations, comprising:

providing, by an augmented reality system and to a mobile device of a user of the augmented reality system, information that describes a physical environment surrounding the user;

providing, for display by the augmented reality system, a notification on the augmented reality system indicating that new content is available;

in response to receiving a confirmation input from the user, removing, by the augmented reality system, the notification from display on the augmented reality system;

receiving, by the augmented reality system and from the mobile device of the user of the augmented reality system, location information that indicates an assigned location within the physical environment that the user has selected for new content to be displayed;

determining, by the augmented reality system and based on the location information, a display location on a display of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed at the assigned location within the physical environment; and

providing, by the augmented reality system, the new content for display on the display of the augmented reality system at the display location.

12. The system of claim 11 , wherein the mobile device of the user at which the user selects the assigned location is a mobile telephone of the user.

13. The system of claim 11 , wherein the operations comprise generating, by the augmented reality system, a notification based on the augmented reality system receiving data from an external source that is external to the augmented reality system indicating that the new content is available.

14. The system of claim 11 , wherein the operations comprise:

identifying candidate locations in the physical environment for display of the new content,

wherein information provided to the mobile device identifies the candidate locations.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2021
From: WARREN, SILAS; KHAN, OMAR; MILLER, SAMUEL A.; ARORA, TUSHAR
To: MAGIC LEAP, INC.
Reel/Frame 056936/0340 →