IP Library Granted Patent US 11,087,559
Granted Patent B1
US 11,087,559 · App. 17/088,265 · Granted Aug 10, 2021

Managing augmented reality content associated with a physical location

Inventors: Michael Kuhn (Los Gatos, CA); Justin D. Stoyles (San Francisco, CA)
Assignee: Apple Inc.
G06T19/006G02B27/0172G06K9/00201G06K9/00671H04N21/4756H04W4/30G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,559
App. No.
17/088,265
Granted
Aug 10, 2021
Kind
B1
Abstract

The present disclosure relates to managing augmented reality content created on a first electronic device and viewed at a second electronic device. In some embodiments, the first electronic device determines its physical location, receives input representing user-generated augmented reality content, displays an augmented reality environment including the user-generated augmented reality content overlaid on a live view of the physical location, and sends the user-generated augmented reality content to an external storage repository. The second electronic device can then receive the user-generated augmented reality content, determine whether it is at the physical location, and display the user-generated augmented reality content when it is at the physical location.

Claims (59)

1. An electronic device, comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

predicting a future physical location of an electronic device;

identifying augmented reality content associated with the future physical location, wherein the augmented reality content is associated with the future physical location based on a previous user request to associate the augmented reality content with the future physical location;

before the electronic device arrives at the future physical location, obtaining the identified augmented reality content;

upon arriving at the future physical location, displaying an affordance indicating availability of the obtained augmented reality content for display;

receiving a request to view the obtained augmented reality content; and

in response to receiving the request to view the obtained augmented reality content, displaying the obtained augmented reality content.

2. The electronic device of claim 1 , wherein the one or more programs further include instructions for:

obtaining images from one or more image sensors, wherein the obtained images include one or more predefined physical features present at the future physical location; and

determining a current location of the electronic device based at least in part on the obtained images.

3. The electronic device of claim 1 , wherein the augmented reality content is displayed while the electronic device is at the future physical location.

4. The electronic device of claim 1 , wherein the one or more programs further include instructions for:

providing an alert when the obtained augmented reality content is available for display.

5. The electronic device of claim 1 , wherein the one or more programs further include instructions for:

receiving a destination, wherein the predicted future location is based on the received destination.

6. The electronic device of claim 5 , wherein the identified augmented reality content includes content associated with additional physical locations along a route to the destination.

7. The electronic device of claim 1 , wherein predicting the future physical location comprises:

determining a direction of travel of the electronic device.

8. The electronic device of claim 1 , wherein predicting the future physical location comprises:

determining a proximity of the electronic device to the future physical location.

9. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors, the one or more programs including instructions for:

predicting a future physical location of the electronic device;

identifying augmented reality content associated with the future physical location, wherein the augmented reality content is associated with the future physical location based on a previous user request to associate the augmented reality content with the future physical location;

before the electronic device arrives at the future physical location, obtaining the identified augmented reality content;

upon arriving at the future physical location, displaying an affordance indicating availability of the obtained augmented reality content for display;

receiving a request to view the obtained augmented reality content; and

in response to receiving the request to view the obtained augmented reality content, displaying the obtained augmented reality content.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:

obtaining images from one or more image sensors, wherein the obtained images include one or more predefined physical features present at the future physical location; and

determining a current location of the electronic device based at least in part on the obtained images.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the augmented reality content is displayed while the electronic device is at the future physical location.

12. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:

providing an alert when the obtained augmented reality content is available for display.

13. The non-transitory computer-readable storage medium of claim 9 , wherein the one or more programs further include instructions for:

receiving a destination, wherein the predicted future location is based on the received destination.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the identified augmented reality content includes content associated with additional physical locations along a route to the destination.

15. The non-transitory computer-readable storage medium of claim 9 , wherein predicting the future physical location comprises:

determining a direction of travel of the electronic device.

16. The non-transitory computer-readable storage medium of claim 9 , wherein predicting the future physical location comprises:

determining a proximity of the electronic device to the future physical location.

17. A method, comprising:

predicting a future physical location of the electronic device;

identifying augmented reality content associated with the future physical location, wherein the augmented reality content is associated with the future physical location based on a previous user request to associate the augmented reality content with the future physical location;

before the electronic device arrives at the future physical location, obtaining the identified augmented reality content;

upon arriving at the future physical location, displaying an affordance indicating availability of the obtained augmented reality content for display;

receiving a request to view the obtained augmented reality content; and

in response to receiving the request to view the obtained augmented reality content, displaying the obtained augmented reality content.

18. The method of claim 17 , further comprising:

obtaining images from one or more image sensors, wherein the obtained images include one or more predefined physical features present at the future physical location; and

determining a current location of the electronic device based at least in part on the obtained images.

19. The method of claim 17 , wherein the augmented reality content is displayed while the electronic device is at the future physical location.

20. The method of claim 17 , further comprising:

receiving a destination, wherein the predicted future location is based on the received destination.

21. The method of claim 17 , wherein predicting the future physical location comprises:

determining a direction of travel of the electronic device.

22. The method of claim 17 , wherein predicting the future physical location comprises:

determining a proximity of the electronic device to the future physical location.

Continuity (3)
Continuation 17026855 · Sep 21, 2020
Continuation 16140268 · Sep 24, 2018
Provisional Application 62566173 · Sep 29, 2017
Cited By (2)
US 12,361,646 US 12,619,303