IP Library Granted Patent US 11,615,595
Granted Patent B2
US 11,615,595 · App. 17/481,193 · Granted Mar 28, 2023

Systems, methods, and graphical user interfaces for sharing augmented reality environments

Inventors: Praveen Sharma (Brooklyn, NY); Fiona P. O'Leary (Mountain View, CA); Joseph A. Malia (Isle of Wight, GB)
Assignee: APPLE INC.
G06T19/006G06T7/70G06T13/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,615,595
App. No.
17/481,193
Granted
Mar 28, 2023
Kind
B2
Abstract

A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

Claims (42)

1. A method, comprising:

at a first electronic device with one or more processors, memory, and one or more cameras, the first electronic device in communication with a display generation component:

capturing, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device, wherein the position information indicates a location of the second electronic device within an augmented reality (AR) environment that includes a physical environment in which the first electronic device and the second electronic device are located and the position information displayed by the second electronic device is updated by the second electronic device as a position of the second electronic device in the AR environment changes; and

after capturing the image of the second electronic device that includes the position information, displaying, via the display generation component of the first electronic device, one or more virtual objects within the AR environment using the position information captured from the second electronic device.

2. The method of claim 1 , wherein the position information displayed by the second electronic device includes machine-readable visual information that includes the position information.

3. The method of claim 2 , wherein the machine-readable visual information is displayed at a position on the second electronic device known to the first electronic device prior to capturing the image of the second electronic device.

4. The method of claim 2 , including receiving from the second electronic device, prior to capturing the image of the second electronic device, information about the second electronic device that includes display position information that provides information about a position on the second electronic device at which the machine-readable visual information is displayed.

5. The method of claim 1 , wherein changes in the position information displayed by the second electronic device are animated over time.

6. The method of claim 1 , including displaying, via the display generation component of the first electronic device, the updated position information as the position information is updated by the second electronic device.

7. The method of claim 1 , wherein the position information displayed by the second electronic device at a particular time is associated with the position of the second electronic device in the physical environment at that particular time.

8. The method of claim 1 , including receiving, from the second electronic device, information that includes at least a portion of a three-dimensional map of the AR environment.

9. The method of claim 1 , further including receiving information from the second electronic device using a wireless connection.

10. The method of claim 1 , further including, prior to capturing the position information, receiving a user input and initiating, based on user input, a process for establishing augmented reality co-presence with the second electronic device.

11. A first electronic device, comprising:

a display generation component;

one or more cameras;

one or more input devices;

one or more processors; and

memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:

capturing, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device, wherein the position information indicates a location of the second electronic device within an augmented reality (AR) environment that includes a physical environment in which the first electronic device and the second electronic device are located and the position information displayed by the second electronic device is updated by the second electronic device as a position of the second electronic device in the AR environment changes; and

after capturing the image of the second electronic device that includes the position information, displaying, via the display generation component of the first electronic device, one or more virtual objects within the AR environment using the position information captured from the second electronic device.

12. The first electronic device of claim 11 , wherein the position information displayed by the second electronic device includes machine-readable visual information that includes the position information.

13. The first electronic device of claim 12 , wherein the machine-readable visual information is displayed at a position on the second electronic device known to the first electronic device prior to capturing the image of the second electronic device.

14. The first electronic device of claim 12 , the one or more programs further including instructions for receiving from the second electronic device, prior to capturing the image of the second electronic device, information about the second electronic device that includes display position information that provides information about a position on the second electronic device at which the machine-readable visual information is displayed.

15. The first electronic device of claim 11 , wherein changes in the position information displayed by the second electronic device are animated over time.

16. The first electronic device of claim 11 , the one or more programs further including instructions for displaying, via the display generation component of the first electronic device, the updated position information as the position information is updated by the second electronic device.

17. The first electronic device of claim 11 , wherein the position information displayed by the second electronic device at a particular time is associated with the position of the second electronic device in the physical environment at that particular time.

18. The first electronic device of claim 11 , the one or more programs further including instructions for receiving, from the second electronic device, information that includes at least a portion of a three-dimensional map of the AR environment.

19. The first electronic device of claim 11 , the one or more programs further including instructions for receiving information from the second electronic device using a wireless connection.

20. The first electronic device of claim 11 , the one or more programs further including instructions for, prior to capturing the position information, receiving a user input and initiating, based on user input, a process for establishing augmented reality co-presence with the second electronic device.

21. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a first electronic device that includes and/or is in communication with a display generation component, one or more cameras, and one or more input devices, cause the first electronic device to:

capture, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device, wherein the position information indicates a location of the second electronic device within an augmented reality (AR) environment that includes a physical environment in which the first electronic device and the second electronic device are located and the position information displayed by the second electronic device is updated by the second electronic device as a position of the second electronic device in the AR environment changes; and

after capturing the image of the second electronic device that includes the position information, display, via the display generation component of the first electronic device, one or more virtual objects within the AR environment using the position information captured from the second electronic device.

22. The non-transitory computer readable storage medium of claim 21 , wherein the position information displayed by the second electronic device includes machine-readable visual information that includes the position information.

23. The non-transitory computer readable storage medium of claim 22 , wherein the machine-readable visual information is displayed at a position on the second electronic device known to the first electronic device prior to capturing the image of the second electronic device.

24. The non-transitory computer readable storage medium of claim 22 , the one or more programs further including instructions that cause the first electronic device to receive, from the second electronic device, prior to capturing the image of the second electronic device, information about the second electronic device that includes display position information that provides information about a position on the second electronic device at which the machine-readable visual information is displayed.

25. The non-transitory computer readable storage medium of claim 21 , wherein changes in the position information displayed by the second electronic device are animated over time.

26. The non-transitory computer readable storage medium of claim 21 , the one or more programs further including instructions that cause the first electronic device to display, via the display generation component of the first electronic device, the updated position information as the position information is updated by the second electronic device.

27. The non-transitory computer readable storage medium of claim 21 , wherein the position information displayed by the second electronic device at a particular time is associated with the position of the second electronic device in the physical environment at that particular time.

28. The non-transitory computer readable storage medium of claim 21 , the one or more programs further including instructions that cause the first electronic device to receive, from the second electronic device, information that includes at least a portion of a three-dimensional map of the AR environment.

29. The non-transitory computer readable storage medium of claim 21 , the one or more programs further including instructions that cause the first electronic device to receive information from the second electronic device using a wireless connection.

30. The non-transitory computer readable storage medium of claim 21 , the one or more programs further including instructions that cause the first electronic device to, prior to capturing the position information, receive a user input and initiating, based on user input, a process for establishing augmented reality co-presence with the second electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2021
From: SHARMA, PRAVEEN; O'LEARY, FIONA P.; MALIA, JOSEPH A.
To: APPLE INC.
Reel/Frame 058313/0108 →
Continuity (2)
Provisional Application 63082940 · Sep 24, 2020
Related Publication 20220092861A1 · Mar 24, 2022