IP Library › Granted Patent US 12,072,489
Granted Patent B2
US 12,072,489 · App. 17/889,709 · Granted Aug 27, 2024

Social connection through distributed and connected real-world objects

Inventors: Hanseul Jun (Stanford, CA); Sven Kratz (Mercer Island, WA); Joanne Leong (Markham, CA); Xingyu Liu (Los Angeles, CA); Andrés Monroy-Hernández (Seattle, WA); Brian Anthony Smith (New York, NY); Yu Jiang Tham (Seattle, WA); Rajan Vaish (Beverly Hills, CA)
Assignee: Snap Inc.
G02B27/017G06T19/006G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,072,489
App. No.
17/889,709
Granted
Aug 27, 2024
Kind
B2
Abstract

Systems and methods are described for providing social connection between users of first and second electronic eyewear devices. A first object in an environment of the first user is paired with a second object in a remote environment of the second user to create a communication connection between the first object and the second object. When the first object is within a field of view of the first electronic eyewear device, a communication is sent that invokes a preselected augmented reality (AR) object for display to the second user adjacent the second object when the second object is in the field of view of the second user. When the first object is within the field of view of the first electronic eyewear device for a predetermined duration, a communication may be sent that invokes a snapshot of an object or a user-selected AR object for display to the second user.

Claims (57)

1. An electronic eyewear device adapted to be worn on the head of a first user, comprising:

at least one camera arranged to capture an image in an environment of the first user;

a memory that stores instructions; and

a processor that executes the instructions to perform operations including:

identifying a first object in the captured image that has been paired with a second object at a remote location; and

when the first object is within a field of view of the electronic eyewear device, sending a communication that invokes a preselected augmented reality (AR) object for display to a second user adjacent the second object when the second object is in a field of view of a second electronic eyewear device of the second user.

2. The electronic eyewear device of claim 1 , wherein execution of the instructions causes the processor to perform additional operations including:

tracking a duration of time that the first object is within the field of view of the electronic eyewear device; and

sending the communication to invoke the preselected AR object for display to the second user adjacent the second object when the first object is within the field of view of the electronic eyewear device for less than a predetermined duration.

3. The electronic eyewear device of claim 2 , wherein the preselected AR object comprises a sparkle-like effect.

4. The electronic eyewear device of claim 2 , wherein execution of the instructions causes the processor to perform additional operations including:

when the first object is within the field of view of the electronic eyewear device for at least the predetermined duration of time, prompting the first user to take a snapshot of an object in the first user's surroundings;

processing the snapshot to remove the object from the snapshot of the first user's surroundings; and

sending a representation of the removed object for display to the second user adjacent the second object.

5. The electronic eyewear device of claim 4 , wherein execution of the instructions causes the processor to perform additional operations including:

recording an audio message from the first user; and

sending the audio message with the representation of the removed object.

6. The electronic eyewear device of claim 2 , wherein execution of the instructions causes the processor to perform additional operations including:

when the first object is within the field of view of the electronic eyewear device for at least the predetermined duration of time, prompting the first user to select at least one of a snapshot or an AR object from an image gallery; and

sending the at least one selected snapshot or AR object for display to the second user adjacent to the second object.

7. The electronic eyewear device of claim 6 , wherein execution of the instructions causes the processor to perform additional operations including:

recording an audio message from the first user; and

sending the audio message with the at least one selected snapshot or AR object.

8. The electronic eyewear device of claim 1 , further comprising a display, wherein execution of the instructions causes the processor to perform additional operations including:

when the first object is in the field of view of the electronic eyewear device, receiving for display to the first user adjacent the first object at least one of a snapshot or an AR object from a communication invoked by the second object being within a field of view of a second electronic eyewear device of the second user; and

presenting the at least one snapshot or AR object on the display.

9. The electronic eyewear device of claim 8 , wherein execution of the instructions causes the processor to perform additional operations including:

causing a presentation of the at least one snapshot or AR object on the display to fade away over time.

10. The electronic eyewear device of claim 1 , wherein execution of the instructions causes the processor to perform additional operations including:

associating a first marker with the first object; and

pairing the first marker associated with the first object with a second marker associated with the second object to create a communication connection between the first marker associated with the first object and the second marker associated with the second object.

11. The electronic eyewear device of claim 10 , wherein the first object and the second object are a same type of object and the communication connection is symmetric.

12. The electronic eyewear device of claim 10 , wherein the first object and the second object are different types of objects and the communication connection is asymmetric.

13. A method of providing social connection between a first user of a first electronic eyewear device and a second user of a second electronic eyewear device, including:

pairing a first object in an environment of the first user with a second object in a remote environment of the second user to create a communication connection between a first marker associated with the first object and a second marker associated with the second object; and

when the first object is within a field of view of the first electronic eyewear device, sending a communication that invokes a preselected augmented reality (AR) object for display to the second user adjacent the second object when the second object is in a field of view of the second electronic eyewear device.

14. The method of claim 13 , further including:

tracking a duration of time that the first object is within the field of view of the first electronic eyewear device; and

sending the communication to invoke the preselected AR object for display to the second user adjacent the second object when the first object is within the field of view of the first electronic eyewear device for less than a predetermined duration.

15. The method of claim 14 , further including:

when the first object is within the field of view of the first electronic eyewear device for at least the predetermined duration, prompting the first user to take a snapshot of an object in the first user's surroundings;

processing the snapshot to remove the object from the snapshot of the first user's surroundings; and

sending a representation of the removed object for display to the second user adjacent the second object.

16. The method of claim 15 , further including:

recording an audio message from the first user; and

sending the audio message with the representation of the removed object.

17. The method of claim 14 , further including:

when the first object is within the field of view of the first electronic eyewear device for at least the predetermined duration, prompting the first user to select at least one of a snapshot or an AR object from an image gallery; and

sending the at least one selected snapshot or AR object for display to the second user adjacent to the second object.

18. The method of claim 13 , further including:

when the first object is in the field of view of the first electronic eyewear device, receiving for display to the first user adjacent the first object at least one of a snapshot or an AR object from a communication that invokes the at least one snapshot or AR object when the second object has been observed within a field of view of the second electronic eyewear device; and

presenting the at least one snapshot or AR object on a display of the first electronic eyewear device.

19. The method of claim 18 , further including:

causing a presentation of the at least one snapshot or AR object on the display of the first electronic eyewear device to fade away over time.

20. A non-transitory computer-readable storage medium that stores instructions that when executed by at least one processor cause the at least one processor to provide a social connection between a first user of a first electronic eyewear device and a second user of a second electronic eyewear device by performing operations including:

pairing a first object in an environment of the first user with a second object in a remote environment of the second user to create a communication connection between a first marker associated with the first object and a second marker associated with the second object when the first object is within a field of view of the first electronic eyewear device for less than a predetermined duration, sending a communication that invokes a preselected augmented reality (AR) object for display to the second user adjacent the second object when the second object is in a field of view of the second electronic eyewear device; and

when the first object is within the field of view of the first electronic eyewear device for at least the predetermined duration of time, sending a communication that invokes at least one of a snapshot of an object in the environment of the first user, a user-selected snapshot, or a user-selected AR object for display to the second user adjacent the second object when the second object is in a field of view of the second electronic eyewear device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2024
From: JUN, HANSEUL; KRATZ, SVEN; LEONG, JOANNE; LIU, XINGYU; MONROY-HERNÁNDEZ, ANDRÉS; SMITH, BRIAN ANTHONY; THAM, YU JIANG; VAISH, RAJAN
To: SNAP INC.
Reel/Frame 067688/0243 →
Continuity (2)
Provisional Application 63240068 · Sep 2, 2021
Related Publication 20230068730A1 · Mar 2, 2023