Granted Patent B2

US 12,675,169 · App. 18/611,141 · Granted Jul 7, 2026

Inventors: Piers George Cowburn (London, GB); David Li (London, GB); Isac Andreas Müller Sandvik (London, GB); Qi Pan (London, GB)

Assignee: Snap Inc.

G06F3/017G06F3/04815G06T19/006H04L51/04H04L67/131

Abstract

Claims (46)

1 . A method comprising:

receiving an observed motion data from a first device associated with a first user, the observed motion data being derived from a camera of a first device, the observed motion data corresponding to image data a gesture performed by a second user, generated by the first device, the second user being associated with a second device, the observed motion data being received from the first device in real time;

receiving from the second device a captured motion data that corresponds to the gesture, the captured motion data being recorded by an inertial sensor included in the second device;

determining whether there is a match between the observed motion data from the first device and the captured motion data from the second device;

in response to determining that there is the match, determining if an AR session is currently present in the first device or in the second device;

initiating a new shared AR session between the first device and the second device when there is no AR session currently present;

adding the first device or the second device to the currently present AR session to create a new shared AR session between when the AR session is currently present; and

causing the shared AR session to be displayed by the first device and by the second device.

2 . The method of claim 1 , wherein the shared AR session comprises a real-time messaging session.

3 . The method of claim 1 , further comprising a data stream, wherein the data stream is a video of the second user.

4 . The method of claim 1 , further comprising:

identifying positions of at least one body part of the second user and analyzing a motion of the at least one body part during the gesture.

5 . The method of claim 4 , wherein the at least one body part includes an arm or hand of the second user.

6 . The method of claim 3 , wherein the data stream further comprises images of a third user being associated with a third device, and wherein the first device identifies the second user in the data stream as being associated with the second device.

7 . A system comprising:

a processor; and

a memory having instructions stored thereon, when executed by the processor, causes the system to perform operations comprising:

receiving an observed motion data from a first device associated with a first user, the observed motion data being derived from a camera of a first device, the observed motion data corresponding to image data a gesture performed by a second user, generated by the first device, the second user being associated with a second device, the observed motion data being received from the first device in real time;

receiving from the second device a captured motion data that corresponds to the gesture, the captured motion data being recorded by an inertial sensor included in the second device;

determining whether there is a match between the observed motion data from the first device and the captured motion data from the second device;

in response to determining that there is the match, determining if an AR session is currently present in the first device or in the second device;

initiating a new shared AR session between the first device and the second device when there is no AR session currently present;

adding the first device or the second device to the currently present AR session to create a new shared AR session between when the AR session is currently present; and

causing the shared AR session to be displayed by the first device and by the second device.

8 . The system of claim 7 , wherein the shared AR session comprises a real-time messaging session.

9 . The system of claim 7 , further comprising a data stream, wherein the data stream is a video of the second user performing the gesture, wherein the video is captured by a camera included in the first device.

10 . The system of claim 7 , further comprising:

identifying positions of at least one body part of the second user and analyzing a motion of the at least one body part during the gesture.

11 . The system of claim 10 , wherein the at least one body part includes an arm or hand of the second user.

12 . The system of claim 9 , wherein the data stream further comprises images of a third user being associated with a third device, and wherein the first device identifies the second user in the data stream as being associated with the second device.

13 . A non-transitory computer-readable storage medium having stored thereon instructions, when executed by a processor, causes the processor to perform operations comprising:

receiving an observed motion data from a first device associated with a first user, the observed motion data being derived from a camera of a first device, the observed motion data corresponding to image data a gesture performed by a second user, generated by the first device, the second user being associated with a second device, the observed motion data being received from the first device in real time;

receiving from the second device a captured motion data that corresponds to the gesture, the captured motion data being recorded by an inertial sensor included in the second device;

determining whether there is a match between the observed motion data from the first device and the captured motion data from the second device;

in response to determining that there is the match, determining if an AR session is currently present in the first device or in the second device;

initiating a new shared AR session between the first device and the second device when there is no AR session currently present;

adding the first device or the second device to the currently present AR session to create a new shared AR session between when the AR session is currently present; and

causing the shared AR session to be displayed by the first device and by the second device.

14 . The computer-readable storage medium of claim 13 , wherein the shared AR session comprises a real-time messaging session.

15 . The computer-readable storage medium of claim 13 , further comprising a data stream, wherein the data stream is a video of the second user.

16 . The computer-readable storage medium of claim 13 , further comprising:

identifying positions of at least one body part of the second user and analyzing a motion of the at least one body part during the gesture.

17 . The computer-readable storage medium of claim 16 , wherein the at least one body part includes an arm or hand of the second user.

18 . The computer-readable storage medium of claim 13 , wherein the inertial sensor comprises one of an accelerometer or a gyroscope, and wherein the inertial sensor captures one or more of a position, a movement, and an orientation of the second device.

19 . The method of claim 1 , wherein the inertial sensor comprises one of an accelerometer or a gyroscope, and wherein the inertial sensor captures one or more of a position, a movement, and an orientation of the second device.

20 . The system of claim 7 , wherein the inertial sensor comprises one of an accelerometer or a gyroscope, and wherein the inertial sensor captures one or more of a position, a movement, and an orientation of the second device.

Assignments (1)

Continuity (3)

References Cited (139)