IP Library › Granted Patent US 12,633,061
Granted Patent B2
US 12,633,061 · App. 17/941,522 · Granted May 19, 2026

Gestures to enable menus using augmented reality content in a messaging system

Inventors: Kyle Goodrich (Venice, CA); Maxim Maximov Lazarov (Culver City, CA); Andrew James McPhee (Culver City, CA); Daniel Moreno (Los Angeles, CA)
Assignee: Snap Inc.
G06T19/006G06F3/017G06T7/20G06T7/70G06T19/20G06V10/761G06V20/20G06V40/28H04L51/046G06T2219/2004G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,633,061
App. No.
17/941,522
Granted
May 19, 2026
Kind
B2
Abstract

The subject technology detects a first location and a first position of a first representation of a first finger and a second location and a second position of a second representation of a second finger. The subject technology detects a first particular location and a first particular position of a first particular representation of a first particular finger and a second particular location and a second particular position of a second particular representation of a second particular finger. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology detects a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position. The subject technology generates a set of virtual objects.

Claims (108)

1 . A method, comprising:

detecting, using one or more hardware processors, from a set of frames, a first gesture and a second gesture, the first gesture corresponding to a first pinch gesture and the second gesture corresponding to a second pinch gesture, the first pinch gesture and the second pinch gesture corresponding to different hands, the first pinch gesture comprising two different fingers of a first hand touching, and the second pinch gesture comprising two different of a second hand touching, the first pinch gesture and the second pinch gesture being detected in at least one same frame from the set of frames;

detecting, using the one or more hardware processors, a first location and a first position of a first representation of a first finger from the first gesture and a second location and a second position of a second representation of a second finger from the first gesture;

detecting, using the one or more hardware processors, a first particular location and a first particular position of a first particular representation of a first particular finger from the second gesture and a second particular location and a second particular position of a second particular representation of a second particular finger from the second gesture;

detecting, using the one or more hardware processors, a first change in the first location and the first position and a second change in the second location and the second position;

detecting, using the one or more hardware processors, a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position;

in response to the first change, second change, first particular change, and second particular change, generating, using the one or more hardware processors, a set of virtual objects along a line from the first location and the first position to the first particular location and the first particular position, wherein a first distance between the first change and the first particular change is greater than a threshold distance value, and a second distance between the second change and the second particular change are greater than the threshold distance value;

detecting, from a different set of frames, a first collision event corresponding to a first collider of the first representation of the first finger intersecting with a second collider of a first virtual object from the generated set of virtual objects;

in response to the first collision event, selecting the first virtual object and generating augmented reality content associated with the selected first virtual object;

detecting, from a second different set frames, a third gesture and a fourth gesture, the third gesture corresponding to a third pinch gesture and the fourth gesture corresponding to a fourth pinch gesture, the third pinch gesture and the fourth pinch gesture corresponding to different hands;

in response to detecting the third gesture and the fourth gesture, moving the set of virtual objects to be arranged in a second line based on spatial positions of the third pinch gesture and the fourth pinch gesture, wherein the second line is different from the line;

rendering, using the one or more hardware processors, the set of virtual objects within a first scene; and

providing for display, using the one or more hardware processors, the rendered set of virtual objects within the first scene.

2 . The method of claim 1 , wherein the first change and the second change does not result in an in increase in a distance greater than a first threshold value between the first representation of the first finger and the second representation of the second finger, and the first finger and the second finger is from a same first hand, and

wherein the first particular change and the second particular change does not result in an in increase in a distance greater than a first particular threshold value between the first particular representation of the first particular finger and the second particular representation of the second particular finger, and the first particular finger and the second particular finger is from a same second hand.

3 . The method of claim 1 , further comprising:

detecting, from a second set of frames, a third location and a third position of the first representation of the first finger and a fourth location and a fourth position of the second representation of the second finger;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position, wherein the third change and the fourth change result in an increase in a distance greater than a threshold value between the first representation of the first finger and the second representation of the second finger, and the first finger and the second finger is from a same hand;

detecting, from the second set of frames, a third particular location and a third particular position of the first particular representation of the first particular finger and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position, wherein the third particular change and the fourth particular change result in an increase in a distance greater than a particular threshold value between the first particular representation of the first particular finger and the second particular representation of the second particular finger, and the first particular finger and the second particular finger is from a same second hand; and

in response to detecting the third change, the fourth change, the third particular change, and the fourth particular change, ceasing generating the set of virtual objects along the line from the first location and the first position to the first particular location and the first particular position.

4 . The method of claim 1 , wherein the rendered set of objects is provided for display within a messaging application executing on a client device.

5 . The method of claim 3 , further comprising:

performing an operation in connection with the selection, the operation comprising generating augmented reality content associated with the selected first virtual object for display within the first scene.

6 . The method of claim 3 , further comprising:

detecting a third location and a third position of the first representation of the first finger from the third gesture and a fourth location and a fourth position of the second representation of the second finger from the third gesture;

detecting a third particular location and a third particular position of the first particular representation of the first particular finger from the fourth gesture and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger from the fourth gesture;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position;

in response to the third change, fourth change, third particular change, and fourth particular change, moving the set of virtual objects to be arranged in a second line from the third location and the third position to the third particular location and the third particular position, wherein a third distance between the third change and the third particular change is greater than a particular threshold distance value, and a fourth distance between the fourth change and the fourth particular change are greater than the particular threshold distance value;

rendering the moved set of virtual objects within the first scene; and

providing for display the rendered moved set of virtual objects within the first scene.

7 . The method of claim 3 , further comprising:

detecting, from a fifth set of frames, a third gesture and a fourth gesture, the third gesture corresponding to a third pinch gesture and the fourth gesture corresponding to a fourth pinch gesture, the third pinch gesture and the fourth pinch gesture corresponding to different hands;

detecting a third location and a third position of the first representation of the first finger from the third gesture and a fourth location and a fourth position of the second representation of the second finger from the third gesture;

detecting a third particular location and a third particular position of the first particular representation of the first particular finger from the fourth gesture and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger from the fourth gesture;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position;

in response to the third change, fourth change, third particular change, and fourth particular change, moving the set of virtual objects to be overlaid on each other such that only a single virtual object is visible within the first scene, wherein a third distance between the third change and the third particular change is less than a particular threshold distance value, and a fourth distance between the fourth change and the fourth particular change are less than the particular threshold distance value;

rendering the moved set of virtual objects within the first scene; and

providing for display the rendered moved set of virtual objects within the first scene.

8 . The method of claim 6 , wherein the rendered moved set of virtual objects are arranged in a vertical manner.

9 . The method of claim 6 , wherein moving the set of virtual objects to be arranged in the second line comprises:

removing a first set of virtual objects from set of virtual objects to provide a second set of objects, the removing based at least in part on a length of the second line such that the second set of objects are arranged to fit along the second line without overlapping each other and the set of virtual objects are unable to fit along the second line without at least one virtual object being overlaid with a second virtual object; and

moving the second set of objects to be arranged in the second line.

10 . The method of claim 9 , wherein moving the set of virtual objects to be overlaid on each other such that only a single virtual object is visible within the first scene comprises:

removing a first set of virtual objects from set of virtual objects to provide the single virtual object.

11 . A system comprising:

a processor; and

a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:

detecting, from a set of frames, a first gesture and a second gesture, the first gesture corresponding to a first pinch gesture and the second gesture corresponding to a second pinch gesture, the first pinch gesture and the second pinch gesture corresponding to different hands, the first pinch gesture comprising two different fingers of a first hand touching, and the second pinch gesture comprising two different of a second hand touching, the first pinch gesture and the second pinch gesture being detected in at least one same frame from the set of frames;

detecting a first location and a first position of a first representation of a first finger from the first gesture and a second location and a second position of a second representation of a second finger from the first gesture;

detecting a first particular location and a first particular position of a first particular representation of a first particular finger from the second gesture and a second particular location and a second particular position of a second particular representation of a second particular finger from the second gesture;

detecting a first change in the first location and the first position and a second change in the second location and the second position;

detecting a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position;

in response to the first change, second change, first particular change, and second particular change, generating a set of virtual objects along a line from the first location and the first position to the first particular location and the first particular position, wherein a first distance between the first change and the first particular change is greater than a threshold distance value, and a second distance between the second change and the second particular change are greater than the threshold distance value;

detecting, from a different set of frames, a first collision event corresponding to a first collider of the first representation of the first finger intersecting with a second collider of a first virtual object from the generated set of virtual objects;

in response to the first collision event, selecting the first virtual object and generating augmented reality content associated with the selected first virtual object;

detecting, from a second different set frames, a third gesture and a fourth gesture, the third gesture corresponding to a third pinch gesture and the fourth gesture corresponding to a fourth pinch gesture, the third pinch gesture and the fourth pinch gesture corresponding to different hands;

in response to detecting the third gesture and the fourth gesture, moving the set of virtual objects to be arranged in a second line based on spatial positions of the third pinch gesture and the fourth pinch gesture, wherein the second line is different from the line;

rendering the set of virtual objects within a first scene; and

providing for display the rendered set of virtual objects within the first scene.

12 . The system of claim 11 , wherein the first change and the second change does not result in an in increase in a distance greater than a first threshold value between the first representation of the first finger and the second representation of the second finger, and the first finger and the second finger is from a same first hand, and

wherein the first particular change and the second particular change does not result in an in increase in a distance greater than a first particular threshold value between the first particular representation of the first particular finger and the second particular representation of the second particular finger, and the first particular finger and the second particular finger is from a same second hand.

13 . The system of claim 11 , wherein the operations further comprise:

detecting, from a second set of frames, a third location and a third position of the first representation of the first finger and a fourth location and a fourth position of the second representation of the second finger;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position, wherein the third change and the fourth change result in an increase in a distance greater than a threshold value between the first representation of the first finger and the second representation of the second finger, and the first finger and the second finger is from a same hand;

detecting, from the second set of frames, a third particular location and a third particular position of the first particular representation of the first particular finger and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position, wherein the third particular change and the fourth particular change result in an increase in a distance greater than a particular threshold value between the first particular representation of the first particular finger and the second particular representation of the second particular finger, and the first particular finger and the second particular finger is from a same second hand; and

in response to detecting the third change, the fourth change, the third particular change, and the fourth particular change, ceasing generating the set of virtual objects along the line from the first location and the first position to the first particular location and the first particular position.

14 . The system of claim 13 , wherein the operations further comprise:

performing an operation in connection with the selection, the operation comprising generating augmented reality content associated with the selected first virtual object for display within the first scene.

15 . The system of claim 13 , wherein the operations further comprise:

detecting a third location and a third position of the first representation of the first finger from the third gesture and a fourth location and a fourth position of the second representation of the second finger from the third gesture;

detecting a third particular location and a third particular position of the first particular representation of the first particular finger from the fourth gesture and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger from the fourth gesture;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position;

in response to the third change, fourth change, third particular change, and fourth particular change, moving the set of virtual objects to be arranged in a second line from the third location and the third position to the third particular location and the third particular position, wherein a third distance between the third change and the third particular change is greater than a particular threshold distance value, and a fourth distance between the fourth change and the fourth particular change are greater than the particular threshold distance value;

rendering the moved set of virtual objects within the first scene; and

providing for display the rendered moved set of virtual objects within the first scene.

16 . The system of claim 13 , wherein the operations further comprise:

detecting, from a fifth set of frames, a third gesture and a fourth gesture, the third gesture corresponding to a third pinch gesture and the fourth gesture corresponding to a fourth pinch gesture, the third pinch gesture and the fourth pinch gesture corresponding to different hands;

detecting a third location and a third position of the first representation of the first finger from the third gesture and a fourth location and a fourth position of the second representation of the second finger from the third gesture;

detecting a third particular location and a third particular position of the first particular representation of the first particular finger from the fourth gesture and a fourth particular location and a fourth particular position of the second particular representation of the second particular finger from the fourth gesture;

detecting a third change in the third location and the third position and a fourth change in the fourth location and the fourth position;

detecting a third particular change in the third particular location and the third particular position and a fourth particular change in the fourth particular location and the fourth particular position;

in response to the third change, fourth change, third particular change, and fourth particular change, moving the set of virtual objects to be overlaid on each other such that only a single virtual object is visible within the first scene, wherein a third distance between the third change and the third particular change is less than a particular threshold distance value, and a fourth distance between the fourth change and the fourth particular change are less than the particular threshold distance value;

rendering the moved set of virtual objects within the first scene; and

providing for display the rendered moved set of virtual objects within the first scene.

17 . The system of claim 15 , wherein the rendered moved set of virtual objects are arranged in a vertical manner.

18 . The system of claim 15 , wherein moving the set of virtual objects to be arranged in the second line comprises:

removing a first set of virtual objects from set of virtual objects to provide a second set of objects, the removing based at least in part on a length of the second line such that the second set of objects are arranged to fit along the second line without overlapping each other and the set of virtual objects are unable to fit along the second line without at least one virtual object being overlaid with a second virtual object; and

moving the second set of objects to be arranged in the second line.

19 . The system of claim 18 , wherein moving the set of virtual objects to be overlaid on each other such that only a single virtual object is visible within the first scene comprises:

removing a first set of virtual objects from set of virtual objects to provide the single virtual object.

20 . A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

detecting, from a set of frames, a first gesture and a second gesture, the first gesture corresponding to a first pinch gesture and the second gesture corresponding to a second pinch gesture, the first pinch gesture and the second pinch gesture corresponding to different hands, the first pinch gesture comprising two different fingers of a first hand touching, and the second pinch gesture comprising two different of a second hand touching, the first pinch gesture and the second pinch gesture being detected in at least one same frame from the set of frames;

detecting a first location and a first position of a first representation of a first finger from the first gesture and a second location and a second position of a second representation of a second finger from the first gesture;

detecting a first particular location and a first particular position of a first particular representation of a first particular finger from the second gesture and a second particular location and a second particular position of a second particular representation of a second particular finger from the second gesture;

detecting a first change in the first location and the first position and a second change in the second location and the second position;

detecting a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position;

in response to the first change, second change, first particular change, and second particular change, generating a set of virtual objects along a line from the first location and the first position to the first particular location and the first particular position, wherein a first distance between the first change and the first particular change is greater than a threshold distance value, and a second distance between the second change and the second particular change are greater than the threshold distance value;

detecting, from a different set of frames, a first collision event corresponding to a first collider of the first representation of the first finger intersecting with a second collider of a first virtual object from the generated set of virtual objects;

in response to the first collision event, selecting the first virtual object and generating augmented reality content associated with the selected first virtual object;

detecting, from a second different set frames, a third gesture and a fourth gesture, the third gesture corresponding to a third pinch gesture and the fourth gesture corresponding to a fourth pinch gesture, the third pinch gesture and the fourth pinch gesture corresponding to different hands;

in response to detecting the third gesture and the fourth gesture, moving the set of virtual objects to be arranged in a second line based on spatial positions of the third pinch gesture and the fourth pinch gesture, wherein the second line is different from the line;

rendering the set of virtual objects within a first scene; and

providing for display the rendered set of virtual objects within the first scene.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2025
From: GOODRICH, KYLE; LAZAROV, MAXIM MAXIMOV; MORENO, DANIEL
To: SNAP INC.
Reel/Frame 070411/0216 →
EMPLOYEE CONFIDENTIAL INFORMATION AND INVENTIONS ASSIGNMENT AGREEMENT Recorded Mar 5, 2025
From: MCPHEE, ANDREW
To: SNAPCHAT, INC.
Reel/Frame 070410/0875 →
CHANGE OF NAME Recorded Mar 5, 2025
From: SNAPCHAT, INC.
To: SNAP INC.
Reel/Frame 070412/0114 →
Continuity (1)
Related Publication 20240087245A1 · Mar 14, 2024
References Cited (249)
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 7996793B2 · Latta et al. · 2011 [cited by applicant]
US 8487938B2 · Latta et al. · 2013 [cited by applicant]
US 8856691B2 · Geisner et al. · 2014 [cited by applicant]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9230160B1 · Kanter · 2016 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9383895B1 · Vinayak et al. · 2016 [cited by applicant]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10475246B1 · Gribetz et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10567449B2 · Harner et al. · 2020 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10732725B2 · Chou et al. · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11017611B1 · Mount et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11054896B1 · Wilytsch et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11227637B1 · Collins et al. · 2022 [cited by applicant]
US 11948266B1 · Goodrich et al. · 2024 [cited by applicant]
US 11995780B2 · Goodrich et al. · 2024 [cited by applicant]
US 12034785B2 · Yerli · 2024 [cited by applicant]
US 12374055B2 · Goodrich et al. · 2025 [cited by applicant]
US 12380925B2 · Goodrich et al. · 2025 [cited by applicant]
US 12456263B2 · Goodrich et al. · 2025 [cited by applicant]
US 20070174774A1 · Lerman et al. · 2007 [cited by applicant]
US 20090012788A1 · Gilbert et al. · 2009 [cited by applicant]
US 20100050120A1 · Ohazama et al. · 2010 [cited by applicant]
US 20110050562A1 · Schoen et al. · 2011 [cited by applicant]
US 20110261083A1 · Wilson · 2011 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20120113223A1 · Hilliges et al. · 2012 [cited by applicant]
US 20120293544A1 · Miyamoto et al. · 2012 [cited by applicant]
US 20130155255A1 · Yu · 2013 [cited by applicant]
US 20130265220A1 · Fleischmann et al. · 2013 [cited by applicant]
US 20130278499A1 · Anderson · 2013 [cited by applicant]
US 20130303247A1 · Wu et al. · 2013 [cited by applicant]
US 20130307875A1 · Anderson · 2013 [cited by applicant]
US 20140171036A1 · Simmons · 2014 [cited by applicant]
US 20140235350A1 · Langridge et al. · 2014 [cited by applicant]
US 20150097862A1 · Reisner-Kollmann et al. · 2015 [cited by applicant]
US 20150120293A1 · Wohlert et al. · 2015 [cited by applicant]
US 20150169076A1 · Cohen et al. · 2015 [cited by applicant]
US 20150169176A1 · Cohen · 2015 [cited by examiner]
US 20150220149A1 · Plagemann et al. · 2015 [cited by applicant]
US 20150229837A1 · Her et al. · 2015 [cited by applicant]
US 20150318020A1 · Pribula · 2015 [cited by applicant]
US 20150370320A1 · Connor · 2015 [cited by applicant]
US 20170092293A1 · Kristjansson · 2017 [cited by applicant]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170237789A1 · Harner et al. · 2017 [cited by applicant]
US 20170277684A1 · Dharmarajan Mary · 2017 [cited by applicant]
US 20170277685A1 · Takumi · 2017 [cited by applicant]
US 20170351910A1 · Elwazer et al. · 2017 [cited by applicant]
US 20180045963A1 · Hoover et al. · 2018 [cited by applicant]
US 20180158370A1 · Pryor · 2018 [cited by applicant]
US 20180210628A1 · Mcphee et al. · 2018 [cited by applicant]
US 20180314337A1 · Iwanami · 2018 [cited by applicant]
US 20190215544A1 · Hemmati et al. · 2019 [cited by applicant]
US 20190258072A1 · Youngstrom et al. · 2019 [cited by applicant]
US 20200043243A1 · Bhushan et al. · 2020 [cited by applicant]
US 20200097091A1 · Chou et al. · 2020 [cited by applicant]
US 20200117335A1 · Mani et al. · 2020 [cited by applicant]
US 20200226814A1 · Tang et al. · 2020 [cited by applicant]
US 20200304708A1 · Lee et al. · 2020 [cited by applicant]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210335148A1 · Fujiwara et al. · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20220083197A1 · Rockel et al. · 2022 [cited by applicant]
US 20220171468A1 · Konishi · 2022 [cited by applicant]
US 20220198760A1 · Serizawa et al. · 2022 [cited by applicant]
US 20220214743A1 · Dascola · 2022 [cited by examiner]
US 20220223179A1 · Kang et al. · 2022 [cited by applicant]
US 20220335246A1 · Bin W Mohamad Fablillah et al. · 2022 [cited by applicant]
US 20220408164A1 · Lee et al. · 2022 [cited by applicant]
US 20230125393A1 · Cheng et al. · 2023 [cited by applicant]
US 20230154134A1 · Oh · 2023 [cited by applicant]
US 20230342024A1 · Ku et al. · 2023 [cited by applicant]
US 20240087239A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087242A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087243A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087244A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087246A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087264A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240087609A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240185548A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240265652A1 · Goodrich et al. · 2024 [cited by applicant]
US 20240281072A1 · Nagano et al. · 2024 [cited by applicant]
US 20250322617A1 · Goodrich et al. · 2025 [cited by applicant]
US 20250336423A1 · Goodrich et al. · 2025 [cited by applicant]
US 20260073652A1 · Goodrich et al. · 2026 [cited by applicant]
CN 103049761 · 2016 [cited by applicant]
CN 107533373A · 2018 [cited by applicant]
CN 108762505 · 2018 [cited by applicant]
CN 110889382A · 2020 [cited by applicant]
CN 110991327 · 2020 [cited by applicant]
CN 113608619 · 2021 [cited by applicant]
CN 113867531 · 2021 [cited by applicant]
CN 119836615A · 2025 [cited by applicant]
CN 119836616A · 2025 [cited by applicant]
CN 119856136A · 2025 [cited by applicant]
CN 119856137A · 2025 [cited by applicant]
CN 119856223A · 2025 [cited by applicant]
CN 119895353A · 2025 [cited by applicant]
CN 119895354A · 2025 [cited by applicant]
CN 119895355A · 2025 [cited by applicant]
EP 3118722 · 2017 [cited by applicant]
EP 3155560 · 2017 [cited by applicant]
EP 3707693 · 2020 [cited by applicant]
JP 2004187043 · 2004 [cited by applicant]
KR 20200117685 · 2020 [cited by applicant]
WO 2012166680 · 2012 [cited by applicant]
WO 2013077883 · 2013 [cited by applicant]
WO 2015192117 · 2015 [cited by applicant]
WO WO2015192117A1 · 2015 [cited by examiner]
WO 2016168591 · 2016 [cited by applicant]
WO 2019094618 · 2019 [cited by applicant]
WO 2021172832 · 2021 [cited by applicant]
WO 2024054888 · 2024 [cited by applicant]
WO 2024054906 · 2024 [cited by applicant]
WO 2024054909 · 2024 [cited by applicant]
WO 2024054915 · 2024 [cited by applicant]
WO 2024054995 · 2024 [cited by applicant]
WO 2024054999 · 2024 [cited by applicant]
WO 2024055001 · 2024 [cited by applicant]
WO 2024055004 · 2024 [cited by applicant]
U.S. Appl. No. 17/941,292, filed Sep. 9, 2022, Auto Trimming for Augmented Reality Content in Messaging Systems. [cited by applicant]
U.S. Appl. No. 17/941,303, filed Sep. 9, 2022, Cursor Functionality for Augmented Reality Content in Messaging Systems. [cited by applicant]
U.S. Appl. No. 17/941,293, filed Sep. 9, 2022, 3D Cursor Functionality for Augmented Reality Content in Messaging Systems. [cited by applicant]
U.S. Appl. No. 17/941,301, filed Sep. 9, 2022, Shooting Interaction Using Augmented Reality Content in a Messaging System. [cited by applicant]
U.S. Appl. No. 17/941,612, filed Sep. 9, 2022, Trigger Gesture for Selection of Augmented Reality Content in Messaging Systems. [cited by applicant]
U.S. Appl. No. 17/941,435, filed Sep. 9, 2022, Virtual Object Manipulation With Gestures in a Messaging System. [cited by applicant]
U.S. Appl. No. 17/930,927, filed Sep. 9, 2022, Sculpting Augmented Reality Content Using Gestures in a Messaging System. [cited by applicant]
U.S. Appl. No. 18/638,273, filed Apr. 17, 2024, Shooting Interaction Using Augmented Reality Content in a Messaging System. [cited by applicant]
“U.S. Appl. No. 17/941,301, Non Final Office Action mailed Sep. 21, 2023”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Non Final Office Action mailed Oct. 6, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,435, Notice of Allowance mailed Nov. 8, 2023”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073776, International Search Report mailed Nov. 17, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073776, Written Opinion mailed Nov. 17, 2023”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073781, International Search Report mailed Dec. 1, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073781, Written Opinion mailed Dec. 1, 2023”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073639, International Search Report mailed Dec. 1, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073639, Written Opinion mailed Dec. 1, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073609, International Search Report mailed Dec. 6, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073609, Written Opinion mailed Dec. 6, 2023”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073783, International Search Report mailed Dec. 6, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073783, Written Opinion mailed Dec. 6, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073647, International Search Report mailed Dec. 12, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073647, Written Opinion mailed Dec. 12, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073635, International Search Report mailed Dec. 13, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073635, Written Opinion mailed Dec. 13, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073786, International Search Report mailed Dec. 18, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 073786, Written Opinion mailed Dec. 18, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,301, Response filed Dec. 21, 2023 to Non Final Office Action mailed Sep. 21, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Response filed Jan. 8, 2024 to Non Final Office Action mailed Oct. 6, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,301, Notice of Allowance mailed Jan. 25, 2024”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,435, Corrected Notice of Allowability mailed Feb. 16, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Non Final Office Action mailed Mar. 21, 2024”, 20 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Final Office Action mailed Mar. 25, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,435, Notice of Allowance mailed Jun. 12, 2023”, 8 pgs. [cited by applicant]
Panzarino, Matthew, “Snapchat Adds Filters, A Replay Function and for Whatever Reason, Time, Temperature and Speed Overlays”, TechCrunch, [Online] Retrieved form the Internet: URL: https: techcrunch.com 2013 12 20 snapc… [cited by applicant]
U.S. Appl. No. 18/436,818, filed Feb. 8, 2024, Virtual Object Manipulation With Gestures in a Messaging System. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Jun. 20, 2024 to Non Final Office Action mailed Mar. 21, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Response filed Jun. 25, 2024 to Final Office Action mailed Mar. 25, 2024”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Final Office Action mailed Jul. 1, 2024”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Non Final Office Action mailed Sep. 10, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Oct. 1, 2024 to Final Office Action mailed Jul. 1, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/638,273, Non Final Office Action mailed Nov. 7, 2024”, 32 pgs. [cited by applicant]
“U.S. Appl. No. 17/930,927, Response filed Oct. 13, 2025 to Final Office Action mailed Jul. 11, 2025”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Final Office Action mailed Oct. 17, 2025”, 30 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Sep. 16, 2025 to Non Final Office Action mailed Jun. 16, 2025”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 18/436,818, Notice of Allowance mailed Aug. 18, 2025”, 6 pgs. [cited by applicant]
“Chinese Application Serial No. 202380064732.4, Voluntary Amendment filed Jul. 24, 2025”, w/English claims, 11 pgs. [cited by applicant]
“Chinese Application Serial No. 202380064767.8, Voluntary Amendment filed Jul. 25, 2025”, w/English Claims, 12 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011548, Notice of Preliminary Rejection mailed Aug. 26, 2025”, W/English Translation, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/930,927, Non Final Office Action mailed Feb. 28, 2025”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 17/930,927, Response filed May 28, 2025 to Non Final Office Action mailed Feb. 28, 2025”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Notice of Allowance mailed Apr. 2, 2025”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Response filed Dec. 10, 2024 to Non Final Office Action mailed Sep. 10, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Examiner Interview Summary mailed Jun. 4, 2025”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Final Office Action mailed Mar. 6, 2025”, 28 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Non Final Office Action mailed Nov. 26, 2024”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Feb. 26, 2025 to Non Final Office Action mailed Nov. 26, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,303, Non Final Office Action mailed Mar. 4, 2025”, 24 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,303, Response filed Jun. 4, 2025 to Non Final Office Action mailed Mar. 4, 2025”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,612, Notice of Allowance mailed Mar. 19, 2025”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,612, Notice of Allowance mailed Dec. 18, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/436,818, Non Final Office Action mailed Feb. 12, 2025”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/436,818, Response filed May 12, 2025 to Non Final Office Action mailed Feb. 12, 2025”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/638,273, Notice of Allowance mailed Mar. 12, 2025”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 18/638,273, Response filed Feb. 6, 2025 to Non Final Office Action mailed Nov. 7, 2024”, 10 pgs. [cited by applicant]
“Chinese Application Serial No. 202380064674.5, Voluntary Amendment filed May 30, 2025”, w/ English Claims, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073609, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073635, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073639, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073647, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073776, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073781, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073783, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/073786, International Preliminary Report on Patentability mailed Mar. 20, 2025”, 8 pgs. [cited by applicant]
Von Kapri, Anette Lia Freiin, “InReach: Navigating and Manipulating 3D Models using Natural Body Gestures in a Remote Collaboration Setup”, Massachusetts Institute of Technology, Thesis, (Jun. 2013), 83 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011442, Response filed Aug. 28, 2025 to Notice of Preliminary Rejection mailed Jun. 30, 2025”, w current English claims, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Jun. 6, 2025 to Final Office Action mailed Mar. 6, 2025”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Non Final Office Action mailed Jun. 16, 2025”, 30 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,292, Corrected Notice of Allowability mailed Jul. 1, 2025”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,303, Notice of Allowance mailed Jul. 2, 2025”, 6 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011442, Notice of Preliminary Rejection mailed Jun. 30, 2025”, with English translation, 5 pages. [cited by applicant]
“U.S. Appl. No. 17/930,927, Final Office Action mailed Jul. 11, 2025”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 18/436,818, Notice of Allowance mailed Jul. 16, 2025”, 7 pgs. [cited by applicant]
Frees, Scott, “Precise and Rapid Interaction through Scaled Manipulation in Immersive Virtual Environments”, IEEE Proceedings. VR 2005. Virtual Reality, (Mar. 16, 2005). [cited by applicant]
“Chinese Application Serial No. 202380064674.5, Office Action mailed Dec. 18, 2025”, w English translation, 11 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011442, Notice of Preliminary Rejection mailed Jan. 12, 2026”, w English Translation, 12 pgs. [cited by applicant]
“Chinese Application Serial No. 202380064767.8, Office Action mailed Dec. 20, 2025”, w English translation, 19 pgs. [cited by applicant]
“Chinese Application Serial No. 202380064764.4, Office Action mailed Jan. 20, 2026”, W/English Translation, 10 pgs. [cited by applicant]
“European Application Serial No. 23782714.2, Communication Pursuant to Article 94(3) EPC mailed Mar. 20, 2026”, 5 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011460, Notice of Preliminary Rejection mailed Mar. 20, 2026”, w/o English translation, 8 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011591, Notice of Preliminary Rejection mailed Mar. 19, 2026”, w/ English translation, 20 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011617, Notice of Preliminary Rejection mailed Mar. 9, 2026”, w/ English Translation, 20 pgs. [cited by applicant]
“Korean Application Serial No. 10-2025-7011619, Notice of Preliminary Rejection mailed Feb. 19, 2026”, w/ English translation, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/930,927, Response filed Feb. 25, 2026 to Non Final Office Action mailed Nov. 28, 2025”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Non Final Office Action mailed Mar. 16, 2026”, 36 pgs. [cited by applicant]
“U.S. Appl. No. 17/941,293, Response filed Feb. 17, 2026 to Final Office Action mailed Oct. 17, 2025”, 14 pgs. [cited by applicant]