IP Library › Granted Patent US 12,547,295
Granted Patent B2
US 12,547,295 · App. 18/105,431 · Granted Feb 10, 2026

Smart carousel of image modifiers

Inventors: Samir Ahmed (Marina del Rey, CA); Farnaz Azmoodeh (Venice, CA)
Assignee: Snap Inc.
G06F3/0482G06F3/04847G06F3/0488G06T11/60H04N21/4312H04N21/4622G06F2203/04804G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,547,295
App. No.
18/105,431
Filed
Feb 3, 2023
Granted
Feb 10, 2026
Kind
B2
Art Unit
2174
USPC
715/825
Abstract

Embodiments of the present disclosure relate generally to techniques for automated organization and presentation of user-selectable features within user interfaces. More particularly, but not by way of limitation, the present disclosure addresses systems and methods for presenting and accessing filters within user interfaces displaying media content items.

Claims (52)

1 . A system comprising:

at least one processor; and

memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, cause the system to perform operations comprising:

receiving, via a user interface, an interaction related to a media content item;

identifying, based on a characteristic of the interaction related to the media content item, a set of image modifiers including one or more first image modifiers and one or more second image modifiers, wherein each respective image modifier has a modifier category identifier, identifying of the set of image modifiers comprising determining a modifier context based on the characteristic of the interaction, the modifier context associated with an intent of a user with respect to modifying the media content item;

presenting, via the user interface, a modifier carousel comprising a set of interface elements, each interface element within the set of interface elements representing a respective image modifier within the set of image modifiers, each interface element within the set of interface elements being user-selectable to apply the respective image modifier to the media content item, and the one or more first image modifiers automatically ordered ahead of the one or more second image modifiers based on the one or more first image modifiers having one or more first modifier category identifiers that match the modifier context associated with the intent of the user and the one or more second image modifiers having one or more second modifier category identifiers that do not match the modifier context associated with the intent of the user;

receiving, via the user interface, a user selection of a first interface element from among the set of interface elements, the first interface element corresponding to a target image modifier from among the set of image modifiers; and

applying, in response to receiving the user selection of the first interface element, the target image modifier to the media content item.

2 . The system of claim 1 , wherein the set of interface elements in the modifier carousel are presented in a prioritized list.

3 . The system of claim 2 , the operations further comprising:

ranking the image modifiers, the ranking of the image modifiers comprising determining a score for each of the image modifiers; and

automatically ordering the set of interface elements into the prioritized list based on the score for each of the image modifiers.

4 . The system of claim 1 , wherein the interaction related to the media content item comprises a predefined motion, directed at the user interface, to display the modifier carousel.

5 . The system of claim 1 , wherein the characteristic of the interaction related to the media content item is used as a primary characteristic in the identifying of the set of image modifiers.

6 . The system of claim 1 , wherein the modifier category identifier identifies a face modifier, an atmospheric modifier, a ground modifier, a face swapping modifier, an emotion modifier, or a costume modifier.

7 . The system of claim 1 , wherein the media content item corresponds to a real-time image captured by an image capture device of the system.

8 . The system of claim 1 , the operations further comprising:

presenting, via the user interface, a search icon outside of the modifier carousel, the search icon being user-selectable to search for a specific interface element within the set of interface elements.

9 . The system of claim 1 , the operations further comprising:

causing the first interface element to be presented proximate to or within an image capture element, the image capture element being user-selectable to capture an image which is based on applying the target image modifier to the media content item.

10 . The system of claim 1 , the operations further comprising:

receiving, via the user interface, a user selection of a second interface element from among the set of interface elements, the second interface element corresponding to a further target image modifier from among the set of image modifiers; and

applying, in response to receiving the user selection of the second interface element, the further target image modifier to the media content item.

11 . The system of claim 10 , the operations further comprising:

causing the second interface element to be presented proximate to or within an image capture element, the image capture element being user-selectable to capture an image which is based on applying the further target image modifier to the media content item.

12 . The system of claim 1 , the operations further comprising:

receiving a second media content item; and

causing the second media content item to be presented in conjunction with the modifier carousel.

13 . The system of claim 1 , wherein respective positions of interface elements in the set of interface elements in the modifier carousel are modifiable in response to input received via the user interface.

14 . The system of claim 13 , wherein the input received via the user interface identifies an image modifier selected by a user to be added to the set of image modifiers.

15 . The system of claim 1 , wherein the image modifiers in the set of image modifiers are ranked using one or more of: a pointwise ranking, a pairwise ranking, or a mean reciprocal ranking.

16 . The system of claim 1 , the operations further comprising:

detecting a user selection of one or more objects depicted in the media content item; and

determining the intent of the user based on the user selection of the one or more objects.

17 . A computer-implemented method comprising:

receiving, via a user interface, an interaction related to a media content item;

identifying, based on a characteristic of the interaction related to the media content item, a set of image modifiers including one or more first image modifiers and one or more second image modifiers, wherein each respective image modifier has a modifier category identifier, identifying of the set of image modifiers comprising determining a modifier context based on the characteristic of the interaction, the modifier context associated with an intent of a user with respect to modifying the media content item;

presenting, via the user interface, a modifier carousel comprising a set of interface elements, each interface element within the set of interface elements representing a respective image modifier within the set of image modifiers, each interface element within the set of interface elements being user-selectable to apply the respective image modifier to the media content item, and the one or more first image modifiers automatically ordered ahead of the one or more second image modifiers based on the one or more first image modifiers having one or more first modifier category identifiers that match the modifier context associated with the intent of the user and the one or more second image modifiers having one or more second modifier category identifiers that do not match the modifier context associated with the intent of the user;

receiving, via the user interface, a user selection of a first interface element from among the set of interface elements, the first interface element corresponding to a target image modifier from among the set of image modifiers; and

applying, in response to receiving the user selection of the first interface element, the target image modifier to the media content item.

18 . The computer-implemented method of claim 17 , further comprising:

detecting a user selection of one or more objects depicted in the media content item; and

determining the intent of the user based on the user selection of the one or more objects.

19 . A non-transitory computer-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:

receiving, via a user interface, an interaction related to a media content item;

identifying, based on a characteristic of the interaction related to the media content item, a set of image modifiers including one or more first image modifiers and one or more second image modifiers, wherein each respective image modifier has a modifier category identifier, identifying of the set of image modifiers comprising determining a modifier context based on the characteristic of the interaction, the modifier context associated with an intent of a user with respect to modifying the media content item;

presenting, via the user interface, a modifier carousel comprising a set of interface elements, each interface element within the set of interface elements representing a respective image modifier within the set of image modifiers, each interface element within the set of interface elements being user-selectable to apply the respective image modifier to the media content item, and the one or more first image modifiers automatically ordered ahead of the one or more second image modifiers based on the one or more first image modifiers having one or more first modifier category identifiers that match the modifier context associated with the intent of the user and the one or more second image modifiers having one or more second modifier category identifiers that do not match the modifier context associated with the intent of the user;

receiving, via the user interface, a user selection of a first interface element from among the set of interface elements, the first interface element corresponding to a target image modifier from among the set of image modifiers; and

applying, in response to receiving the user selection of the first interface element, the target image modifier to the media content item.

20 . The non-transitory computer-readable medium of claim 19 , the operations further comprising:

detecting a user selection of one or more objects depicted in the media content item; and

determining the intent of the user based on the user selection of the one or more objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: AHMED, SAMIR; AZMOODEH, FARNAZ
To: SNAP INC.
Reel/Frame 062689/0622 →
Continuity (3)
Continuation 15626418 · Jun 19, 2017
Provisional Application 62425500 · Nov 22, 2016
Related Publication 20230185428A1 · Jun 15, 2023
References Cited (163)
US 5485197A · Hoarty · 1996 [cited by applicant]
US 6038295A · Mattes · 2000 [cited by applicant]
US 6980909B2 · Root et al. · 2005 [cited by applicant]
US 7173651B1 · Knowles · 2007 [cited by applicant]
US 7411493B2 · Smith · 2008 [cited by applicant]
US 7535890B2 · Rojas · 2009 [cited by applicant]
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 7996793B2 · Latta et al. · 2011 [cited by applicant]
US 8028250B2 · Vronay et al. · 2011 [cited by applicant]
US 8131597B2 · Hudetz · 2012 [cited by applicant]
US 8199747B2 · Rojas et al. · 2012 [cited by applicant]
US 8332475B2 · Rosen et al. · 2012 [cited by applicant]
US 8487938B2 · Latta et al. · 2013 [cited by applicant]
US 8566722B2 · Gordon et al. · 2013 [cited by applicant]
US 8718333B2 · Wolf et al. · 2014 [cited by applicant]
US 8724622B2 · Rojas · 2014 [cited by applicant]
US 8752113B1 · Good · 2014 [cited by examiner]
US 8856691B2 · Geisner et al. · 2014 [cited by applicant]
US 8874677B2 · Rosen et al. · 2014 [cited by applicant]
US 8909679B2 · Root et al. · 2014 [cited by applicant]
US 8995433B2 · Rojas · 2015 [cited by applicant]
US 9040574B2 · Wang et al. · 2015 [cited by applicant]
US 9055416B2 · Rosen et al. · 2015 [cited by applicant]
US 9100806B2 · Rosen et al. · 2015 [cited by applicant]
US 9100807B2 · Rosen et al. · 2015 [cited by applicant]
US 9191776B2 · Root et al. · 2015 [cited by applicant]
US 9204252B2 · Root · 2015 [cited by applicant]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9230160B1 · Kanter · 2016 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9443227B2 · Evans et al. · 2016 [cited by applicant]
US 9489661B2 · Evans et al. · 2016 [cited by applicant]
US 9491134B2 · Rosen et al. · 2016 [cited by applicant]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 9798708B1 · Sharifi et al. · 2017 [cited by applicant]
US 10095386B2 · Yoon et al. · 2018 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10579869B1 · Xiong et al. · 2020 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11307747B2 · Dancie et al. · 2022 [cited by applicant]
US 11531402B1 · Stolzenberg · 2022 [cited by applicant]
US 11546505B2 · Canberk · 2023 [cited by applicant]
US 11635872B2 · Ahmed et al. · 2023 [cited by applicant]
US 20070186177A1 · Both et al. · 2007 [cited by applicant]
US 20070240079A1 · Flynt · 2007 [cited by examiner]
US 20090012788A1 · Gilbert et al. · 2009 [cited by applicant]
US 20090324103A1 · Gelfand et al. · 2009 [cited by applicant]
US 20110113384A1 · Gotcher et al. · 2011 [cited by applicant]
US 20110170787A1 · Gum · 2011 [cited by examiner]
US 20110202598A1 · Evans et al. · 2011 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20120105489A1 · Monroe · 2012 [cited by examiner]
US 20120209924A1 · Evans et al. · 2012 [cited by applicant]
US 20120304123A1 · Koradi · 2012 [cited by applicant]
US 20130232148A1 · MacDonald · 2013 [cited by examiner]
US 20130329060A1 · Yim · 2013 [cited by applicant]
US 20140171036A1 · Simmons · 2014 [cited by applicant]
US 20140184858A1 · Yu · 2014 [cited by examiner]
US 20140279079A1 · Gudorf et al. · 2014 [cited by applicant]
US 20140337321A1 · Coyote · 2014 [cited by examiner]
US 20140337791A1 · Agnetta et al. · 2014 [cited by applicant]
US 20150120293A1 · Wohlert et al. · 2015 [cited by applicant]
US 20150212664A1 · Freer · 2015 [cited by examiner]
US 20150221066A1 · Kobayashi · 2015 [cited by applicant]
US 20150277849A1 · Beaumier · 2015 [cited by examiner]
US 20150370320A1 · Connor · 2015 [cited by applicant]
US 20160085863A1 · Allen et al. · 2016 [cited by applicant]
US 20160188658A1 · Thomson et al. · 2016 [cited by applicant]
US 20160196584A1 · Franklin et al. · 2016 [cited by applicant]
US 20160292926A1 · Rosenthal · 2016 [cited by examiner]
US 20160358229A1 · Bhalgat et al. · 2016 [cited by applicant]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170277684A1 · Dharmarajan Mary · 2017 [cited by applicant]
US 20170277685A1 · Takumi · 2017 [cited by applicant]
US 20170351910A1 · Elwazer et al. · 2017 [cited by applicant]
US 20170352092A1 · Mitchell · 2017 [cited by examiner]
US 20180039406A1 · Kong · 2018 [cited by examiner]
US 20180143748A1 · Ahmed et al. · 2018 [cited by applicant]
US 20180158370A1 · Pryor · 2018 [cited by applicant]
US 20190362469A1 · Ilic et al. · 2019 [cited by applicant]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20210405761A1 · Canberk · 2021 [cited by applicant]
US 20220188539A1 · Chan et al. · 2022 [cited by applicant]
US 20220206588A1 · Canberk et al. · 2022 [cited by applicant]
US 20220300730A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220300731A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220326781A1 · Hwang et al. · 2022 [cited by applicant]
US 20220334649A1 · Hwang et al. · 2022 [cited by applicant]
US 20230343038A1 · Xiao · 2023 [cited by examiner]
CA 2887596 · 2015 [cited by applicant]
CN 103049761 · 2016 [cited by applicant]
EP 3707693 · 2020 [cited by applicant]
KR 102263125 · 2021 [cited by applicant]
KR 20220158824 · 2022 [cited by applicant]
WO 2012058602 · 2012 [cited by applicant]
WO 2016168591 · 2016 [cited by applicant]
WO 2018098171 · 2018 [cited by applicant]
WO 2019094618 · 2019 [cited by applicant]
WO 2022005687 · 2022 [cited by applicant]
WO 2022005693 · 2022 [cited by applicant]
WO 2022060549 · 2022 [cited by applicant]
WO 2022066578 · 2022 [cited by applicant]
WO 2022132381 · 2022 [cited by applicant]
WO 2022146678 · 2022 [cited by applicant]
WO 2022198182 · 2022 [cited by applicant]
WO 2022216784 · 2022 [cited by applicant]
WO 2022225761 · 2022 [cited by applicant]
WO 2022245765 · 2022 [cited by applicant]
“International Application Serial No. PCT US2017 062830, International Search Report mailed Feb. 6, 2018”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2017 062830, Written Opinion mailed Feb. 6, 2018”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Non Final Office Action mailed Mar. 22, 2019”, 16 pgs. [cited by applicant]
“International Application Serial No. PCT US2017 062830, International Preliminary Report on Patentability mailed Jun. 6, 2019”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Sep. 23, 2019 to Non Final Office Action mailed Mar. 22, 2019”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Final Office Action mailed Dec. 27, 2019”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Mar. 26, 20 to Final Office Action mailed Dec. 27, 2019”, 9 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7017974, Notice of Preliminary Rejection mailed May 21, 2020”, W English Translation, 14 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Non Final Office Action mailed Jun. 26, 2020”, 19 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7017974, Response Filed Jul. 21, 2020 to Notice of Preliminary Rejection mailed May 21, 2020”, w English Claims, 18 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Oct. 26, 2020 to Non Final Office Action mailed Jun. 26, 2020”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Examiner Interview Summary mailed Nov. 5, 2020”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Final Office Action mailed Nov. 20, 2020”, 19 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7017974, Final Office Action mailed Nov. 28, 2020”, w English Translation, 5 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Jan. 27, 2021 to Final Office Action mailed Nov. 20, 2020”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Examiner Interview Summary mailed Jan. 29, 2021”, 3 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7017974, Response filed Jan. 29, 2021 to Final Office Action mailed Nov. 28, 2020”, w English Claims, 23 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Non Final Office Action mailed Jul. 8, 2021”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Oct. 8, 2021 to Non Final Office Action mailed Jul. 8, 2021”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Final Office Action mailed Jan. 28, 2022”, 23 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed May 26, 2022 to Final Office Action mailed Jan. 28, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Non Final Office Action mailed Aug. 19, 2022”, 24 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Response filed Nov. 17, 2022 to Non Final Office Action mailed Aug. 19, 2022”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 15/626,418, Notice of Allowance mailed Dec. 22, 2022”, 11 pgs. [cited by applicant]
Leyden, John, “This SMS will self-destruct in 40 seconds”, [Online] Retrieved from the Internet: URL: http: www.theregister.co.uk 2005 12 12 stealthtext , (Dec. 12, 2005), 1 pg. [cited by applicant]