IP Library › Granted Patent US 12,192,667
Granted Patent B2
US 12,192,667 · App. 18/224,228 · Granted Jan 7, 2025

DIY effects image modification

Inventors: Kyle Goodrich (Venice, CA); Samuel Edward Hare (Los Angeles, CA); Maxim Maximov Lazarov (Culver City, CA); Tony Mathew (Los Angeles, CA); Andrew James McPhee (Culver City, CA); Daniel Moreno (New York, NY); Wentao Shang (Los Angeles, CA)
Assignee: Snap Inc.
H04N5/2621H04L51/046H04L51/10H04N5/2628H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,667
App. No.
18/224,228
Filed
Jul 20, 2023
Granted
Jan 7, 2025
Kind
B2
Art Unit
2639
USPC
348/239
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

Claims (53)

1. A system comprising:

at least one hardware processor; and

a memory storing instructions which, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:

receiving input comprising a selection of an effects option for activating an effects mode;

receiving a gesture that swipes in a first direction across a screen in which an image is displayed;

determining that a second effect is adjacent to a first effect currently applied to the image; and

selecting a second effect option in response to determining that the second effect is adjacent to the first effect.

2. The system of claim 1 , wherein the effects option comprises a user-customizable effects option, and wherein the operations further comprise:

displaying a plurality of image modification options on top of the image, the plurality of image modification options comprising the effects option.

3. The system of claim 1 , wherein the image is a frame of a real-time or previously stored video feed, and wherein the first effect is applied to the image automatically.

4. The system of claim 3 , the operations further comprise:

presenting, together with the video feed, a menu of options comprising a create option; and

displaying a plurality of image modification options comprising the effects option in response to receiving a user selection of the create option.

5. The system of claim 4 , wherein the plurality of image modification options overlays the video feed, and wherein the menu of options is displayed adjacent to the video feed.

6. The system of claim 4 , wherein the plurality of image modification options includes a three-dimensional (3D) captions option to enable a user to generate a 3D caption for the video feed, a 3D cutouts option to enable a user to generate a 3D cutout of an object depicted in the video feed, and a 3D paint option to enable a user to draw in 3D using one or more paint styles over the video feed.

7. The system of claim 1 , wherein the operations comprise, in response to receiving the input, displaying a plurality of effect options and the image proximate to the effects option.

8. The system of claim 1 , the operations further comprise:

selecting the first effect associated with the first effect option; and

applying the first effect instead of the second effect to the image.

9. The system of claim 8 , wherein selecting the first effect comprises:

receiving user input that scrolls a plurality of effect options within an array.

10. The system of claim 9 , wherein the operations comprise:

tapping the first effect option displayed in the array to select the first effect option.

11. The system of claim 1 , the operations further comprise:

displaying an option associated with modifying an attribute of the first effect.

12. The system of claim 1 , the operations further comprise:

replacing a display of an array comprising a plurality of effect options with a slider associated with different attributes of the first effect.

13. The system of claim 1 , wherein the operations further comprise:

determining a type of effect modification attribute of the first effect;

selecting the second effect associated with the second effect option;

determining that a type of effect modification attribute of the second effect is different from the type of effect modification attribute of the first effect; and

modifying a display property of an effect modification option to include a second display property in response to determining that the type of effect modification attribute of the second effect is different from the type of effect modification attribute of the first effect.

14. The system of claim 13 , wherein the operations further comprise:

receiving user input that drags a slider to a given attribute of the different attributes; and

modifying an attribute of the first effect applied to the image based on the given attribute.

15. The system of claim 14 , wherein the operations further comprise:

displaying, proximate to the slider, an icon corresponding to the effects option, wherein the icon is displayed in place of the effect modification option; and

replacing the display of the slider with the display of an array in response to receiving a user selection of the icon corresponding to the effects option.

16. The system of claim 14 , wherein the attribute that is modified comprises at least one of a color or intensity of the effect.

17. A method comprising:

receiving input comprising a selection of an effects option for activating an effects mode;

receiving a gesture that swipes in a first direction across a screen in which an image is displayed;

determining that a second effect is adjacent to a first effect currently applied to the image; and

selecting a second effect option in response to determining that the second effect is adjacent to the first effect.

18. The method of claim 17 , wherein the effects option comprises a user-customizable effects option, further comprising:

receiving, by an application, the image from a camera of a device; and

applying the first effect associated with the first effect option of a plurality of effect options to the image.

19. The method of claim 17 , wherein the image is a frame of a real-time or previously stored video feed, and wherein the first effect is applied to the image automatically.

20. A non-transitory machine-readable medium storing instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving input comprising a selection of an effects option for activating an effects mode;

receiving a gesture that swipes in a first direction across a screen in which an image is displayed;

determining that a second effect is adjacent to a first effect currently applied to the image; and

selecting a second effect option in response to determining that the second effect is adjacent to the first effect.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2023
From: GOODRICH, KYLE; HARE, SAMUEL EDWARD; LAZAROV, MAXIM MAXIMOV; MATHEW, TONY; MCPHEE, ANDREW JAMES; MORENO, DANIEL; SHANG, WENTAO
To: SNAP INC.
Reel/Frame 064325/0810 →
Continuity (4)
Continuation 17829907 · Jun 1, 2022
Continuation 15929484 · May 5, 2020
Provisional Application 62976916 · Feb 14, 2020
Related Publication 20230362318A1 · Nov 9, 2023
References Cited (31)
US 8954851B2 · Nielsen et al. · 2015 [cited by applicant]
US 11381756B2 · Goodrich et al. · 2022 [cited by applicant]
US 11758080B2 · Goodrich et al. · 2023 [cited by applicant]
US 20100111417A1 · Ward et al. · 2010 [cited by applicant]
US 20140237365A1 · Oberbrunner et al. · 2014 [cited by applicant]
US 20150067514A1 · Lewis et al. · 2015 [cited by applicant]
US 20180210628A1 · Mcphee et al. · 2018 [cited by applicant]
US 20190236334A1 · Babushkin · 2019 [cited by applicant]
US 20200045245A1 · Van Os et al. · 2020 [cited by applicant]
US 20210258511A1 · Goodrich et al. · 2021 [cited by applicant]
US 20220294997A1 · Goodrich et al. · 2022 [cited by applicant]
CN 115315726A · 2022 [cited by applicant]
KR 102669113 · 2024 [cited by applicant]
WO WO2014093713A1 · 2014 [cited by applicant]
WO WO2021163725A1 · 2021 [cited by applicant]
“U.S. Appl. No. 15/929,484, Non Final Office Action mailed Dec. 16, 2021”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 15/929,484, Notice of Allowance mailed Mar. 2, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 15/929,484, Response filed Feb. 9, 2022 to Non Final Office Action mailed Dec. 16, 2021”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/829,907, Corrected Notice of Allowability mailed May 5, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/829,907, Non Final Office Action mailed Nov. 15, 2022”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/829,907, Notice of Allowance mailed Apr. 25, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/829,907, Response filed Feb. 14, 2023 to Non Final Office Action mailed Nov. 15, 2022”, 10 pgs. [cited by applicant]
“European Application Serial No. 21753854.5, Response to Communication pursuant to Rules 161 and 162 filed Oct. 13, 2022”, 16 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/070142, International Preliminary Report on Patentability mailed Aug. 25, 2022”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/070142, International Search Report mailed Jun. 7, 2021”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/070142, Written Opinion mailed Jun. 7, 2021”, 7 pgs. [cited by applicant]
U.S. Appl. No. 15/929,484 U.S. Pat. No. 11,381,756, May 5, 2020, DIY Effects Image Modification. [cited by applicant]
U.S. Appl. No. 17/829,907, filed Jun. 1, 2022, DIY Effects Image Modification. [cited by applicant]
“Korean Application Serial No. 10-2022-7031395, Notice of Preliminary Rejection mailed Aug. 27, 2023”, w/ English Translation, 8 pgs. [cited by applicant]
“Korean Application Serial No. 10-2022-7031395, Response filed Oct. 23, 2023 to Notice of Preliminary Rejection mailed Aug. 27, 2023”, w/ English claims, 27 pgs. [cited by applicant]
“European Application Serial No. 21753854.5, Extended European Search Report mailed Feb. 12, 2024”, 6 pgs. [cited by applicant]
Cited By (2)
US 1,094,423 US 1,147,004