IP Library › Granted Patent US 12,244,956
Granted Patent B2
US 12,244,956 · App. 18/099,683 · Granted Mar 4, 2025

Recorded sound thumbnail

Inventors: Nathan Kenneth Boyd (Los Angeles, CA); Jonathan Dale Brody (Marina del Rey, CA); Andrew Grosvenor Cooper (Los Angeles, CA); Joseph Timothy Fortier (Los Angeles, CA); Brandon Francis (New York, NY); Christie Marie Heikkinen (Santa Monica, CA); Ranidu Lankage (Belmont, CA)
Assignee: SNAP INC.
H04N5/2621G06F16/683G06T5/70G06T5/73H04L51/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,244,956
App. No.
18/099,683
Granted
Mar 4, 2025
Kind
B2
Abstract

Aspects of the present disclosure involve a system and a method for performing operations comprising: displaying, by a messaging application, a sound capture screen that enables a user to record the sound; after the sound is recorded using the sound capture screen, generating, by the messaging application, a visual element associated with the sound; receiving, by the messaging application, selection of the visual element from a displayed list of visual elements representing different sounds; in response to receiving the selection of the visual element, conditionally adding one or more graphics representing the sound to one or more images at a user selected position based on a privacy status of the sound; and playing, by the messaging application, the sound associated with the visual element together with displaying the one or more images.

Claims (77)

1. A method comprising:

determining whether to add, by at least one processor, one or more graphics representing a sound recorded by a client device on top of a portion of one or more images based on a privacy status of the sound, the privacy status being associated with a permission of a recipient to share the sound with a set of users associated with the recipient;

in response to determining that the privacy status of the sound corresponds to a public sound:

presenting to the recipient the one or more images that include the one or more graphics with the one or more graphics displayed on top of a portion of the one or more images;

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient, the one or more graphics being displayed on the top of the portion of the one or more images; and

in response to determining that the privacy status of the sound corresponds to a private sound:

presenting to the recipient the one or more images that include the one or more graphics without displaying the one or more graphics; and

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient without presenting the one or more graphics representing the sound.

2. The method of claim 1 , further comprising:

displaying a sound capture screen that enables a user of the client device to record the sound;

after the sound is recorded using the sound capture screen, generating the one or more graphics associated with the sound; and

receiving selection of the one or more graphics from a displayed list of the one or more graphics representing different sounds to trigger conditionally adding the one or more graphics.

3. The method of claim 1 , further comprising:

receiving a user selection of a sound icon overlaid onto one or more images captured by the client device; and

in response to receiving the user selection of the sound icon, presenting a menu of sounds, the menu comprising an option to create a sound.

4. The method of claim 3 , wherein a sound capture screen is displayed in response to receiving the user selection of the sound icon.

5. The method of claim 1 , further comprising:

activating a video capture device of the client device;

blurring or dimming images captured by the video capture device;

displaying a border around the blurred or dimmed images; and

displaying a sound recording option together with a waveform.

6. The method of claim 5 , further comprising:

receiving a first input that selects the sound recording option;

starting to record audio content captured by a microphone of the client device in response to the first input;

receiving a second input that selects the sound recording option again;

terminating recording audio content captured by a microphone of the client device in response to the second input; and

storing the audio content that has been recorded between the first and second inputs as the sound.

7. The method of claim 6 , further comprising:

animating the waveform based on the audio content while the audio content is being recorded; and

populating a progress bar associated with the sound recording option while the audio content is being recorded.

8. The method of claim 7 , wherein the progress bar represents a maximum duration for recording the sound.

9. The method of claim 6 , wherein the audio content is recorded without recording the images captured by the video capture device.

10. The method of claim 1 , further comprising:

after the sound is recorded using a sound capture screen, displaying a plurality of options, the plurality of options comprising a first option for associating a name with the sound and a second option for trimming a starting and ending portion of the sound.

11. The method of claim 10 , further comprising looping playback of the sound while the plurality of options is displayed.

12. The method of claim 10 , wherein the plurality of options comprise a third option for making the sound publicly available, further comprising:

receiving input that selects the third option to make the sound publicly available;

determining that the third option has been selected by a user for a first time; and

in response to determining that the third option has been selected by a user for the first time, presenting a dialog box indicating that the sound will be available for other users of a messaging application to incorporate into images captured by the other users.

13. The method of claim 10 , wherein the plurality of options comprise a third option for making the sound publicly available, further comprising:

receiving input that selects the third option to make the sound publicly available; and

presenting an attribution option allowing a user to specify a name of a creator of the sound in addition to the name of the sound.

14. The method of claim 1 , further comprising:

determining the privacy status of the sound;

assigning a first visual property to the one or more graphics within a list in response to determining that the privacy status of the sound indicates that the sound is a private sound; and

assigning a second visual property to the one or more graphics within the list in response to determining that the privacy status of the sound indicates that the sound is a public sound.

15. The method of claim 1 , further comprising:

determining that the privacy status of the sound indicates that the sound is a public sound;

sending the one or more images and the sound associated with the one or more graphics to one or more recipients associated with client devices;

and

enabling the one or more recipients to share the sound with respective sets of friends associated with the one or more recipients in response to receiving inputs from the one or more recipients that select the one or more graphics representing the sound that are included in the one or more images.

16. The method of claim 1 , wherein the one or more graphics representing the sound comprise a name of the sound, a visual representation of a creator of the sound, and an animated waveform.

17. A system comprising:

at least one processor configured to perform operations comprising:

determining whether to add one or more graphics representing a sound recorded by a client device on top of a portion of one or more images based on a privacy status of the sound, the privacy status being associated with a permission of a recipient to share the sound with a set of users associated with the recipient;

in response to determining that the privacy status of the sound corresponds to a public sound:

presenting to the recipient the one or more images that include the one or more graphics with the one or more graphics displayed on top of a portion of the one or more images;

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient, the one or more graphics being displayed on the top of the portion of the one or more images; and

in response to determining that the privacy status of the sound corresponds to a private sound:

presenting to the recipient the one or more images that include the one or more graphics without displaying the one or more graphics; and

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient without presenting the one or more graphics representing the sound.

18. The system of claim 17 , the operations further comprising:

displaying a sound capture screen that enables a user of the client device to record the sound;

after the sound is recorded using the sound capture screen, generating a one or more graphics associated with the sound; and

receiving selection of the one or more graphics from a displayed list of the one or more graphics representing different sounds to trigger conditionally adding the one or more graphics.

19. The system of claim 17 , the operations comprising:

displaying a sound capture screen that enables a user of the client device to record the sound;

after the sound is recorded using the sound capture screen, generating a one or more graphics associated with the sound; and

receiving selection of the one or more graphics from a displayed list of the one or more graphics representing different sounds to trigger conditionally adding the one or more graphics.

20. A non-transitory machine-readable storage medium that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

determining whether to add one or more graphics representing a sound recorded by a client device on top of a portion of one or more images based on a privacy status of the sound, the privacy status being associated with a permission of a recipient to share the sound with a set of users associated with the recipient;

in response to determining that the privacy status of the sound corresponds to a public sound:

presenting to the recipient the one or more images that include the one or more graphics with the one or more graphics displayed on top of a portion of the one or more images;

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient, the one or more graphics being displayed on the top of the portion of the one or more images; and

in response to determining that the privacy status of the sound corresponds to a private sound:

presenting to the recipient the one or more images that include the one or more graphics without displaying the one or more graphics; and

playing the sound associated with the one or more graphics together with the one or more images, on a recipient device of the recipient without presenting the one or more graphics representing the sound.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2023
From: BOYD, NATHAN KENNETH; BRODY, JONATHAN DALE; COOPER, ANDREW GROSVENOR; FORTIER, JOSEPH TIMOTHY; FRANCIS, BRANDON; HEIKKINEN, CHRISTIE MARIE; LANKAGE, RANIDU
To: SNAP INC.
Reel/Frame 063771/0534 →
Continuity (3)
Continuation 16948451 · Sep 18, 2020
Provisional Application 62706872 · Sep 15, 2020
Related Publication 20230269345A1 · Aug 24, 2023
References Cited (29)
US 9706055B1 · Alothman · 2017 [cited by examiner]
US 10348658B2 · Rodriguez et al. · 2019 [cited by applicant]
US 10666587B1 · Adler et al. · 2020 [cited by applicant]
US 11595592B2 · Boyd et al. · 2023 [cited by applicant]
US 20070198509A1 · Nishio · 2007 [cited by examiner]
US 20090287326A1 · Schlosser et al. · 2009 [cited by applicant]
US 20100061197A1 · Yoshikawa et al. · 2010 [cited by applicant]
US 20110289452A1 · Jordan et al. · 2011 [cited by applicant]
US 20120072856A1 · Park et al. · 2012 [cited by applicant]
US 20130132843A1 · Marnett · 2013 [cited by applicant]
US 20140108084A1 · Bargetzi et al. · 2014 [cited by applicant]
US 20160048306A1 · Weil et al. · 2016 [cited by applicant]
US 20160105382A1 · Bin Mahfooz et al. · 2016 [cited by applicant]
US 20180077096A1 · Demattei · 2018 [cited by applicant]
US 20180373683A1 · Hullette et al. · 2018 [cited by applicant]
US 20190130629A1 · Chand et al. · 2019 [cited by applicant]
US 20220086367A1 · Boyd et al. · 2022 [cited by applicant]
CN 106575149 · 2017 [cited by applicant]
CN 116057917 · 2023 [cited by applicant]
WO WO2016057843A2 · 2016 [cited by applicant]
WO WO2022060791A1 · 2022 [cited by applicant]
“U.S. Appl. No. 16/948,451, Non Final Office Action mailed Jun. 16, 2022”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 16/948,451, Notice of Allowance mailed Oct. 26, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/948,451, Response filed Sep. 16, 2022 to Non Final Office Action mailed Jun. 16, 2022”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/050399, International Search Report mailed Jan. 4, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/050399, Written Opinion mailed Jan. 4, 2022”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/050399, International Preliminary Report on Patentability mailed Mar. 30, 2023”, 7 pgs. [cited by applicant]
“Chinese Application Serial No. 202180062836.2, Office Action mailed Jul. 12, 2024”, w/ English translation, 18 pgs. [cited by applicant]
Wu, Xiao-Qin, “Acquisition and Processing of Multimedia Materials in CAI Courseware”, Journal of Sichuan Normal University (Social Science Edition), vol. 23, No. 4, (Jul. 28, 2000), 3 pgs. [cited by applicant]