IP Library › Granted Patent US 12,373,161
Granted Patent B2
US 12,373,161 · App. 17/556,802 · Granted Jul 29, 2025

Selecting an audio track in association with multi-video clip capture

Inventors: Kaveh Anvaripour (Santa Monica, CA); Christine Barron (Los Angeles, CA); Wayne Mike Cao (Newark, CA); Andrew Grosvenor Cooper (Los Angeles, CA); Christie Marie Heikkinen (Santa Monica, CA); Ranidu Lankage (Belmont, CA)
Assignee: SNAP INC.
G06F3/165G11B27/031H04N21/439
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,161
App. No.
17/556,802
Filed
Dec 20, 2021
Granted
Jul 29, 2025
Kind
B2
Art Unit
2481
USPC
386/285
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing audio with captured video clips. The program and method provide for displaying, by a messaging application, a capture user interface for capturing video; providing a camera mode selection element which is selectable to switch between a first camera mode for capturing a single video clip and a second camera mode for capturing multiple video clips, to generate a media content item; providing an audio selection element which is selectable to select an audio track for the media content item; receiving, via the camera mode selection element, first user input selecting the second camera mode; receiving, via the audio selection element, second user input selecting the audio track; and providing for capturing multiple video clips in association with the selected audio track for generating the media content item.

Claims (62)

1. A method, comprising:

displaying, by a messaging application running on a device, a capture user interface for capturing video;

providing, by the messaging application, a camera mode selection element within the capture user interface, the camera mode selection element being selectable to switch between a first camera mode and a second camera mode, the first camera mode for capturing a single video clip to generate a media content item, and the second camera mode for capturing multiple video clips for combining to generate the media content item;

providing, by the messaging application, an audio selection button and an audio selection element within the capture user interface, each of the audio selection button and the audio selection element being selectable to select an audio track for the media content item;

receiving, by the messaging application and via the camera mode selection element, first user input selecting the second camera mode;

receiving, by the messaging application and via the audio selection button or the audio selection element, second user input selecting the audio track; and

providing, by the messaging application and based on the first and second user input, for capturing multiple video clips in association with the selected audio track for generating the media content item, wherein the capture user interface in accordance with the second camera mode includes a preview button which is selectable to switch from the capture user interface to a preview user interface, the preview user interface being separate from the capture user interface, the preview user interface for previewing, modifying and selecting a playback option for the multiple video clips in association with the selected audio track, in order to generate the media content item,

wherein the capture user interface includes a carousel interface for presenting a set of augmented reality content items, each augmented reality content item within the set of augmented reality content items being selectable to apply respective augmented reality content to the multiple video clips, and

wherein in a case where the respective augmented reality content includes accommodating audio, the accommodating audio is muted and replaced with the selected audio track in order to generate the media content item.

2. The method of claim 1 , further comprising:

updating, by the messaging application and in response to receiving the first and second user input, the capture user interface for video capture in accordance with the second camera mode and the selected audio track.

3. The method of claim 2 , wherein the updated capture user interface includes a timeline progress bar which is configured to update in real time based on a number of captured video clips and a length of each captured video clip.

4. The method of claim 3 , wherein the timeline progress bar is configured to update in real time based on passing preset thresholds for a total length of all captured video clips.

5. The method of claim 3 , wherein the updated capture user interface displays a title of the audio track adjacent to the timeline progress bar.

6. The method of claim 1 , further comprising:

generating the media content item based on the multiple video clips and on the selected audio track.

7. The method of claim 1 , wherein receiving the second user input comprises:

receiving user selection of the audio selection button or the audio selection element;

displaying, in response to receiving the user selection, a plurality of available audio tracks within an audio track list interface; and

receiving user selection of the audio track from among the plurality of available audio tracks within the audio track list interface.

8. The method of claim 7 , further comprising:

providing, in response to receiving user selection of the audio track, an audio track editing interface for selecting a point, within the audio track, from which to start audio playback.

9. The method of claim 1 , wherein the preview user interface includes a send button which is selectable to send the media content item to a recipient or to broadcast the media content item.

10. The method of claim 1 , wherein the audio selection button is presented in an enabled state when the audio track has been selected for the media content item, and

wherein the audio selection button is presented in a disabled state when no audio track has been selected for the media content item.

11. A system comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising:

displaying, by a messaging application running, a capture user interface for capturing video;

providing, by the messaging application, a camera mode selection element within the capture user interface, the camera mode selection element being selectable to switch between a first camera mode and a second camera mode, the first camera mode for capturing a single video clip to generate a media content item, and the second camera mode for capturing multiple video clips for combining to generate the media content item;

providing, by the messaging application, an audio selection button and an audio selection element within the capture user interface, each of the audio selection button and the audio selection element being selectable to select an audio track for the media content item;

receiving, by the messaging application and via the camera mode selection element, first user input selecting the second camera mode;

receiving, by the messaging application and via the audio selection button or the audio selection element, second user input selecting the audio track; and

providing, by the messaging application and based on the first and second user input, for capturing multiple video clips in association with the selected audio track for generating the media content item,

wherein the capture user interface in accordance with the second camera mode includes a preview button which is selectable to switch from the capture user interface to a preview user interface, the preview user interface being separate from the capture user interface, the preview user interface for previewing, modifying and selecting a playback option for the multiple video clips in association with the selected audio track, in order to generate the media content item,

wherein the capture user interface includes a carousel interface for presenting a set of augmented reality content items, each augmented reality content item within the set of augmented reality content items being selectable to apply respective augmented reality content to the multiple video clips, and

wherein in a case where the respective augmented reality content includes accommodating audio, the accommodating audio is muted and replaced with the selected audio track in order to generate the media content item.

12. The system of claim 11 , the operations further comprising:

updating, by the messaging application and in response to receiving the first and second user input, the capture user interface for video capture in accordance with the second camera mode and the selected audio track.

13. The system of claim 12 , wherein the updated capture user interface includes a timeline progress bar which is configured to update in real time based on a number of captured video clips and a length of each captured video clip.

14. The system of claim 13 , wherein the timeline progress bar is configured to update in real time based on passing preset thresholds for a total length of all captured video clips.

15. The system of claim 13 , wherein the updated capture user interface displays a title of the audio track adjacent to the timeline progress bar.

16. The system of claim 11 , the operations further comprising:

generating the media content item based on the multiple video clips and on the selected audio track.

17. The system of claim 11 , wherein receiving the second user input comprises:

receiving user selection of the audio selection button or the audio selection element;

displaying, in response to receiving the user selection, a plurality of available audio tracks within an audio track list interface; and

receiving user selection of the audio track from among the plurality of available audio tracks within the audio track list interface.

18. The system of claim 17 , the operations further comprising:

providing, in response to receiving user selection of the audio track, an audio track editing interface for selecting a point, within the audio track, from which to start audio playback.

19. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

displaying, by a messaging application running on a device, a capture user interface for capturing video;

providing, by the messaging application, a camera mode selection element within the capture user interface, the camera mode selection element being selectable to switch between a first camera mode and a second camera mode, the first camera mode for capturing a single video clip to generate a media content item, and the second camera mode for capturing multiple video clips for combining to generate the media content item;

providing, by the messaging application, an audio selection button and an audio selection element within the capture user interface, each of the audio selection button and the audio selection element being selectable to select an audio track for the media content item;

receiving, by the messaging application and via the camera mode selection element, first user input selecting the second camera mode;

receiving, by the messaging application and via the audio selection button or the audio selection element, second user input selecting the audio track; and

providing, by the messaging application and based on the first and second user input, for capturing multiple video clips in association with the selected audio track for generating the media content item,

wherein the capture user interface in accordance with the second camera mode includes a preview button which is selectable to switch from the capture user interface to a preview user interface, the preview user interface being separate from the capture user interface, the preview user interface for previewing, modifying and selecting a playback option for the multiple video clips in association with the selected audio track, in order to generate the media content item,

wherein the capture user interface includes a carousel interface for presenting a set of augmented reality content items, each augmented reality content item within the set of augmented reality content items being selectable to apply respective augmented reality content to the multiple video clips, and

wherein in a case where the respective augmented reality content includes accommodating audio, the accommodating audio is muted and replaced with the selected audio track in order to generate the media content item.

20. The computer-readable medium of claim 19 , the operations further comprising:

updating, by the messaging application and in response to receiving the first and second user input, the capture user interface for video capture in accordance with the second camera mode and the selected audio track.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2022
From: ANVARIPOUR, KAVEH; BARRON, CHRISTINE; CAO, WAYNE MIKE; COOPER, ANDREW GROSVENOR; HEIKKINEN, CHRISTIE MARIE; LANKAGE, RANIDU
To: SNAP INC.
Reel/Frame 059148/0711 →
Continuity (2)
Provisional Application 63132172 · Dec 30, 2020
Related Publication 20220206738A1 · Jun 30, 2022
References Cited (129)
US 9361521B1 · Mclean et al. · 2016 [cited by applicant]
US 9703456B2 · Park · 2017 [cited by applicant]
US 9807337B2 · Miner · 2017 [cited by applicant]
US 10289287B2 · Rathod · 2019 [cited by applicant]
US 10498950B2 · Jeno · 2019 [cited by applicant]
US 10645335B2 · Abe · 2020 [cited by applicant]
US 11081140B1 · Cheng · 2021 [cited by examiner]
US 11146847B1 · Harshawat et al. · 2021 [cited by applicant]
US 11169680B2 · Park et al. · 2021 [cited by applicant]
US 11861800B2 · Anvaripour et al. · 2024 [cited by applicant]
US 11924540B2 · Anvaripour et al. · 2024 [cited by applicant]
US 12002135B2 · Anvaripour et al. · 2024 [cited by applicant]
US 12108146B2 · Anvaripour et al. · 2024 [cited by applicant]
US 20070174774A1 · Lerman et al. · 2007 [cited by applicant]
US 20090288010A1 · Ubillos · 2009 [cited by applicant]
US 20110170008A1 · Koch · 2011 [cited by applicant]
US 20120308209A1 · Zaletel · 2012 [cited by applicant]
US 20130145269A1 · Latulipe et al. · 2013 [cited by applicant]
US 20140029915A1 · Lin · 2014 [cited by applicant]
US 20140055633A1 · Marlin et al. · 2014 [cited by applicant]
US 20140351698A1 · Nakagawa · 2014 [cited by applicant]
US 20160080686A1 · Oyama et al. · 2016 [cited by applicant]
US 20160216871A1 · Stamatiou · 2016 [cited by applicant]
US 20160225410A1 · Lee et al. · 2016 [cited by applicant]
US 20170109585A1 · Matias et al. · 2017 [cited by applicant]
US 20170213297A1 · Havilio · 2017 [cited by applicant]
US 20170269687A1 · Hussain et al. · 2017 [cited by applicant]
US 20170316792A1 · Chaudhuri et al. · 2017 [cited by applicant]
US 20170358321A1 · Kilar et al. · 2017 [cited by applicant]
US 20180005618A1 · Liu · 2018 [cited by examiner]
US 20180082430A1 · Sharma et al. · 2018 [cited by applicant]
US 20180091728A1 · Brown et al. · 2018 [cited by applicant]
US 20180131878A1 · Charlton et al. · 2018 [cited by applicant]
US 20190166400A1 · Andreou et al. · 2019 [cited by applicant]
US 20190342507A1 · Dye et al. · 2019 [cited by applicant]
US 20200034033A1 · Chaudhri et al. · 2020 [cited by applicant]
US 20200186728A1 · Pena · 2020 [cited by examiner]
US 20200351353A1 · Al Majid et al. · 2020 [cited by applicant]
US 20200356593A1 · Azzinnari et al. · 2020 [cited by applicant]
US 20200358963A1 · Manzari et al. · 2020 [cited by applicant]
US 20210105244A1 · O'rourke et al. · 2021 [cited by applicant]
US 20220005477A1 · Ma et al. · 2022 [cited by applicant]
US 20220207805A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220207838A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220210328A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220210337A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20240062494A1 · Anvaripour et al. · 2024 [cited by applicant]
US 20240171849A1 · Anvaripour et al. · 2024 [cited by applicant]
US 20240265601A1 · Anvaripour et al. · 2024 [cited by applicant]
CN 110710192 · 2020 [cited by applicant]
CN 115516445 · 2022 [cited by applicant]
CN 116648895A · 2023 [cited by applicant]
CN 116671121 · 2023 [cited by applicant]
CN 116685995 · 2023 [cited by applicant]
CN 116710881 · 2023 [cited by applicant]
CN 116745741A · 2023 [cited by applicant]
KR 20170045257A · 2017 [cited by applicant]
KR 102110207B1 · 2020 [cited by applicant]
WO 2014031899 · 2014 [cited by applicant]
WO 2020047117 · 2020 [cited by applicant]
WO 2020186969 · 2020 [cited by applicant]
WO 2021173147 · 2021 [cited by applicant]
WO 2022090841 · 2022 [cited by applicant]
WO 2022146795 · 2022 [cited by applicant]
WO 2022146796 · 2022 [cited by applicant]
WO 2022146798 · 2022 [cited by applicant]
WO 2022146849 · 2022 [cited by applicant]
WO 2022146851 · 2022 [cited by applicant]
“U.S. Appl. No. 17/556,603, Final Office Action mailed Jun. 12, 2023”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Jun. 22, 2023 to Non Final Office Action mailed Mar. 30, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Non Final Office Action mailed Jun. 26, 2023”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Notice of Allowance mailed Jul. 13, 2023”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
Stone, Marcus, “VLLO—How to ADD text”, Youtube, [Online] Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=B0rGe6EFdWQ>, (Feb. 2, 2020), 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed Sep. 11, 2023 to Final Office Action mailed Jun. 12, 2023”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, International Search Report mailed Apr. 14, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, Written Opinion mailed Apr. 14, 2022”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, International Search Report mailed Apr. 21, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, Written Opinion mailed Apr. 21, 2022”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, International Search Report mailed Apr. 11, 2022”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, Written Opinion mailed Apr. 11, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Non Final Office Action mailed Feb. 1, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Non Final Office Action mailed Feb. 14, 2023”, 18 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, International Search Report mailed Apr. 7, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, Written Opinion mailed Apr. 7, 2022”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, International Search Report mailed Apr. 7, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, Written Opinion mailed Apr. 7, 2022”, 7 pgs. [cited by applicant]
Ward, Benjamin, “Snapchat New Timeline Feature”, [Online] Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=uLUM2rWAYE4>, [retrieved on Mar. 29, 2022], (Nov. 21, 2020), 2 pgs. [cited by applicant]
Jacinta, “A Guide to Instagram Reels—feedalpha : Social Media Automation A Guide to Instagram Reels”, [Online] Retrieved from the Internet: <URL: https://feedalpha.com/a-guide-to-instagram-reels/>, [retrieved on Mar. 26… [cited by applicant]
Nacis, Johnny, “Snapchat : How To use Timeline 2020”, [Online] Retrieved from the Internet: <URL:https://www.youtube.com/watch?v=vpd_fhM_OTg>, [retrieved on Mar. 25, 2022], (Dec. 13, 2020), 2 pgs. [cited by applicant]
Stickly, Katie, “How to trim a TikTok video AFTER recording—YouTube”, [Online] Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=sQzVtCsa6hU>, [retrieved on Mar. 29, 2022], (Feb. 7, 2020), 2 pgs. [cited by applicant]
Peterson, Jake, “How to Add 2020's Most Popular Songs to Your Snaps and Stories in Snapchat”, [Online] Retrieved from the Internet: <URL: https://ios.gadgethacks.com/how-to/add-2020s-most-popular-songs-your-snaps-storie… [cited by applicant]
Wynne, Mabel, “How to edit a video on TikTok”, [Online] Retrieved from the Internet: <URL: https://www.creativeblog.com/how-to/edit-video-on-tiktok>, [retrieved on Mar. 27, 2022] (Nov. 4, 2020), 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Response filed May 1, 2023 to Non Final Office Action mailed Feb. 1, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed May 15, 2023 to Non Final Office Action mailed Feb. 14, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Non Final Office Action mailed Mar. 30, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Non Final Office Action mailed Sep. 22, 2023”, 32 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed Dec. 12, 2023 to Non Final Office Action mailed Sep. 22, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Final Office Action mailed Sep. 26, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Dec. 20, 2023 to Final Office Action mailed Sep. 26, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Notice of Allowance mailed Oct. 2, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Response filed Sep. 18, 2023 to Non Final Office Action mailed Jun. 26, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Corrected Notice of Allowability mailed Nov. 22, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Corrected Notice of Allowability mailed Dec. 4, 2023”, 7 pgs. [cited by applicant]
Boykin, Brendan, “iMovie for iPhone and iPad”, O'Reilly Media, Inc., (May 2012), 79 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Notice of Allowance mailed May 29, 2024”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Non Final Office Action mailed Jul. 25, 2024”, 19 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7025993, Notice of Preliminary Rejection mailed Jun. 17, 2024”, w/ English translation, 14 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7026002, Notice of Preliminary Rejection mailed May 26, 2024”, w/ English translation, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Notice of Allowance mailed Jan. 23, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Supplemental Notice of Allowability mailed Jan. 29, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Corrected Notice of Allowability mailed Jan. 31, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Non Final Office Action mailed Feb. 1, 2024”. 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Apr. 25, 2024 to Non Final Office Action mailed Feb. 1, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Non Final Office Action mailed Sep. 17, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Response filed Oct. 25, 2024 to Non Final Office Action mailed Jul. 25, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Examiner Interview Summary mailed Oct. 28, 2024”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 18/637,034, Non Final Office Action mailed Nov. 20, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Corrected Notice of Allowability mailed Jan. 31, 2025”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Notice of Allowance mailed Jan. 21, 2025”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Response filed Dec. 11, 2024 to Non Final Office Action mailed Sep. 17, 2024”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Final Office Action mailed Feb. 12, 2025”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 18/637,034, Notice of Allowance mailed Mar. 10, 2025”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 18/637,034, Response filed Feb. 19, 2025 to Non Final Office Action mailed Nov. 20, 2024”, 8 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7026002, Response filed Jul. 26, 2024 to Notice of Preliminary Rejection mailed May 26, 2024”, w/ English claims, 29 pgs. [cited by applicant]