IP Library › Granted Patent US 12,361,618
Granted Patent B2
US 12,361,618 · App. 18/637,034 · Granted Jul 15, 2025

Adding time-based captions to captured video within a messaging system

Inventors: Kaveh Anvaripour (Culver City, CA); Christine Barron (Los Angeles, CA); Nathan Kenneth Boyd (Los Angeles, CA); Christie Marie Heikkinen (Sherman Oaks, CA); Ranidu Lankage (Belmont, CA); Daniel Moreno (New York, NY); Shannon Ward (Venice, CA); Tabari Williams (Oakland, CA)
Assignee: Snap Inc.
G06T11/60G06F3/0482G06F3/04845G06F16/7867H04L51/046H04L51/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,618
App. No.
18/637,034
Granted
Jul 15, 2025
Kind
B2
Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for adding time-based captions to captured video. The program and method provide for displaying, by a messaging application, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item; switching, in response to first user input selecting the interface element, to the captions user interface which is configured to receive user input for caption content and a duration to display the caption content; receiving, via the captions user interface, second user input for the caption content and the duration; and generating the media content item based on the caption content and the duration to display the caption content.

Claims (46)

1. A method, comprising:

displaying, by an application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item;

switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and setting a duration to display the caption content;

receiving, via the captions user interface, second user input for the caption content and the duration to display the caption content; and

generating the media content item based on the caption content and the duration to display the caption content,

wherein the captions user interface is configured to provide haptic feedback during a drag gesture of a front handle or a back handle to indicate a transition between adjacent video clips of the captured video.

2. The method of claim 1 , further comprising:

providing, prior to the displaying, a capture user interface for capturing the video, wherein the preview user interface is displayed upon completion of capturing the video via the capture user interface.

3. The method of claim 1 , further comprising:

receiving, via the captions user interface, third user input for second caption content and for a second duration to display the second caption content; and

displaying, within the captions user interface, the caption content based on the duration together with the second caption content based on the second duration, wherein display of the caption content is at a reduced opacity relative to display of the second caption content.

4. The method of claim 1 , wherein the captions user interface includes a keyboard element by which the second user input for the caption content is provided.

5. The method of claim 4 , wherein in response to receiving the second user input for the duration, the captions user interface replaces display of the keyboard element with a preview bar which includes the front handle and the back handle.

6. The method of claim 1 , wherein the captions user interface includes a color slider element which is user selectable to set a color for the caption content.

7. The method of claim 1 , wherein the captions user interface includes an alignment element which is user selectable to set an alignment for the caption content.

8. The method of claim 1 , wherein the caption content includes at least one of text or a sticker.

9. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the at least one processor to perform operations comprising:

displaying, by an application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item;

switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and setting a duration to display the caption content;

receiving, via the captions user interface, second user input for the caption content and the duration to display the caption content; and

generating the media content item based on the caption content and the duration to display the caption content,

wherein the captions user interface is configured to provide haptic feedback during a drag gesture of a front handle or a back handle to indicate a transition between adjacent video clips of the captured video.

10. The system of claim 9 , the operations further comprising:

providing, prior to the displaying, a capture user interface for capturing the video, wherein the preview user interface is displayed upon completion of capturing the video via the capture user interface.

11. The system of claim 9 , the operations further comprising:

receiving, via the captions user interface, third user input for second caption content and for a second duration to display the second caption content; and

displaying, within the captions user interface, the caption content based on the duration together with the second caption content based on the second duration, wherein display of the caption content is at a reduced opacity relative to display of the second caption content.

12. The system of claim 9 , wherein the captions user interface includes a keyboard element by which the second user input for the caption content is provided.

13. The system of claim 12 , wherein in response to receiving the second user input for the duration, the captions user interface replaces display of the keyboard element with a preview bar which includes the front handle and the back handle.

14. The system of claim 9 , wherein the captions user interface includes a color slider element which is user selectable to set a color for the caption content.

15. The system of claim 9 , wherein the captions user interface includes an alignment element which is user selectable to set an alignment for the caption content.

16. The system of claim 9 , wherein the caption content includes at least one of text or a sticker.

17. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

displaying, by an application running on a device, a preview user interface for previewing and editing captured video in order to generate a media content item, the preview user interface including an interface element which is selectable to switch to a captions user interface for adding a caption to the media content item;

switching, in response to first user input selecting the interface element, from the preview user interface to the captions user interface, the captions user interface being configured to receive user input for caption content and setting a duration to display the caption content;

receiving, via the captions user interface, second user input for the caption content and the duration to display the caption content; and

generating the media content item based on the caption content and the duration to display the caption content,

wherein the captions user interface is configured to provide haptic feedback during a drag gesture of a front handle or a back handle to indicate a transition between adjacent video clips of the captured video.

18. The non-transitory computer-readable storage medium of claim 17 , further comprising:

providing, prior to the displaying, a capture user interface for capturing the video, wherein the preview user interface is displayed upon completion of capturing the video via the capture user interface.

19. The non-transitory computer-readable storage medium of claim 17 , further comprising:

receiving, via the captions user interface, third user input for second caption content and for a second duration to display the second caption content; and

displaying, within the captions user interface, the caption content based on the duration together with the second caption content based on the second duration, wherein display of the caption content is at a reduced opacity relative to display of the second caption content.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the captions user interface includes a keyboard element by which the second user input for the caption content is provided.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2024
From: ANVARIPOUR, KAVEH; BARRON, CHRISTINE; BOYD, NATHAN KENNETH; HEIKKINEN, CHRISTIE MARIE; LANKAGE, RANIDU; MORENO, DANIEL; WARD, SHANNON; WILLIAMS, TABARI
To: SNAP INC.
Reel/Frame 067435/0686 →
Continuity (3)
Continuation 17556603 · Dec 20, 2021
Provisional Application 63132337 · Dec 30, 2020
Related Publication 20240265601A1 · Aug 8, 2024
References Cited (140)
US 9361521B1 · Mclean et al. · 2016 [cited by applicant]
US 9703456B2 · Park · 2017 [cited by applicant]
US 9807337B2 · Miner · 2017 [cited by applicant]
US 10289287B2 · Rathod · 2019 [cited by applicant]
US 10498950B2 · Ueno · 2019 [cited by applicant]
US 10645335B2 · Abe · 2020 [cited by applicant]
US 11081140B1 · Cheng et al. · 2021 [cited by applicant]
US 11146847B1 · Harshawat et al. · 2021 [cited by applicant]
US 11169680B2 · Park et al. · 2021 [cited by applicant]
US 11861800B2 · Anvaripour et al. · 2024 [cited by applicant]
US 11924540B2 · Anvaripour et al. · 2024 [cited by applicant]
US 12108146B2 · Anvaripour et al. · 2024 [cited by applicant]
US 20070174774A1 · Lerman et al. · 2007 [cited by applicant]
US 20090288010A1 · Ubillos · 2009 [cited by applicant]
US 20110170008A1 · Koch · 2011 [cited by applicant]
US 20120308209A1 · Zaletel · 2012 [cited by applicant]
US 20130145269A1 · Latulipe et al. · 2013 [cited by applicant]
US 20140029915A1 · Lin · 2014 [cited by applicant]
US 20140055633A1 · Marlin et al. · 2014 [cited by applicant]
US 20140351698A1 · Nakagawa · 2014 [cited by applicant]
US 20160080686A1 · Oyama et al. · 2016 [cited by applicant]
US 20160216871A1 · Stamatiou · 2016 [cited by applicant]
US 20160225410A1 · Lee et al. · 2016 [cited by applicant]
US 20170109585A1 · Matias et al. · 2017 [cited by applicant]
US 20170213297A1 · Havilio · 2017 [cited by applicant]
US 20170269687A1 · Hussain et al. · 2017 [cited by applicant]
US 20170316792A1 · Chaudhuri et al. · 2017 [cited by applicant]
US 20170358321A1 · Kilar et al. · 2017 [cited by applicant]
US 20180005618A1 · Liu · 2018 [cited by applicant]
US 20180082430A1 · Sharma et al. · 2018 [cited by applicant]
US 20180091728A1 · Brown et al. · 2018 [cited by applicant]
US 20180131878A1 · Charlton et al. · 2018 [cited by applicant]
US 20190166400A1 · Andreou et al. · 2019 [cited by applicant]
US 20190342507A1 · Dye et al. · 2019 [cited by applicant]
US 20200034033A1 · Chaudhri et al. · 2020 [cited by applicant]
US 20200186728A1 · Pena et al. · 2020 [cited by applicant]
US 20200351353A1 · Al Majid et al. · 2020 [cited by applicant]
US 20200356593A1 · Azzinnari et al. · 2020 [cited by applicant]
US 20200358963A1 · Manzari et al. · 2020 [cited by applicant]
US 20210105244A1 · O'rourke et al. · 2021 [cited by applicant]
US 20220005477A1 · Ma · 2022 [cited by examiner]
US 20220206738A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220207805A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220207838A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220210328A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220210337A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20240062494A1 · Anvaripour et al. · 2024 [cited by applicant]
US 20240171849A1 · Anvaripour et al. · 2024 [cited by applicant]
CN 110710192A · 2020 [cited by applicant]
CN 115516445A · 2022 [cited by applicant]
CN 116648895A · 2023 [cited by applicant]
CN 116671121A · 2023 [cited by applicant]
CN 116685995A · 2023 [cited by applicant]
CN 116710881A · 2023 [cited by applicant]
CN 116745741A · 2023 [cited by applicant]
KR 20170045257A · 2017 [cited by applicant]
KR 102110207B1 · 2020 [cited by applicant]
WO WO2014031899A1 · 2014 [cited by applicant]
WO WO2020047117A1 · 2020 [cited by applicant]
WO WO2020186969A1 · 2020 [cited by applicant]
WO WO2021173147A1 · 2021 [cited by applicant]
WO WO2022090841A1 · 2022 [cited by applicant]
WO WO2022146795A1 · 2022 [cited by applicant]
WO WO2022146796A1 · 2022 [cited by applicant]
WO WO2022146798A1 · 2022 [cited by applicant]
WO WO2022146849A1 · 2022 [cited by applicant]
WO WO2022146851A1 · 2022 [cited by applicant]
“U.S. Appl. No. 17/556,603, Final Office Action mailed Jun. 12, 2023”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Non Final Office Action mailed Feb. 14, 2023”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Non Final Office Action mailed Sep. 22, 2023”, 32 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Notice of Allowance mailed Jan. 23, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed May 15, 2023 to Non Final Office Action mailed Feb. 14, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed Sep. 11, 2023 to Final Office Action mailed Jun. 12, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Response filed Dec. 12, 2023 to Non Final Office Action mailed Sep. 22, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,603, Supplemental Notice of Allowability mailed Jan. 29, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Final Office Action mailed Sep. 26, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Non Final Office Action mailed Feb. 1, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Non Final Office Action mailed Mar. 30, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Jun. 22, 2023 to Non Final Office Action mailed Mar. 30, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Dec. 20, 2023 to Final Office Action mailed Sep. 26, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Non Final Office Action mailed Oct. 2, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Response filed Jan. 2, 2024 to Non Final Office Action mailed Oct. 2, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Corrected Notice of Allowability mailed Jan. 31, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Non Final Office Action mailed Jun. 26, 2023”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Notice of Allowance mailed Oct. 2, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,305, Response filed Sep. 18, 2023 to Non Final Office Action mailed Jun. 26, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Corrected Notice of Allowability mailed Nov. 22, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Corrected Notice of Allowability mailed Dec. 4, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Non Final Office Action mailed Feb. 1, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Notice of Allowance mailed Jul. 13, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/557,327, Response filed May 1, 2023 to Non Final Office Action mailed Feb. 1, 2023”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, International Search Report mailed Apr. 14, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064682, Written Opinion mailed Apr. 14, 2022”, 6 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, International Search Report mailed Apr. 11, 2022”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064697, Written Opinion mailed Apr. 11, 2022”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, International Search Report mailed Apr. 7, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064704, Written Opinion mailed Apr. 7, 2022”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, International Search Report mailed Apr. 7, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064985, Written Opinion mailed Apr. 7, 2022”, 7 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, International Preliminary Report on Patentability mailed Jul. 13, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, International Search Report mailed Apr. 21, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2021/064990, Written Opinion mailed Apr. 21, 2022”, 7 pgs. [cited by applicant]
Boykin, Brendan, “iMovie for iPhone and iPad”, O'Reilly Media, Inc., (May 2012), 79 pgs. [cited by applicant]
Jacinta, “A Guide to Instagram Reels—feedalpha: Social Media Automation A Guide to Instagram Reels”, [Online] Retrieved from the Internet: <URL: https://feedalpha.com/a-guide-to-instagram-reels/>, [retrieved on Mar. 26,… [cited by applicant]
Nacis, Johnny, “Snapchat : How To use Timeline 2020”, [Online] Retrieved from the Internet: <URL:https://www.youtube.com/watch?v=vpd_fhM_OTg>, [retrieved on Mar. 25, 2022], (Dec. 13, 2020), 2 pgs. [cited by applicant]
Peterson, Jake, “How to Add 2020's Most Popular Songs to Your Snaps & Stories in Snapchat”, [Online] Retrieved from the Internet: <URL: https://ios.gadgethacks.com/how-to/add-2020s-most-popular-songs-your-snaps-stories-… [cited by applicant]
Stickly, Katie, “How to trim a TikTok video AFTER recording—YouTube”, [Online] Retrieved from the Internet: < URL: https://www.youtube.com/watch?v=sQzVtCsa6hU>, [retrieved on Mar. 29, 2022], (Feb. 7, 2020), 2 pgs. [cited by applicant]
Stone, Marcus, “VLLO—How to ADD text”, Youtube, [Online] Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=B0rGe6EFdWQ>, (Feb. 2, 2020), 7 pgs. [cited by applicant]
Ward, Benjamin, “Snapchat New Timeline Feature”, [Online] Retrieved from the Internet: <URL: https://www.youtube.com/watch?v=uLUM2rWAYE4>, [retrieved on Mar. 29, 2022], (Nov. 21, 2020), 2 pgs. [cited by applicant]
Wynne, Mabel, “How to edit a video on TikTok”, [Online] Retrieved from the Internet: <URL: https://www.creativeblog.com/how-to/edit-video-on-tiktok>, [retrieved on Mar. 27, 2022], (Nov. 4, 2020), 8 pgs. [cited by applicant]
U.S. Appl. No. 17/556,713, filed Dec. 20, 2021, Camera Mode for Capturing Multiple Video Clips Within a Messaging System. [cited by applicant]
U.S. Appl. No. 17/556,802, filed Dec. 20, 2021, Selecting an Audio Track in Association with Multi-Video Clip Capture. [cited by applicant]
U.S. Appl. No. 17/556,603, filed Dec. 20, 2021, Adding Time-Based Captions to Captured Video Within a Messaging System. [cited by applicant]
U.S. Appl. No. 17/557,305, now U.S. Pat. No. 11,924,540, filed Dec. 21, 2021, Trimming Video in Association with Multi-Video Clip Capture. [cited by applicant]
U.S. Appl. No. 17/557,327, now U.S. Pat. No. 11,861,800, filed Dec. 21, 2021, Presenting Available Augmented Reality Content Items in Association with Multi-Video Clip Capture. [cited by applicant]
U.S. Appl. No. 18/420,435, filed Jan. 23, 2024, Trimming Video in Association with Multi-Video Clip Capture. [cited by applicant]
U.S. Appl. No. 18/501,902, filed Nov. 3, 2023, Presenting Available Augmented Reality Content Items in Association with Multi-Video Clip Capture. [cited by applicant]
“U.S. Appl. No. 17/556,713, Notice of Allowance mailed May 29, 2024”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,713, Response filed Apr. 25, 2024 to Non Final Office Action mailed Feb. 1, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Examiner Interview Summary mailed Aug. 23, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Final Office Action mailed Dec. 19, 2024”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Non Final Office Action mailed May 24, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Non Final Office Action mailed Aug. 29, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Response filed Aug. 20, 2024 to Non Final Office Action mailed May 24, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/556,802, Response filed Nov. 27, 2024 to Non Final Office Action mailed Aug. 29, 2024”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Corrected Notice of Allowability mailed Jan. 31, 2025”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Non Final Office Action mailed Sep. 17, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Notice of Allowance mailed Jan. 21, 2025”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/420,435, Response filed Dec. 11, 2024 to Non Final Office Action mailed Sep. 17, 2024”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Examiner Interview Summary mailed Oct. 28, 2024”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Final Office Action mailed Feb. 12, 2025”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Non Final Office Action mailed Jul. 25, 2024”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 18/501,902, Response filed Oct. 25, 2024 to Non Final Office Action mailed Jul. 25, 2024”, 13 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7025993, Notice of Preliminary Rejection mailed Jun. 17, 2024”, w/ English translation, 14 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7026002, Notice of Preliminary Rejection mailed May 26, 2024”, w/ English translation, 12 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7026002, Response filed Jul. 26, 2024 to Notice of Preliminary Rejection mailed May 26, 2024”, w/ English claims, 29 pgs. [cited by applicant]