IP Library › Granted Patent US 12,340,823
Granted Patent B2
US 12,340,823 · App. 18/325,091 · Granted Jun 24, 2025

Accelerated video editing

Inventors: Wei Jun Zheng (Shanghai, CN); Jian Jun Wang (Xi'an, CN); Yue Gao (Yorktown Heights, NY); Ting Chen (Beijing, CN); Chun Hong Zheng (Beijing, CN); Yin Hu (Ningbo, CN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G11B27/031
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,823
App. No.
18/325,091
Granted
Jun 24, 2025
Kind
B2
Abstract

A method for accelerated video editing that includes providing a video, segmenting, using a segmentation module, the video into a number of clips, and automatically computing, for each clip of the number of clips, corresponding metadata representing at least one attribute of the clip based on an analysis of contents of each clip of the plurality of clips. A profile script is generated based on the corresponding metadata, the profile script is generated to include one or more editing actions to be performed on a section of the video that corresponds to at least one identified clip from the number of clips. An editing tool is used to automatically edit the video based on the profile script to generate an edited video.

Claims (36)

1. A computer implemented method for accelerated video editing, comprising:

receiving a video;

segmenting the video into a plurality of clips based on one or more segmentation parameters;

automatically computing, for each clip of the plurality of clips, corresponding metadata representing at least one clip attribute based on an analysis of contents of each clip of the plurality of clips;

generating a profile script based on the corresponding metadata, the profile script being generated to include one or more editing actions to be performed on the video or the plurality of clips; and

automatically editing, by an editing tool, the video or the clips based on the profile script to obtain an edited video.

2. The method of claim 1 , wherein the corresponding metadata is generated in human understandable language.

3. The method of claim 1 , further comprising transforming the profile script, by a profile script interpreter, into a plurality of tool-dependent commands usable by the editing tool prior to automatically editing the video by the editing tool.

4. The method of claim 1 , wherein the segmenting is based on at least object identification, wherein one or more objects detected in the video are used as a parameter for producing one of the plurality of clips.

5. The method of claim 1 , wherein the segmenting is based on at least audio identification, wherein one or more distinct sections of an audio of the video are used as a parameter for producing one of the plurality of clips.

6. The method of claim 1 , wherein the segmenting is based on at least text identification, wherein one or more texts of the video is used as a parameter for producing one of the plurality of clips.

7. The method of claim 1 , wherein the corresponding metadata comprises a key-value data structure that represents the at least one attribute of each clip of the plurality of clips.

8. The method of claim 7 , wherein at least one of the plurality of clips is identified using the key-value data structure.

9. The method of claim 1 , wherein generating the profile script comprises receiving a manually customized profile script in response to initially automatically generating the profile script.

10. The method of claim 1 , wherein generating the profile script comprises receiving a manually generated and customized profile script from an operator.

11. The method of claim 1 , wherein automatically editing comprises at least one of a cutting action, a compression action, a masking action of a text, image or audio, an appending action, or a replacement action.

12. The method of claim 1 , further comprising validating a syntax of the profile script prior to automatically editing the video by the computing device.

13. A computer program product comprising:

one or more computer-readable storage devices and program instructions stored on at least one of the one or more tangible storage devices, the program instructions executable by a processor, the program instructions comprising:

program instructions to receive a video;

program instructions to segment the video into a plurality of clips based on one more segmentation parameters;

program instructions to automatically compute, for each clip of the plurality of clips, corresponding metadata representing at least one attribute of the clip based on an analysis of contents of each clip of the plurality of clips;

program instructions to generate a profile script based on the corresponding metadata, the profile script being generated to include one or more editing actions to be performed on the video; and

program instructions to automatically edit, by an editing tool, the video based on the profile script to obtain an edited video.

14. The computer program product of claim 13 , further comprising program instructions to generate the corresponding metadata in human understandable language.

15. The computer program product of claim 13 , further comprising program instructions to transform the profile script into a plurality of tool-dependent commands usable by the editing tool prior to automatically editing the video by the editing tool.

16. The computer program product of claim 13 , wherein the automatically editing comprises at least one of a cutting action, a compression action, a masking action of a text, image or audio, an appending action, or a replacement action.

17. A non-transitory computer-readable storage medium tangibly embodying a computer readable program code having computer readable instructions that, when executed, causes a processor to carry out a method comprising:

receiving a video;

segmenting the video into a plurality of clips based on one or more segmentation parameters;

automatically computing, for each clip of the plurality of clips, corresponding metadata representing at least one attribute of the clip based on an analysis of contents of each clip of the plurality of clips;

generating a profile script based on the corresponding metadata, the profile script being generated to include one or more editing actions to be performed the video; and

automatically editing, the video based on the profile script to obtain an edited video.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the corresponding metadata is generated in human understandable language.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the method further comprises transforming the profile script, by a computerized profile script interpreter, into a plurality of tool-dependent commands usable by the editing tool prior to automatically editing the video by the editing tool.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the automatically editing includes at least one of a cutting action, a compression action, a masking action of a text, image or audio, an appending action, and a replacement action.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2023
From: ZHENG, WEI JUN; WANG, JIAN JUN; GAO, YUE; CHEN, TING; ZHENG, CHUN HONG; HU, YIN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063786/0660 →
Continuity (1)
Related Publication 20240404559A1 · Dec 5, 2024
References Cited (17)
US 6310839B1 · Lee et al. · 2001 [cited by applicant]
US 7280738B2 · Kauffman et al. · 2007 [cited by applicant]
US 7362946B1 · Kowald · 2008 [cited by examiner]
US 9172983B2 · Koh et al. · 2015 [cited by applicant]
US 11295783B2 · Shen · 2022 [cited by applicant]
US 20020080191A1 · Savoie · 2002 [cited by applicant]
US 20020120925A1 · Logan · 2002 [cited by examiner]
US 20130216206A1 · Dubin · 2013 [cited by examiner]
US 20190371023A1 · Zhu · 2019 [cited by applicant]
US 20210142828A1 · Prakash · 2021 [cited by examiner]
AU 2003252878A1 · 2004 [cited by applicant]
CN 109168084B · 2021 [cited by applicant]
CN 113329259B · 2022 [cited by applicant]
CN 115481977A · 2022 [cited by applicant]
WO 2024246624A1 · 2024 [cited by applicant]
International Search Report and Written Opinion issued Jun. 24, 2024 in related application No. PCT/IB2024/053412, 11 pgs. [cited by applicant]
Feury, D. “How I Completely Automated My YouTube Editing Using FFmpeg”, YouTube Video, downloaded Dec. 2, 2023 from, https://www.youtube.com/watch?v=JbX5vDfiyh0&ab_channel=DonaldFeury, 5 pgs. [cited by applicant]