IP Library Granted Patent US 12,192,594
Granted Patent B2
US 12,192,594 · App. 18/536,092 · Granted Jan 7, 2025

Method, apparatus, device, and storage medium of video processing

Inventors: Yitian Wang (Beijing, CN); Wozhou He (Beijing, CN); Mingjie Chen (Beijing, CN); Peihua Yu (Beijing, CN)
Assignee: Beijing Zitiao Network Technology Co., Ltd.
H04N21/816G06F40/166G11B27/031
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,594
App. No.
18/536,092
Granted
Jan 7, 2025
Kind
B2
Abstract

The present disclosure provides a video processing method, device, apparatus, and a storage medium. The method includes: displaying a material editing area for video editing based on a first script structure, the material editing area divided into a plurality of sub-areas; displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, the target multimedia material being a multimedia material selected for a target script node that is a script node corresponding to the target sub-area in the first script structure; and generating the target video based on multimedia material displayed in the material editing area. Based on a material editing area including a plurality of sub-areas respectively corresponding to script nodes, embodiments of the present disclosure can implement video editing, and diversify the video editing methods to further meet various people's needs for video editing.

Claims (55)

1. A method of video processing, comprising:

displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is indicative of a content paragraph of the target video;

displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and

generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node.

2. The method of claim 1 , wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement.

3. The method of claim 1 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and

editing, based on the adjustment operation, the multimedia clip in the multimedia material.

4. The method of claim 1 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and

adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material.

5. The method of claim 1 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and

adjusting, based on the editing operation, the text content in the script node.

6. The method of claim 1 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and

adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area.

7. The method of claim 1 , wherein the target multimedia material comprises a candidate multimedia material, and prior to generating the target video based on the multimedia material displayed in the material editing area, and the method further comprises:

in response to a switching operation from the target multimedia material in the target sub-area to the candidate multimedia material, switching the target multimedia material displayed in the target sub-area to the candidate multimedia material.

8. A device comprising a memory, a processor, and computer programs stored in the memory and operable on the processor, the processor, when executing the computer programs, implementing the method of:

displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is of a content paragraph of the target video;

displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and

generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node.

9. The device of claim 8 , wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement.

10. The device of claim 8 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and

editing, based on the adjustment operation, the multimedia clip in the multimedia material.

11. The device of claim 8 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and

adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material.

12. The device of claim 8 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and

adjusting, based on the editing operation, the text content in the script node.

13. The device of claim 8 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and

adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area.

14. A computer program product being stored on a non-transitory computer storage medium and comprising computer programs/instructions which, when executed by a processor, implement the method of:

displaying, based on a first script structure, a material editing area for video editing, wherein the material editing area is divided into a plurality of sub-areas, each of a subset of the plurality of sub-areas corresponding to a script node among a plurality of script nodes in the first script structure, the first script structure is indicative of a content paragraph structure of a target video, and each of the plurality of script nodes is indicative of a content paragraph of the target video;

displaying a target multimedia material according to a timeline in a target sub-area of the plurality of sub-areas, wherein the target multimedia material is selected for a target script node which is the script node corresponding to the target sub-area in the first script structure; and

generating the target video based on multimedia material displayed in the material editing area, wherein the target multimedia material is filled in a target content paragraph of the target video, and the target content paragraph is corresponding to the target script node.

15. The computer program product of claim 14 , wherein an interface layout of the plurality of sub-areas in the material editing area is a vertical alignment arrangement.

16. The computer program product of claim 14 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an adjustment operation on a target text content of a first script node in the first script structure, determining a multimedia material corresponding to the first script node in the material editing area, and determining a multimedia clip corresponding to the target text content in the multimedia material; and

editing, based on the adjustment operation, the multimedia clip in the multimedia material.

17. The computer program product of claim 14 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adding a text content at a target text position of a second script node in the first script structure, determining a multimedia material corresponding to the second script node in the material editing area, and determining a timeline position corresponding to the target text position in the multimedia material; and

adding, based on the operation of adding the text content, adding a multimedia clip corresponding to the text content at the timeline position in the multimedia material.

18. The computer program product of claim 14 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an editing operation on a target multimedia clip of a first multimedia material in the material editing area, determining the script node corresponding to the first multimedia material, and determining a text content corresponding to the target multimedia clip in the script node; and

adjusting, based on the editing operation, the text content in the script node.

19. The computer program product of claim 14 , prior to generating the target video based on the multimedia material displayed in the material editing area, the method further comprises:

in response to an operation of adjusting a sequence of a second script node and a third script node in the first script structure, determining sub-areas respectively corresponding to the second script node and the third script node in the material editing area; and

adjusting, based on the operation of adjusting the sequence, a sequence of multimedia material in the sub-areas respectively corresponding to the second script node and the third script node in the material editing area.

20. The computer program product of claim 14 , wherein the target multimedia material comprises a candidate multimedia material, and prior to generating the target video based on the multimedia material displayed in the material editing area, and the method further comprises:

in response to a switching operation from the target multimedia material in the target sub-area to the candidate multimedia material, switching the target multimedia material displayed in the target sub-area to the candidate multimedia material.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: WANG, YITIAN
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 068630/0349 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: HE, WOZHOU
To: BEIJING DOUYIN INFORMATION SERVICE CO., LTD.
Reel/Frame 068630/0368 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: CHEN, MINGJIE
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068630/0400 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: YU, PEIHUA
To: BEIJING YOUZHUJU NETWORK TECHNOLOGY CO. LTD.
Reel/Frame 068630/0412 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: BEIJING DOUYIN INFORMATION SERVICE CO., LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068633/0132 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: BEIJING YOUZHUJU NETWORK TECHNOLOGY CO. LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068633/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2024
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068633/0483 →
Priority Claims (1)
CN 202111081785.6 · Sep 15, 2021 · national
Continuity (2)
Continuation PCTCN2022117803 · Sep 8, 2022
Related Publication 20240114216A1 · Apr 4, 2024
References Cited (17)
US 7512537B2 · Pahud · 2009 [cited by examiner]
US 10140259B2 · Iyer · 2018 [cited by examiner]
US 20070061728A1 · Sitomer et al. · 2007 [cited by applicant]
US 20100153520A1 · Daun · 2010 [cited by examiner]
US 20100322589A1 · Henderson et al. · 2010 [cited by applicant]
US 20200126583A1 · Pokharel et al. · 2020 [cited by applicant]
US 20200273493A1 · Huber · 2020 [cited by examiner]
US 20210110164A1 · Mehta · 2021 [cited by examiner]
CN 108259965A · 2018 [cited by applicant]
CN 109756751A · 2019 [cited by applicant]
CN 109889882A · 2019 [cited by applicant]
CN 111711855A · 2020 [cited by applicant]
CN 112040142A · 2020 [cited by applicant]
CN 112579826A · 2021 [cited by applicant]
International Patent Application No. PCT/CN2022/117803; Int'l Search Report; dated Nov. 30, 2022; 3 pages. [cited by applicant]
Communication pursuant to Rules 70(2) and 70a(2) EPC for European Application No. 22869112.7, mailed on Oct. 1, 2024, 1 page. [cited by applicant]
European Patent Application No. 22869112.7; Extended Search Report; dated Sep. 12, 2024; 7 pages. [cited by applicant]