IP Library › Granted Patent US 11,223,760
Granted Patent B2
US 11,223,760 · App. 17/214,498 · Granted Jan 11, 2022

Video processing method and device, shooting system, and computer-readable storage medium

Inventors: Guanliang Su (Shenzhen, CN); Ye Tao (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
H04N5/23216H04N5/23299H04N5/262
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,223,760
App. No.
17/214,498
Granted
Jan 11, 2022
Kind
B2
Abstract

A video processing method includes determining a shooting template that includes background music, one or more gimbal movement trajectories, and one or more shooting elements, sending one or more parameters corresponding to the one or more gimbal movement trajectories to a gimbal to control the gimbal to drive a shooting device to shoot according to the one or more gimbal movement trajectories, obtaining information of at least one video segment, and generating a video file based on the at least one video segment.

Claims (50)

1. A video processing method comprising:

determining a shooting template, the shooting template including background music, one or more gimbal movement trajectories, and one or more shooting elements;

sending one or more parameters corresponding to the one or more gimbal movement trajectories to a gimbal to control the gimbal to drive a shooting device to shoot according to the one or more gimbal movement trajectories;

obtaining information of at least one video segment; and

generating a video file based on the at least one video segment.

2. The method of claim 1 , wherein determining the shooting template includes:

receiving the background music input by a user;

identifying one or more music nodes of the background music;

segmenting the background music into one or more background music segments based on the one or more music nodes; and

generating the shooting template that includes one or more template segments, a duration of each of the one or more template segments equaling a duration of one of the one or more background music segments.

3. The method of claim 2 , further comprising, after segmenting the background music into the one or more background music segments:

for one background music segment of the one or more background music segments, determining one gimbal movement trajectory of the one or more gimbal movement trajectories corresponding to one template segment that corresponds to the one background music segment.

4. The method of claim 3 , wherein determining the one gimbal movement trajectory corresponding to the one template segment includes:

determining the one gimbal movement trajectory corresponding to the one template segment based on the duration of the one template segment.

5. The method of claim 4 , wherein determining the one gimbal movement trajectory corresponding to the one template segment based on the duration of the one template segment includes:

obtaining one or more candidate gimbal movement trajectories each having a movement duration consistent with the duration of the one template segment;

obtaining score information of the candidate gimbal movement trajectories; and

determining one of the one or more candidate gimbal movement trajectories with a highest score as the one gimbal movement trajectory corresponding to the one template segment.

6. The method of claim 4 , wherein determining the one gimbal movement trajectory corresponding to the one template segment based on the duration of the one template segment includes:

obtaining one or more candidate gimbal movement trajectories each having a movement duration consistent with the duration of the one template segment;

pushing the one or more candidate gimbal movement trajectories to the user;

receiving a selection instruction from the user; and

determining, based on the selection instruction, one of the one or more candidate gimbal movement trajectories as the one gimbal movement trajectory corresponding to the one template segment.

7. The method of claim 3 , determining the one gimbal movement trajectory corresponding to the one template segment includes:

determining one of the one or more gimbal movement trajectories that conforms to a rhythm style of the one background music segment as the one gimbal movement trajectory corresponding to the one template segment.

8. The method of claim 2 , further comprising, after segmenting the background music:

determining, based on a selection instruction, at least one of the one or more shooting elements that corresponds to one of the one or more template segments.

9. The method of claim 2 , wherein segmenting the background music includes:

segmenting the background music into the one or more background music segments based on the one or more music nodes according to a preset segmentation algorithm.

10. The method of claim 1 , wherein determining the shooting template includes:

receiving the one or more gimbal movement trajectories and the background music selected by a user to generate the shooting template.

11. The method of claim 10 , further comprising:

determining the one or more shooting elements based on a selection instruction to obtain the shooting template.

12. The method of claim 10 , further comprising:

segmenting the background music into one or more background music segments based on music node information of the background music; and

adjusting one gimbal movement trajectory of the one or more gimbal movement trajectories to have a duration that matches a duration of one background music segment of the one or more background music segments.

13. The method of claim 12 , wherein adjusting the one gimbal movement trajectory includes:

adjusting a movement speed of the gimbal such that the duration of the one gimbal movement trajectory is consistent with the duration of the background music segment.

14. The method of claim 1 , wherein determining the shooting template includes:

receiving a selection instruction, the selection instruction including an identification of a preset shooting template, the preset shooting template including preset background music, a preset gimbal movement trajectory, and a preset shooting element; and

determining the shooting template according to the selection instruction.

15. The method of claim 1 , further comprising, before determining the shooting template:

receiving a trial instruction;

selecting a template segment according to the trial instruction; and

sending a gimbal movement trajectory corresponding to the template segment to the gimbal to control the gimbal to move according to the gimbal movement trajectory corresponding to the template segment.

16. The method of claim 1 , further comprising, before determining the shooting template:

receiving a trial instruction, the trial instruction including at least one of an identification of a candidate background music, an identification of a candidate gimbal movement trajectory, or an identification of a candidate shooting element; and

displaying a shooting effect corresponding to at least one of the candidate background music or the candidate shooting element.

17. The method of claim 1 , wherein sending the one or more parameters to the gimbal includes:

sending the one or more parameters to the gimbal via a wireless connection or a wired connection.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2021
From: TAO, YE
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 055739/0030 →
EMPLOYMENT AGREEMENT Recorded Mar 26, 2021
From: SU, GUANLIANG
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 055744/0104 →
Continuity (2)
Continuation PCTCN2018108833 · Sep 29, 2018
Related Publication 20210235008A1 · Jul 29, 2021