IP Library › Granted Patent US 12,155,957
Granted Patent B2
US 12,155,957 · App. 18/528,745 · Granted Nov 26, 2024

Video special effects processing method and apparatus

Inventors: Xiaoqi Li (Beijing, CN); Jingjin Zhou (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
H04N5/2621G06V10/40G10H1/366H04N5/2628H04N5/265G10H2210/076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,155,957
App. No.
18/528,745
Granted
Nov 26, 2024
Kind
B2
Abstract

The embodiments of the disclosure disclose a video effect processing method and a video effect processing device. The method includes: detecting audio of a video; acquiring a video frame in the video when the audio is detected at a preset rhythm; performing effect processing on the target object in the video frame to obtain an effect processed video frame; and displaying and playing the effect processed video frame.

Claims (61)

1. A video effect processing method, comprising:

detecting audio of a video, wherein the video comprises a target object;

acquiring a video frame in the video when the audio is detected at a preset rhythm;

performing effect processing on the target object in the video frame to obtain an effect processed video frame, comprising:

determining an effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing effect processing on the target object in the video frame according to the effect processing mode to obtain an effect processed video frame, wherein the rest of the video frame other than the target object in the video frame remains unchanged; and

displaying and playing the effect processed video frame;

wherein:

the effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

2. The video effect processing method of claim 1 , wherein:

the effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

3. The video effect processing method of claim 1 , wherein:

the effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

4. The video effect processing method of claim 3 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

5. The video effect processing method according to claim 1 , wherein the preset rhythm is a beat point, a stress point, a drum point or a preset melody point in the audio.

6. An electronic device, comprising:

memory; and

a processor coupled to the memory, the processor configured to execute the video display method for performing instructions comprising:

detecting audio of a video, wherein the video comprises a target object;

acquiring a video frame in the video when the audio is detected at a preset rhythm;

performing effect processing on the target object in the video frame to obtain an effect processed video frame, comprising:

determining an effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing effect processing on the target object in the video frame according to the effect processing mode to obtain an effect processed video frame, wherein the rest of the video frame other than the target object in the video frame remains unchanged; and

displaying and playing the effect processed video frame;

wherein:

the effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

7. The electronic device of claim 6 , wherein:

the effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

8. The electronic device of claim 6 , wherein:

the effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

9. The electronic device of claim 8 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

10. The electronic device of claim 6 , wherein the preset rhythm is a beat point, a stress point, a drum point or a preset melody point in the audio.

11. A non-transitory computer-readable storage medium storing non-transitory computer-readable instructions that, when executed by a computer, cause the processor to:

detecting audio of a video, wherein the video comprises a target object;

acquiring a video frame in the video when the audio is detected at a preset rhythm;

performing effect processing on the target object in the video frame to obtain an effect processed video frame, comprising:

determining an effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing effect processing on the target object in the video frame according to the effect processing mode to obtain an effect processed video frame, wherein the rest of the video frame other than the target object in the video frame remains unchanged; and

displaying and playing the effect processed video frame;

wherein:

the effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein:

the effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

13. The non-transitory computer-readable storage medium according to claim 11 , wherein:

the effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

14. The non-transitory computer-readable storage medium according to claim 13 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

15. The non-transitory computer-readable storage medium according to claim 11 , wherein:

the zoom-out processing specifically is: in the video frame, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2024
From: LI, XIAOQI
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 067898/0575 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2024
From: ZHOU, JINGJIN
To: SHANGHAI WANGYAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 067898/0659 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2024
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.; SHANGHAI WANGYAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 067900/0771 →
Priority Claims (1)
CN 201911364890.3 · Dec 26, 2019 · national
Continuity (3)
Continuation 17849029 · Jun 24, 2022
Continuation PCTCN2020138415 · Dec 22, 2020
Related Publication 20240106968A1 · Mar 28, 2024