IP Library › Granted Patent US 11,882,244
Granted Patent B2
US 11,882,244 · App. 17/849,029 · Granted Jan 23, 2024

Video special effects processing method and apparatus

Inventors: Xiaoqi Li (Beijing, CN); Jingjin Zhou (Beijing, CN)
H04N5/2621G06V10/40G10H1/366H04N5/265H04N5/2628G10H2210/076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,882,244
App. No.
17/849,029
Granted
Jan 23, 2024
Kind
B2
Abstract

The embodiments of the disclosure disclose a video special effect processing method and a video special effect processing device. The method includes: detecting music played along with a video during a process of playing the video; acquiring a video frame image to be played in the video when the music is detected to be played at a preset rhythm; performing special effect processing on the target object in the video frame image to obtain a special effect processed video frame image; and displaying and playing the special effect processed video frame image.

Claims (63)

1. A video special effect processing method, comprising:

detecting music played along with a video during a process of playing the video, wherein the video comprises a target object;

acquiring a video frame image to be played in the video when the music is detected to be played at a preset rhythm;

performing special effect processing on the target object in the video frame image to obtain a special effect processed video frame image, comprising:

determining a special effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing special effect processing on the target object in the video frame image according to the special effect processing mode to obtain a special effect processed video frame image, wherein the rest of the video frame image other than the target object in the video frame image remains unchanged; and

displaying and playing the special effect processed video frame image;

wherein:

the special effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame image to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame image to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame image, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame image, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

2. The video special effect processing method of claim 1 , wherein:

the special effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the special effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

3. The video special effect processing method of claim 1 , wherein:

the special effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the special effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

4. The video special effect processing method of claim 3 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

5. The video special effect processing method according to claim 1 , wherein the preset rhythm is a beat point, a stress point, a drum point or a preset melody point in the music.

6. An electronic device, comprising:

memory; and

a processor coupled to the memory, the processor configured to execute the video display method for performing instructions comprising:

detecting music played along with a video during a process of playing the video, wherein the video comprises a target object;

acquiring a video frame image to be played in the video when the music is detected to be played at a preset rhythm;

performing special effect processing on the target object in the video frame image to obtain a special effect processed video frame image, comprising:

determining a special effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing special effect processing on the target object in the video frame image according to the special effect processing mode to obtain a special effect processed video frame image, wherein the rest of the video frame image other than the target object in the video frame image remains unchanged; and

displaying and playing the special effect processed video frame image;

wherein:

the special effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame image to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame image to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame image, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame image, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

7. The electronic device according to claim 6 , wherein

the special effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the special effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

8. The electronic device according to claim 6 , wherein

the special effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the special effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

9. The electronic device according to claim 8 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

10. The electronic device according to claim 6 , wherein

the zoom-out processing specifically is: in the video frame image, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and executing a shaking function of a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame image, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and executing a shaking function of a video picture corresponding to the target object after being reduced to the minimum threshold value.

11. The electronic device according to claim 6 , wherein the preset rhythm is a beat point, a stress point, a drum point or a preset melody point in the music.

12. A non-transitory computer-readable storage medium storing non-transitory computer-readable instructions that, when executed by a computer, cause the processor to:

detecting music played along with a video during a process of playing the video, wherein the video comprises a target object;

acquiring a video frame image to be played in the video when the music is detected to be played at a preset rhythm;

performing special effect processing on the target object in the video frame image to obtain a special effect processed video frame image, comprising:

determining a special effect processing mode corresponding to the preset rhythm according to the preset rhythm; and

performing special effect processing on the target object in the video frame image according to the special effect processing mode to obtain a special effect processed video frame image, wherein the rest of the video frame image other than the target object in the video frame image remains unchanged; and

displaying and playing the special effect processed video frame image;

wherein:

the special effect processing mode is zoom-out processing or zoom-in processing, the zoom-out processing is to only magnify the target object in the video frame image to realize a zooming-out video effect, and the zoom-in processing is to only reduce the target object in the video frame image to realize a zooming-in video effect;

the zoom-out processing specifically is: in the video frame image, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame image, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

13. The non-transitory computer-readable storage medium according to claim 12 , wherein the special effect processing mode is zoom-out processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing if the preset rhythm is a weak beat; or,

the special effect processing mode is zoom-in processing if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing if the preset rhythm is a weak beat.

14. The non-transitory computer-readable storage medium according to claim 12 , wherein:

the special effect processing mode is zoom-out processing by adopting a first magnification parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-out processing by adopting a second magnification parameter if the preset rhythm is a weak beat, wherein the first magnification parameter and the second magnification parameter are different parameters; or,

the special effect processing mode is zoom-in processing by adopting a first reduction parameter if the preset rhythm is a strong beat, and the special effect processing mode is zoom-in processing by adopting a second reduction parameter if the preset rhythm is a weak beat, wherein the first reduction parameter and the second reduction parameter are different parameters.

15. The non-transitory computer-readable storage medium according to claim 14 , wherein the first magnification parameter is greater than the second magnification parameter, and the first reduction parameter is greater than the second reduction parameter.

16. The non-transitory computer-readable storage medium according to claim 12 , wherein:

the zoom-out processing specifically is: in the video frame image, magnifying the target object to realize the zoom-out video effect until the target object is magnified to a maximum threshold value, and performing a shaking function on a video picture corresponding to the target object after being magnified to the maximum threshold value; and

the zoom-in processing specifically is: in the video frame image, reducing the target object to realize the zoom-in video effect until the target object is reduced to a minimum threshold value, and performing a shaking function on a video picture corresponding to the target object after being reduced to the minimum threshold value.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: LI, XIAOQI
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 060837/0806 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: ZHOU, JINGJIN
To: SHANGHAI WANGYAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060837/0811 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060837/0816 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2022
From: SHANGHAI WANGYAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 060837/0820 →
Priority Claims (1)
CN 201911364890.3 · Dec 26, 2019 · national
Continuity (2)
Continuation PCTCN2020138415 · Dec 22, 2020
Related Publication 20220321802A1 · Oct 6, 2022
Cited By (1)
US 12,518,664