IP Library › Granted Patent US 12,375,618
Granted Patent B2
US 12,375,618 · App. 18/008,637 · Granted Jul 29, 2025

Method and apparatus for showing special effect, electronic device, and computer-readable medium

Inventors: Dongju Xie (Beijing, CN); Weiming Zheng (Beijing, CN)
Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
H04N5/2621G06T7/20G10H1/368
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,618
App. No.
18/008,637
Granted
Jul 29, 2025
Kind
B2
Abstract

The present disclosure provides an effect showing method and an apparatus thereof, an electronic device, and a computer-readable medium. The method includes: opening an effect showing interface and turning on a video capturing apparatus; obtaining a music feature of background music in the effect showing interface and second effect elements generated according to the music feature, showing the second effect elements in a preset order, and controlling the second effect elements to move in the effect showing interface according to the music feature; identifying a target object in a video captured by the video capturing apparatus and controlling a first effect element in the effect showing interface to move according to a movement of the target object; and triggering an effect when the first effect element and the second effect elements satisfy a preset condition.

Claims (53)

1. A method for showing an effect, comprising:

opening an effect showing interface based on a triggering operation and turning on a video capturing apparatus, wherein a first effect element is shown in the effect showing interface;

obtaining a music feature of background music in the effect showing interface and a plurality of second effect elements generated according to the music feature, showing the second effect elements in a preset order, and controlling the second effect elements to move in the effect showing interface according to the music feature;

identifying a target object in a video captured by the video capturing apparatus and controlling the first effect element to move in the effect showing interface according to a movement of the target object; and

triggering an effect when the first effect element and the second effect elements satisfy a preset condition.

2. The method according to claim 1 , wherein the music feature comprises a total number of feature music segments of the background music, and a total number of the second effect elements corresponds to the number of the feature music segments.

3. The method according to claim 2 , wherein the music feature further comprises a play duration of each of the feature music segments; and

for each second effect element, a length of the each second effect element shown in the effect showing interface is positively related to a play duration of a feature music segment corresponding to the each second effect element.

4. The method according to claim 2 , wherein the music feature further comprises a pitch of each of the feature music segments; and

for each second effect element, a position height of the each second effect element shown in the effect showing interface is positively related to a pitch of a feature music segment corresponding to the each second effect element.

5. The method according to claim 2 , wherein the music feature further comprises a total number of beats of each of the feature music segments; and

for each second effect element, a movement velocity of the each second effect element in the effect showing interface is positively related to the number of beats of a feature music segment corresponding to the each second effect element.

6. The method according to claim 2 , wherein the preset order comprises a play order of the feature music segments.

7. The method according to claim 1 , wherein controlling the first effect element to move in the effect showing interface according to the movement of the target object comprises:

obtaining a movement trail of the target object in a target direction; and

controlling the first effect element to move in the effect showing interface according to the movement trail of the target object in the target direction.

8. The method according to claim 1 , wherein after identifying the target object in the video captured by the video capturing apparatus, the method further comprises:

displaying the target object in the effect showing interface, and adjusting a position of the first effect element in the effect showing interface according to an initial position of the target object in the effect showing interface.

9. The method according to claim 1 , wherein triggering the effect when the first effect element and the second effect elements satisfy the preset condition comprises:

triggering a first effect when the second effect element moves to a preset region in the effect showing interface and contacts with the first effect element; and

triggering a second effect when the second effect element moves to the preset region in the effect showing interface and is not in contact with the first effect element,

wherein the preset region is a region in which the first effect element is capable of moving.

10. The method according to claim 9 , wherein

the first effect comprises:

playing a first pre-configured sound effect; and/or

playing a first pre-configured animation; and

the second effect comprises:

playing a second pre-configured sound effect; and/or

playing a second pre-configured animation.

11. The method according to claim 10 , wherein the first pre-configured sound effect is the background music.

12. The method according to claim 1 , further comprising:

receiving a music selecting operation by a user; and

determining the background music for the effect showing interface according to the music selecting operation.

13. An apparatus for showing an effect, comprising:

an opening module, configured to open an effect showing interface based on a triggering operation and turn on a video capturing apparatus, wherein a first effect element is shown in the effect showing interface;

an effect element showing module, configured to obtain a music feature of background music in the effect showing interface and a plurality of second effect elements generated according to the music feature, show the second effect elements in a preset order, and control the second effect elements to move in the effect showing interface according to the music feature;

an effect element controlling module, configured to identify a target object in a video captured by the video capturing apparatus and control the first effect element to move in the effect showing interface according to a movement of the target object; and

an effect showing module, configured to trigger an effect when the first effect element and the second effect elements satisfy a preset condition.

14. An electronic device, comprising:

one or more processors;

a memory; and

one or more applications,

wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and

the one or more applications are configured to perform the method for showing an effect according to claim 1 .

15. A non-transitory computer-readable medium for storing computer instructions, wherein the computer instructions, when executed on a computer, cause the computer to perform the method for showing an effect according to claim 1 .

16. The apparatus according to claim 13 , wherein the music feature comprises a total number of feature music segments of the background music, and a total number of the second effect elements corresponds to the number of the feature music segments.

17. The apparatus according to claim 16 , wherein the music feature further comprises a play duration of each of the feature music segments; and

for each second effect element, a length of the each second effect element shown in the effect showing interface is positively related to a play duration of a feature music segment corresponding to the each second effect element.

18. The apparatus according to claim 16 , wherein the music feature further comprises a pitch of each of the feature music segments; and

for each second effect element, a position height of the each second effect element shown in the effect showing interface is positively related to a pitch of a feature music segment corresponding to the each second effect element.

19. The apparatus according to claim 16 , wherein the music feature further comprises a total number of beats of each of the feature music segments; and

for each second effect element, a movement velocity of the each second effect element in the effect showing interface is positively related to the number of beats of a feature music segment corresponding to the each second effect element.

20. The apparatus according to claim 16 , wherein the preset order comprises a play order of the feature music segments.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: XIE, DONGJU
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064187/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: ZHENG, WEIMING
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 064187/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064187/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 064187/0651 →
Priority Claims (1)
CN 202010699334.8 · Jul 17, 2020 · national
Continuity (1)
Related Publication 20230254436A1 · Aug 10, 2023
References Cited (24)
US 10319410B1 · Townsend · 2019 [cited by examiner]
US 20160299684A1 · Miyashita · 2016 [cited by applicant]
US 20200351450A1 · Kim · 2020 [cited by examiner]
CN 103077701A · 2013 [cited by applicant]
CN 107329980A · 2017 [cited by applicant]
CN 107770596A · 2018 [cited by applicant]
CN 108111909A · 2018 [cited by applicant]
CN 108322802A · 2018 [cited by applicant]
CN 108810597A · 2018 [cited by applicant]
CN 108833818A · 2018 [cited by applicant]
CN 109040615A · 2018 [cited by applicant]
CN 109120875A · 2019 [cited by applicant]
CN 109615682A · 2019 [cited by applicant]
CN 110769309A · 2020 [cited by applicant]
CN 111077984A · 2020 [cited by applicant]
CN 111177610A · 2020 [cited by applicant]
CN 111240482A · 2020 [cited by applicant]
CN 111857923A · 2020 [cited by applicant]
IN 109462776A · 2019 [cited by applicant]
JP 2015203933A · 2015 [cited by applicant]
Hu Fangliang et al. “Research and implementation of 3D scene post-processing special effects based on mobile platform”, China Excellent Master's Thesis Full-text Database (Information Technology Series), Mar. 15, 2016. [cited by applicant]
International Search Report issued in corresponding International Application No. PCT/CN2021/096349 dated Aug. 26, 2021. [cited by applicant]
Huron D., et al., “Eyebrow Movements And Vocal Pitch Height: Evidence Consistent With An Ethological Signal”, The Journal of the Acoustical Society of America, Mar. 18, 2013, 6 pages. [cited by applicant]
Written Opinion for International Application No. PCT/CN2021/096349, mailed on Aug. 26, 2021, 09 Pages. [cited by applicant]