Granted Patent B2

US 12,340,454 · App. 17/601,261 · Granted Jun 24, 2025

Inventors: Niwen Zheng (Beijing, CN); Lei Sun (Beijing, CN); Tao Li (Beijing, CN); Sen Zhao (Beijing, CN); Jia Qu (Beijing, CN)

Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.

G06T13/80G06F16/64G06F16/685G06T11/203G06T11/60G06F3/0482G06T2200/24

Abstract

Claims (52)

1. A method for displaying lyric effects, applied in a user terminal, comprising:

obtaining, based on a lyric effect display operation of a user, an image sequence and music data to be displayed, the music data comprising audio data and lyrics;

determining a user-selected target time point, playing at least one target image corresponding to the user-selected target time point in the image sequence, and determining target lyrics corresponding to the user-selected target time point in the lyrics; and

adding, at the user terminal, an animation effect on the at least one target image, displaying the target lyrics on the at least one target image, and playing a part of the audio data corresponding to the target lyrics,

wherein the animation effect comprises a plurality of frames of animation images, and said adding, at the user terminal, the animation effect on the at least one target image comprises:

determining a number of the plurality of frames included in the animation effect;

determining, from the image sequence, the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect; and

superimposing the plurality of frames of the animation effect on the determined at least one target image in one-to-one correspondence in accordance with a play order of respective frames of animation images of the animation effect and a play order of respective image frames of the determined at least one target image,

wherein said determining, from the image sequence, the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect comprises:

determining one image at the user-selected target time point, a first number of images before the user-selected target time point, and a second number of images after the user-selected target time point as the at least one target image, a sum of the first number and the second number being equal to the determined number of the plurality of frames included in the animation effect minus 1.

2. The method according to claim 1 , further comprising, prior to said adding the animation effect on the at least one target image:

determining a type of the music data; and

obtaining the animation effect based on the type of the music data.

3. The method according to claim 1 , further comprising, prior to said adding the animation effect on the at least one target image:

obtaining the animation effect based on a content of the target lyrics.

4. The method according to claim 1 , further comprising:

displaying an animation effect selection interface in response to a special effects addition trigger operation of the user; and

determining the animation effect based on an animation effect selection operation of the user on the animation effect selection interface.

5. The method according to claim 1 , wherein said displaying the target lyrics on the at least one target image comprises:

determining a display area corresponding to the target lyrics in the at least one target image and a display mode of the target lyrics; and

superimposing the target lyrics on the corresponding at least one target image in accordance with the display mode.

6. The method according to claim 5 , wherein said determining the display mode of the target lyrics comprises:

determining the display mode of the target lyrics based on a size of the display area.

7. The method according to claim 6 , wherein the display mode of the target lyrics comprises at least one of: a number of words of lyrics displayed on each line in the display area, an alignment mode of the lyrics displayed on each line in the display area, or a font and a font size of the lyrics.

8. The method according to claim 1 , wherein said determining the user-selected target time point comprises:

receiving a time point selection operation of the user; and

determining the user-selected target time point based on the time point selection operation.

9. The method according to claim 1 , further comprising:

synthesizing the image sequence, the animation effects, and the music data into a video based on a video generation operation of the user.

10. An electronic device being a user terminal, comprising:

one or more processors;

a memory; and

one or more application programs stored in the memory and configured to be executed by the one or more processors, the one or more applications are configured to implement a method for displaying lyric effects, applied in the user terminal, comprising:

obtaining, based on a lyric effect display operation of a user, an image sequence and music data to be displayed, the music data comprising audio data and lyrics;

determining a user-selected target time point, playing at least one target image corresponding to the user-selected target time point in the image sequence, and determining target lyrics corresponding to the user-selected target time point in the lyrics; and

adding, at the user terminal, an animation effect on the at least one target image, displaying the target lyrics on the at least one target image, and playing a part of the audio data corresponding to the target lyrics,

wherein the animation effect comprises a plurality of frames of animation images, and said adding, at the user terminal, the animation effects on the at least one target image comprises:

determining a number of the plurality of frames included in the animation effect;

determining, from the image sequence, a number of the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect; and

superimposing the plurality of frames of the animation effect on the determined at least one target image in one-to-one correspondence in accordance with a play order of respective frames of animation images of the animation effect and a play order of respective image frames of the determined at least one target image,

wherein said determining, from the image sequence, the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect comprises:

determining one image at the user-selected target time point, a first number of images before the user-selected target time point, and a second number of images after the user-selected target time point as the at least one target image, a sum of the first number and the second number being equal to the determined number of the plurality of frames included in the animation effect minus 1.

11. A non-transitory computer-readable medium having at least one instruction, at least one program segment, a set of codes, or a set of instructions stored thereon, wherein the at least one instruction, the at least one program segment, the set of codes, or the set of instructions is loaded and executed by a processor to implement a method for displaying lyric effects, applied in a user terminal, comprising:

obtaining, based on a lyric effect display operation of a user, an image sequence and music data to be displayed, the music data comprising audio data and lyrics;

determining a user-selected target time point, playing at least one target image corresponding to the user-selected target time point in the image sequence, and determining target lyrics corresponding to the user-selected target time point in the lyrics; and

adding, at the user terminal, an animation effect on the at least one target image, displaying the target lyrics on the at least one target image, and playing a part of the audio data corresponding to the target lyrics,

wherein the animation effect comprises a plurality of frames of animation images, and said adding the animation effect on the at least one target image comprises:

determining a number of the plurality of frames included in the animation effect;

determining, from the image sequence, the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect; and

superimposing the plurality of frames of the animation effect on the determined at least one target image in one-to-one correspondence in accordance with a play order of respective frames of animation images of the animation effect and a play order of respective image frames of the determined at least one target image,

wherein said determining, from the image sequence, the at least one target image corresponding to the user-selected target time point and containing a number of image frames equal to the determined number of the plurality of frames included in the animation effect comprises:

determining one image at the user-selected target time point, a first number of images before the user-selected target time point, and a second number of images after the user-selected target time point as the at least one target image, a sum of the first number and the second number being equal to the determined number of the plurality of frames included in the animation effect minus 1.

Priority Claims (1)

Continuity (1)

References Cited (36)