IP Library Granted Patent US 11,645,804
Granted Patent B2
US 11,645,804 · App. 17/047,276 · Granted May 9, 2023

Dynamic emoticon-generating method, computer-readable storage medium and computer device

Inventors: Dong Huang (Shenzhen, CN); Tian Yi Liang (Shenzhen, CN); Jia Wen Zhong (Shenzhen, CN); Jun Jie Zhou (Shenzhen, CN); Jin Jiang (Shenzhen, CN); Ying Qi (Shenzhen, CN); Si Kun Liang (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06T13/80G06F3/0483G06F3/04817G06T13/40G06V40/171G11B27/022H04L51/10H04N5/2621G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,804
App. No.
17/047,276
Granted
May 9, 2023
Kind
B2
Abstract

An animated emoticon generation method, a computer-readable storage medium, and a computer device are provided. The method includes: displaying an emoticon input panel on a chat page; detecting whether a video shooting event is triggered in the emoticon input panel; acquiring video data in response to detecting the video shooting event; obtaining an edit operation for the video data; processing video frames in the video data according to the edit operation to synthesize an animated emoticon; and adding an emoticon thumbnail corresponding to the animated emoticon to the emoticon input panel, the emoticon thumbnail displaying the animated emoticon to be used as a message on the chat page based on a user selecting the emoticon thumbnail in the emoticon input panel.

Claims (104)

1. An animated emoticon generation method, performed by a computer device, the method comprising:

displaying an emoticon input panel on a chat page on which chat messages are displayed, the chat messages being between at least two participants in a chat displayed on the chat page;

detecting whether a video shooting event is triggered in the emoticon input panel on the chat page on which the chat messages are displayed, the video shooting event comprising an operation to an emoticon displayed on the chat page;

acquiring video data in response to detecting the video shooting event on the chat page on which the chat messages are displayed;

while acquiring the video data, translucently superimposing a display of real-time images from the video data with a display of the emoticon;

obtaining an edit operation for the video data;

processing video frames in the video data according to the edit operation to synthesize an animated emoticon from the acquired video data of which the display of the real-time images from the video data were translucently superimposed with the display of the emoticon; and

adding, alongside the static emoticons, an emoticon thumbnail corresponding to the animated emoticon to the emoticon input panel on the chat page on which the chat messages are displayed, the emoticon thumbnail displaying the animated emoticon to be used as a message on the chat page on which the chat messages are displayed based on a user selecting the emoticon thumbnail in the emoticon input panel.

2. The method according to claim 1 , wherein the acquiring the video data in response to the video shooting event comprises:

switching from the chat page on which the chat messages are displayed to a video acquisition page in response to the video shooting event;

displaying, on the video acquisition page, an image acquired in real time;

recording the video data based on detecting a recording start event on the video acquisition page; and

obtaining the video data until detecting a recording end event on the video acquisition page.

3. The method according to claim 1 , wherein the edit operation comprises a background removal operation, and

wherein the processing the video frames in the video data according to the edit operation to synthesize the animated emoticon comprises:

extracting facial features for each video frame according to an image attribute of the each video frame;

obtaining contour information of a human figure in the video frames according to the facial features;

obtaining background regions of the video frames according to the contour information;

adjusting transparency of each pixel in the background region according to a transparency value; and

synthesizing the adjusted video frames to obtain the animated emoticon.

4. The method according to claim 1 , wherein the edit operation comprises an acceleration operation, and

wherein the processing the video frames in the video data according to the edit operation to synthesize the animated emoticon comprises:

calculating a timestamp array corresponding to the video data based on an acceleration rate;

extracting, from the video data, video frames that correspond to the timestamp array; and

synthesizing the extracted video frames to obtain the animated emoticon.

5. The method according to claim 1 , wherein the edit operation comprises an emoticon addition operation, and

wherein the processing the video frames in the video data according to the edit operation to synthesize the animated emoticon comprises:

obtaining an additional emoticon corresponding to an additional emoticon thumbnail selected from the emoticon input panel;

adding an emoticon image of the additional emoticon to the video frames in the video data; and

synthesizing the video frames to which the emoticon image is added to obtain the animated emoticon.

6. The method according to claim 5 , wherein the adding the emoticon image of the additional emoticon to the video frames in the video data further comprises:

generating a plurality of different emoticon images of the additional emoticon;

mapping the plurality of different emoticon images to the respective video frames in the video data; and

adding the corresponding plurality of emoticon images of the additional emoticon to the respective video frames in the video data.

7. The method according to claim 1 , wherein the edit operation comprises a text addition operation, and

wherein the processing the video frames in the video data according to the edit operation to synthesize the animated emoticon comprises:

obtaining an additional text in response to the text addition operation;

adding the additional text to the video frames in the video data; and

synthesizing the video frames to which the additional text is added to obtain the animated emoticon.

8. The method according to claim 7 , wherein the obtaining the additional text comprises:

displaying a text input box and obtaining the additional text input in the text input box by the user; or

obtaining speech data recorded during the acquisition of the video data, and performing speech recognition on the speech data to obtain the additional text.

9. The method according to claim 1 , further comprising:

detecting a transparency of a pixel in each of the video frames;

adjusting the transparency of the pixel according to a transparency value; and

synthesizing the animated emoticon based on the adjusted transparency of the pixels in the video frames.

10. The method according to claim 1 , further comprising:

obtaining a follow shot operation for an emoticon message on the chat page on which the chat messages are displayed;

switching from the chat page on which the chat messages are displayed to a video acquisition page in response to the follow shot operation, the video acquisition page being separate from the chat page;

displaying, on the video acquisition page, the emoticon corresponding to the emoticon message on the video acquisition page in a translucent manner; and

superimposing, on the video acquisition page, the real-time images acquired by a camera with the emoticon of the emoticon message displayed in the translucent manner.

11. The method according to claim 1 , further comprising:

based on the edit operation for the video data not being obtained and detecting a synthesis confirmation operation, directly synthesizing according to the video frames in the acquired video data to obtain the animated emoticon.

12. A computer device for generating an animated emoticon, comprising:

at least one memory configured to store computer program code;

at least one processor configured to access the at least one memory and operate as instructed by the computer program code, the computer program code comprising:

detection code configured to cause the at least one processor to display an emoticon input panel on a chat page on which chat messages are displayed and detect whether a video shooting event is triggered in the emotion input panel on the chat page on which the chat messages are displayed, the chat messages being between at least two participants of a chat displayed on the chat page, the video shooting event comprising an operation to an emoticon displayed on the chat page;

acquisition code configured to cause the at least one processor to acquire video data, in response to detecting the video shooting event on the chat page on which the chat messages are displayed, and, while acquiring the video data, to translucently superimpose a display of real-time images from the video data with a display of the emoticon;

obtaining code configured to cause the at least one processor to obtain an edit operation for the video data;

synthesis code configured to cause the at least one processor to process video frames in the video data according to the edit operation to synthesize an animated emoticon from the acquired video data of which the display of the real-time images from the video data were translucently superimposed with the display of the emoticon; and

addition code configured to cause the at least one processor to add, alongside the static emoticons, an emoticon thumbnail corresponding to the animated emoticon to the emoticon input panel on the chat page on which the chat messages are displayed, the emoticon thumbnail displaying the animated emoticon to be used as a message on the chat page on which the chat messages are displayed based on a user selecting the emoticon thumbnail in the emoticon input panel.

13. The computer device according to claim 12 , wherein the acquisition code is further configured to cause the at least one processor to:

switch from the chat page on which the chat messages are displayed to a video acquisition page in response to the video shooting event;

display, on the video acquisition page, an image acquired in real-time;

record the video data based on detecting a recording start event on the video acquisition page; and

obtain the video data until detecting a recording end event on the video acquisition page.

14. The computer device according to claim 12 , wherein the edit operation comprises a background removal operation, and

wherein the obtaining code is further configured to cause the at least one processor to:

extract facial features for each video frame according to an image attribute of the each video frame;

obtain contour information of a face in the video frames according to the facial features;

obtain background regions of the video frames according to the contour information;

adjust transparency of each pixel in the background region according to a transparency value; and

synthesize the adjusted video frames to obtain the animated emoticon.

15. The computer device according to claim 12 , wherein the edit operation comprises an acceleration operation, and

wherein the obtaining code is further configured to cause the at least one processor to:

calculate a timestamp array corresponding to the video data based on an acceleration rate; extract, from the video data, video frames that correspond to the timestamp array; and

synthesize the extracted video frames to obtain the animated emoticon.

16. The computer device according to claim 12 , wherein the edit operation comprises an emoticon addition operation, and

wherein the obtaining code is further configured to cause the at least one processor to:

obtain an additional emoticon corresponding to an additional emoticon thumbnail selected from the emoticon input panel;

add an emoticon image of the additional emoticon to the video frames in the video data; and

synthesize the video frames to which the emoticon image is added to obtain the animated emoticon.

17. The computer device according to claim 12 , wherein the edit operation comprises a text addition operation, and

wherein the obtaining code is further configured to cause the at least one processor to:

obtain an additional text in response to the text addition operation;

add the additional text to the video frames in the video data; and

synthesize the video frames to which the additional text is added to obtain the animated emoticon.

18. The computer device according to claim 12 , further comprising transparency adjusting code configured to cause the at least one processor to:

detect a transparency of a pixel in each of the video frames;

adjust the transparency of the pixel according to a transparency value; and

synthesize the animated emoticon based on the adjusted transparency of the pixels in the video frames.

19. The computer device according to claim 12 , further comprising follow shot code configured to cause the at least one processor to:

obtain a follow shot operation for an emoticon message on the chat page on which the chat messages are displayed;

switch from the chat page on which the chat messages are displayed to a video acquisition page in response to the follow shot operation, the video acquisition page being separate from the chat page;

display, on the video acquisition page, the emoticon corresponding to the emoticon message on the video acquisition page in a translucent manner; and

superimpose, on the video acquisition page, the real-time images acquired by a camera with the emoticon of the emoticon message displayed in the translucent manner.

20. A non-transitory computer-readable storage medium storing computer program code to cause at least one processor to:

display an emoticon input panel on a chat page on which chat messages are displayed, the chat messages being between at least two participants of a chat displayed on the chat page, the video shooting event comprising an operation to an emoticon displayed on the chat page;

detect whether a video shooting event is triggered in the emoticon input panel;

while acquiring the video data, translucently superimposing a display of real-time images from the video data with a display of the emoticon;

acquire video data in response to detecting the video shooting event;

obtain an edit operation for the video data;

process video frames in the video data according to the edit operation to synthesize an animated emoticon from the acquired video data of which the display of the real-time images from the video data were translucently superimposed with the display of the emoticon; and

add, alongside the static icons, an emoticon thumbnail corresponding to the animated emoticon to the emoticon input panel on the chat page on which the chat messages are displayed, the emoticon thumbnail displaying the animated emoticon to be used as a message on the chat page on which the chat messages are displayed based on a user selecting the emoticon thumbnail in the emoticon input panel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2020
From: HUANG, DONG; LIANG, TIAN YI; ZHONG, JIA WEN; ZHOU, JUN JIE; JIANG, JIN; QI, YING; LIANG, SI KUN
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 054042/0186 →
Priority Claims (1)
CN 201811132844.6 · Sep 27, 2018 · national
Continuity (1)
Related Publication 20210158594A1 · May 27, 2021
Cited By (1)
US 12,431,168