IP Library › Granted Patent US 12,205,215
Granted Patent B2
US 12,205,215 · App. 17/507,952 · Granted Jan 21, 2025

System and method for animated emoji recording and playback

Inventors: Zhili Chen (Los Angeles, CA); Shouhan Gao (Culver City, CA); Vishnuvardhan Tanguturi (Culver City, CA); Yuxi Zhang (Los Angeles, CA); Bo Hu (Culver City, CA)
Assignee: Lemon Inc.
G06T13/80G06T13/40G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,215
App. No.
17/507,952
Filed
Oct 22, 2021
Granted
Jan 21, 2025
Kind
B2
Examiner
HOANG, PETER
Art Unit
2616
USPC
345/473
Abstract

Systems and methods for managing an animated emoji playback are provided. In particular, a server may monitor user interactions, wherein the user interactions include users interacting with objects of other users. The server may detect an action performed by a first user of the users on an object of a second user of the users and determine if the detected action is a triggering action defined by the second user that triggers a playback of an animated emoji of the second user. In response to determining that the detected action is the triggering action, the server may preset the playback of the animated emoji of the second user to the first user.

Claims (44)

1. A method for managing an animated emoji playback, the method comprising:

monitoring user interactions, wherein the user interactions include users interacting with objects of other users;

generating one or more animated emojis by recording an animation of a user avatar with a facial expression of a second user of the users;

associating the one or more animated emojis with a corresponding one or more triggering actions defined by the second user;

detecting an action performed by a first user of the users;

determining if the detected action is at least one of the triggering action of the corresponding one or more triggering actions defined by the second user that triggers a playback of at least one of the associated animated emoji of the one or more animated emojis of the second user; and

automatically presenting, in response to determination that the detected action is the at least one of the triggering action of the corresponding one or more triggering actions, the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user.

2. The method of claim 1 , wherein the objects include photos, videos, and/or live stream videos.

3. The method of claim 1 , wherein the animated emoji of the second user mirrors the animated emoji by the first user in reacting to the receiving the animated emoji by the first user.

4. The method of claim 1 , wherein determining if the detected action is a triggering action comprises determining if the detected action is associated with the animation emoji defined by the second user.

5. The method of claim 1 , wherein automatically presenting the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user without an input from the second user.

6. The method of claim 5 , wherein automatically presenting the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user comprises:

automatically updating a profile photo of the second user from a user profile photo to the at least one of the associated animated emoji;

presenting a playback of the at least one of the associated animated emoji; and

returning the profile photo to the user profile photo after the playback of the at least one of the associated animated emoji.

7. The method of claim 5 , wherein automatically presenting the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user comprises:

automatically updating a user avatar of the second user during a live video streaming to present a playback of the at least one of the associated animated emoji of the user avatar regardless of a current facial expression of the second user.

8. A computing device for managing an animated emoji playback, the computing device comprising:

a processor; and

a memory having a plurality of instructions stored thereon that, when executed by the processor, causes the computing device to:

monitor user interactions, wherein the user interactions include users interacting with objects of other users;

generate one or more animated emojis by recording an animation of a user avatar with a facial expression of a second user of the users;

associate the one or more animated emojis with a corresponding one or more triggering actions defined by the second user;

detect an action performed by a first user of the users;

determine if the detected action is at least one of the triggering action of the corresponding one or more triggering actions defined by the second user that triggers a playback of at least one of the associated animated emoji of the one or more animated emojis of the second user; and

automatically present, in response to determination that the detected action is the at least one of the triggering action of the corresponding one or more triggering actions, the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user.

9. The computing device of claim 8 , wherein the objects include photos, videos, and/or live stream videos.

10. The computing device of claim 8 , wherein to determine if the detected action is a triggering action comprises to determine if the detected action is associated with the animation emoji defined by the second user.

11. The computing device of claim 8 , wherein automatically present the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user without an input from the second user.

12. The computing device of claim 11 , wherein to automatically present the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user comprises to:

automatically update a profile photo of the second user from a user profile photo to the at least one of the associated animated emoji;

present a playback of the at least one of the associated animated emoji; and

return the profile photo to the user profile photo after the playback of the at least one of the associated animated emoji.

13. The computing device of claim 11 , wherein to automatically present the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user comprises to automatically update a user avatar of the second user during a live video streaming to present a playback of the at least one of the associated animated emoji of the user avatar regardless of a current facial expression of the second user.

14. A non-transitory computer-readable medium storing instructions for managing an animated emoji playback, the instructions when executed by one or more processors of a computing device, cause the computing device to:

monitor user interactions, wherein the user interactions include users interacting with objects of other users;

generate one or more animated emojis by recording an animation of a user avatar with a facial expression of a second user of the users;

associate the one or more animated emojis with a corresponding one or more triggering actions defined by the second user;

detect an action performed by a first user of the users;

determine if the detected action is at least one of the triggering action of the corresponding one or more triggering actions defined by the second user that triggers a playback of at least one of the associated animated emoji of the one or more animated emojis of the second user; and

automatically present, in response to determination that the detected action is the at least one of the triggering action of the corresponding one or more triggering actions, the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user.

15. The non-transitory computer-readable medium of claim 14 , wherein to determine if the detected action is a triggering action comprises to determine if the detected action is associated with the animation emoji defined by the second user.

16. The non-transitory computer-readable medium of claim 14 , wherein to automatically present the playback of the at least one of the associated animated emoji of the one or more animated emojis of the second user to the first user without an input from the second user.

17. The non-transitory computer-readable medium of claim 14 , wherein the objects include photos, videos, and/or live stream videos.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2024
From: CHEN, ZHILI; GAO, SHOUHAN; TANGUTURI, VISHNUVARDHAN; ZHANG, YUXI
To: BYTEDANCE INC.; TIKTOK INC.
Reel/Frame 068570/0142 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2024
From: BYTEDANCE INC.; TIKTOK INC.
To: LEMON INC.
Reel/Frame 068570/0148 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2024
From: HU, BO
To: TIKTOK INC.
Reel/Frame 068947/0415 →
Continuity (1)
Related Publication 20230127495A1 · Apr 27, 2023
References Cited (12)
US 20150113084A1 · Kimura et al. · 2015 [cited by applicant]
US 20180336715A1 · Rickwald · 2018 [cited by examiner]
US 20230023653A1 · Watanabe · 2023 [cited by applicant]
CN 111314204A · 2020 [cited by applicant]
JP 2014029666A · 2014 [cited by applicant]
JP 2021189674 · 2020 [cited by examiner]
WO 2021169431A1 · 2021 [cited by applicant]
WO 2021210585A1 · 2021 [cited by applicant]
Machine Translation JP2021-189674 (Year: 2020). [cited by examiner]
International Search Report mailed on Apr. 28, 2023 in International Application No. PCT/SG2022/050681. [cited by applicant]
Notice of Reasons for Refusal for Japanese Patent Application No. 2023575652, mailed Oct. 1, 2024, 8 pages. [cited by applicant]
Communication pursuant to Rules 70(2) and 70a(2) EPC for European Application No. 22884168.0, mailed Oct. 22, 2024, 1 page. [cited by applicant]