IP Library Granted Patent US 9,936,165
Granted Patent B2
US 9,936,165 · App. 13/977,278 · Granted Apr 3, 2018

System and method for avatar creation and synchronization

Inventors: Wenlong Li (Beijing, CN); Xiaofeng Tong (Beijing, CN); Yangzhou Du (Beijing, CN); Wei Hu (Beijing, CN); Yimin Zhang (Beijing, CN)
Assignee: INTEL CORPORATION
H04N7/157G06K9/00302H04L12/1827H04N7/147H04N7/155
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,936,165
App. No.
13/977,278
Granted
Apr 3, 2018
Kind
B2
Abstract

A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.

Claims (89)

1. A system for avatar synchronization between a first user device and a remote user device, the system comprising:

the first user device comprising:

a communication module configured to transmit information to and receive information from the remote user device;

one or more non-transitory storage mediums having stored thereon, individually or in combination, instructions that when executed by one or more processors result in the following operations comprising:

initiating communication between the first user device and the remote user device;

receiving selection of a new avatar to represent a user of the first user device;

identifying a new avatar file for the new avatar in an avatar database associated with the first user device;

determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and

transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database;

wherein on receipt of the new avatar file, the remote user device uses the new avatar file to display the new avatar to represent the user of the first user device, during active communication between the first and the remote user devices.

2. The system of claim 1 , wherein the remote user device comprises one or more storage mediums having stored thereon, individually or in combination, instructions that when executed by one or more processors result in the following operations comprising:

beginning to receive the new avatar file associated with the first user device;

prior to completing receipt of the new avatar file, selecting a default avatar to represent the user of the first user device; and

when receipt of the new avatar file is completed, selecting the new avatar to represent the user of the first user device.

3. The system of claim 1 , wherein the instructions when executed by one or more processors of the first user device result in the following additional operations:

initiating communication with a server;

providing the server with a list of avatars present in the avatar database associated with the first user device; and

requesting the server to broadcast the list of avatars to at least the remote user device.

4. The system of claim 3 , wherein the remote user device comprises one or more storage mediums having stored thereon, individually or in combination, instructions that when executed by one or more processors of the remote user device result in the following operations comprising:

receiving the list of avatars;

comparing the list of avatars to a local list of avatars in the remote avatar database associated with the remote user device;

if the local list of avatars does not contain a corresponding avatar for at least one avatar in the list of avatars, determining whether offline synchronization is desired;

if offline synchronization is desired, transmitting a request for a corresponding avatar file for the corresponding avatar.

5. The system of claim 4 , wherein the instructions when executed by one or more processors of the remote user device further result in the following additional operations:

if offline synchronization is not desired, awaiting initiation of a communication session with the first user device to synchronize the corresponding avatar.

6. The system of claim 1 , wherein the first user device further comprises a camera configured to capture images, wherein the instructions when executed by one or more processors of the first user device result in the following additional operations:

capturing an image;

detecting a face in the image;

extracting features from the face;

converting the features into avatar parameters for the new avatar; and

transmitting at least one of the avatar parameters to the remote user device.

7. The system of claim 6 , wherein extracting features from the face comprises determining a facial expression in the face.

8. The system of claim 6 , wherein the avatar selection and avatar parameters are used to generate the new avatar on the remote user device, the new avatar being based on the facial features.

9. The system of claim 6 , wherein the avatar selection and avatar parameters are used to generate the new avatar in a virtual space, the new avatar being based on the facial features.

10. The system of claim 1 , wherein the instructions when executed by one or more processors of the first user device result in the following additional operations:

calculating key points of an image to be used as a basis for the new avatar; and

generating the new avatar using the key points.

11. The system of claim 1 , wherein the instructions when executed by one or more processors of the first user device result in the following additional operations:

calculating key points of an image to be used as a basis for the new avatar; and

requesting a server to generate the new avatar using the key points.

12. One or more non-transitory storage mediums having stored thereon, individually or in combination, instructions that when executed by one or more processors result in the following operations comprising:

initiating, by a first user device, communication between the first user device and a remote user device;

receiving, by the first user device, selection of a new avatar to represent a user of the first user device;

identifying, by the first user device, a new avatar file for the new avatar in an avatar database associated with the first user device;

determining, by the first user device, that the new avatar the is not present in a remote avatar database associated with the remote user device; and

transmitting, by the first user device, the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database;

wherein on receipt of the new avatar file, the remote user device uses the new avatar file to display the new avatar to represent the user of the first user device, during active communication between the first and the remote user devices.

13. The one or more storage mediums of claim 12 , wherein the instructions further result in the following operations comprising:

beginning to receive, by the remote user device, the new avatar file;

prior to completing receipt of the new avatar file, selecting, by the remote user device, a default avatar to represent the user of the first user device; and

when receipt of the new avatar file is completed, selecting, by the remote user device, the new avatar to represent the user of the first user device.

14. The one or more storage mediums of claim 12 , wherein the instructions further result in the following operations comprising:

initiating, by the first user device, communication with a server;

providing, by the first user device, the server with a list of avatars present in the avatar database associated with the first user device; and

requesting, by the first user device, the server to broadcast the list of avatars to at least the remote user device.

15. The one or more storage mediums of claim 14 , wherein the instructions further result in the following operations comprising:

receiving, by the remote user device, the list of avatars;

comparing, by the remote user device, the list of avatars to a local list of avatars in the remote avatar database associated with the remote user device;

if the local list of avatars does not contain a corresponding avatar for at least one avatar in the list of avatars, determining, by the remote user device, whether offline synchronization is desired;

if offline synchronization is desired, transmitting, by the remote user device, a request for a corresponding avatar file for the corresponding avatar.

16. The one or more storage mediums of claim 15 , wherein the instructions further result in the following operations comprising:

if offline synchronization is not desired, awaiting, by the remote user device, initiation of a communication session with the first user device to synchronize the corresponding avatar.

17. The one or more storage mediums of claim 12 , wherein the first user device further comprises a camera configured to capture images.

18. The one or more storage mediums of claim 17 , wherein the instructions further result in the following operations comprising:

capturing, by the camera, an image;

detecting, by the first user device, a face in the image;

extracting, by the first user device, features from the face;

converting, by the first user device, the features into avatar parameters; and

transmitting, by the first user device, at least one of the avatar parameters to the remote user device.

19. The one or more storage mediums of claim 18 , wherein extracting features from the face comprises determining a facial expression in the face.

20. The one or more storage mediums of claim 18 , wherein the avatar selection and avatar parameters are used to generate an avatar on the remote user device, the avatar being based on the facial features.

21. The one or more storage mediums of claim 18 , wherein the avatar selection and avatar parameters are used to generate an avatar in a virtual space, the avatar being based on the facial features.

22. The one or more storage mediums of claim 12 , further comprising:

calculating, by the first user device, key points of an image to be used as a basis for the new avatar; and

generating, by the first user device, the new avatar using the key points.

23. The one or more storage mediums of claim 12 , further comprising:

calculating, by the first user device, key points of an image to be used as a basis for the new avatar; and

requesting, by the first user device, a server to generate the new avatar using the key points.

24. An apparatus for avatar synchronization between a first user device and a remote user device, the apparatus comprising:

one or more processors; and

one or more non-transitory storage mediums having stored thereon, individually or in combination, instructions that when executed by the one or more processors result in the operations comprising:

initiating, by the first user device, communication between the first user device and the remote user device;

receiving, by the first user device, selection of a new avatar to represent a user of the first user device;

identifying, by the first user device, a new avatar file for the new avatar in an avatar database associated with the first user device;

determining, by the first user device, that the new avatar the is not present in a remote avatar database associated with the remote user device; and

transmitting, by the first user device, the new avatar file to the remote avatar database in res once to determining that the new avatar file is not resent in the remote avatar database;

wherein on receipt of the new avatar file, the remote user device uses the new avatar file to display the new avatar to represent the user of the first user device, during active communication between the first and the remote user devices.

25. The apparatus of claim 24 , wherein the operations further comprise:

receiving, by the first user device, a remote avatar file from the remote user device, and receiving, by the first user device, a selection of one of a default avatar and a new remote avatar to represent a user of the remote user device at the first user device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: INTEL CORPORATION
To: TAHOE RESEARCH, LTD.
Reel/Frame 061175/0176 →
Continuity (1)
Related Publication 20160006987A1 · Jan 7, 2016