IP Library › Granted Patent US 9,406,162
Granted Patent B2
US 9,406,162 · App. 13/900,023 · Granted Aug 2, 2016

System and method of generating a video of an avatar

Inventors: Simon Lucey (Campbell ACT, AU); Gautam Tendulkar (Campbell ACT, AU)
Assignee: COMMONWEALTH SCIENTIFIC AND INDUSTRIAL RESEARCH ORGANISATION
G06T13/40G06T13/20G06T13/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,406,162
App. No.
13/900,023
Granted
Aug 2, 2016
Kind
B2
Abstract

A method of generating an image enables animating an avatar on a device with limited processing capabilities. The method includes receiving, on a first computing device, a first image; sending, on a data interface of the first computing device, the first image to a server; receiving, on the data interface and from the server, shape data corresponding to an aspect of the first image; and generating, by a processor of the first computing device, a primary output image based at least upon the shape data and avatar data.

Claims (56)

1. A method of generating an image comprising:

receiving, on a first computing device, a first image;

sending, on a data interface of the first computing device, the first image to a server;

receiving, on the data interface and from the server, shape data corresponding to an aspect of the first image;

generating, by a processor of the first computing device, a primary output image based at least upon the shape data and selected avatar data corresponding to a selected one of a plurality of avatars, the selected avatar data on both the first computing device and the server;

storing a plurality of unique identifiers each being uniquely associated with the plurality of avatars available for use on the first computing device;

subsequent to the generating of the primary output image on the first computing device:

further receiving, on the data interface of the first computing device, a selected one of the plurality of unique identifiers associated with the selected avatar data;

sending, on the data interface of the first computing device, only the unique identifier associated with the selected one of the plurality of avatars to the server;

generating, by the server, a server output image based upon server avatar data associated with the unique identifier and the shape data, and

further using the server to transmit only the server output image to a second computing device.

2. The method according to claim 1 , wherein the shape data comprises a 3D model of a user's face as depicted in the image, and wherein generating the primary output image comprises applying the 3D model to the selected avatar data.

3. The method according to claim 1 , wherein the shape data comprises Active Appearance Model (AAM) parameters, and wherein generating the primary output image comprises applying the AAM parameters to the selected avatar data.

4. The method according to claim 1 , wherein generating the primary output image further comprises applying a mapping function to the shape data according to the selected avatar data.

5. The method according to claim 1 , wherein the server output image is identical to the primary output image.

6. The method according to claim 1 , wherein generating the server output image by the server is conducted according to a different algorithm than an algorithm used by the first computing device to generate the primary output image.

7. The method according to claim 1 , further comprising:

sending, on the data interface of the first computing device, a request to the server to send the server output image to a user of second computing device, wherein the request includes contact details of the user; and

sending, from the server and to the user of the second computing device, using the contact details of the user, the server output image.

8. The method according to claim 1 , further comprising:

sending, on the data interface, a request to the server to share primary output image with a user of the second computing device, wherein the request includes contact details of the user and the selected avatar; and

sending, from the server and to the user of the second computing device, using the contact details of the user, the shape parameters and the selected avatar, for generation of the primary output image by the second computing device.

9. The method according to claim 8 , wherein sending the selected avatar comprises sending an identifier associated with the selected avatar.

10. The method according to claim 1 , wherein generating the primary output image comprises modifying the first image.

11. The method according to claim 1 , further comprising:

sending, on the data interface of the first computing device, a request to the server to upload the server output image to a social media site or a video sharing site, wherein the request includes details of the social media site or the video sharing site, and a selected avatar; and

sending, from the server and to the social media site or the video sharing site, using the details of the social media site or the video sharing site, the server output image.

12. The method according to claim 1 , wherein the first image comprises an image of a video sequence.

13. The method according to claim 1 , further comprising:

receiving, on the data interface of the first computing device, a second image, wherein the first image and the second image comprise images of a video sequence;

sending, on the data interface of the first computing device, the second image to a server;

receiving, on the data interface of the first computing device, further shape data corresponding to an aspect of the second image; and

generating, by the processor of the first computing device, a second primary output image based at least upon the further shape data and the avatar data.

14. The method according to claim 13 , wherein sending the first image to the server is conducted prior to receiving the second image.

15. The method according to claim 1 , further comprising uploading the server output image with the server to a social media site.

16. A system for generating an image, comprising:

a first computing device including:

a data interface;

a processor coupled to the data interface; and

a memory coupled to the processor including instructions executable by the processor for:

receiving a first image;

sending, on the data interface, the first image to a server;

receiving, on the data interface, shape data corresponding to an aspect of the first image;

generating an output image based at least upon the shape data and selected avatar data, corresponding to a selected one of a plurality of avatars, the selected avatar data on both the first computing device and the server;

storing a plurality of unique identifiers each being uniquely associated with the plurality of avatars available for use on the first computing device;

subsequent to the generating of the output image on the first computing device:

receiving, on the data interface of the first computing device, a selected one of the plurality of unique identifiers associated with the selected avatar data; and

sending, on the data interface, only the unique identifier associated with the selected one of the plurality of avatars to the server; and

the server including:

a server data interface;

a server processor coupled to the server data interface; and

a server memory coupled to the server processor including instructions executable by the server processor for:

receiving the first image;

receiving the unique identifier; and

generating a server output image based upon server avatar data associated with the unique identifier, and the shape data, and

transmitting only the server output image to a second computing device for use.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2015
From: TENDULKAR, GAUTAM; LUCEY, SIMON
To: COMMONWEALTH SCIENTIFIC AND INDUSTRIAL RESEARCH ORGANISATION
Reel/Frame 037372/0568 →
Priority Claims (1)
AU 2012902108 · May 22, 2012 · national
Continuity (1)
Related Publication 20130314405A1 · Nov 28, 2013