IP Library Granted Patent US 9,639,974
Granted Patent B2
US 9,639,974 · App. 14/719,174 · Granted May 2, 2017

Image transformation systems and methods

Inventors: Linda Smith (Woodland Hills, CA); Clayton Nicholas Graff (Studio City, CA); John Szeder (Davis, CA)
Assignee: Facecake Technologies, Inc.
G06T15/205G06T7/0042G06T7/0051G06T13/20G06T13/40G06T13/80G06T15/04G06T2207/10004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,639,974
App. No.
14/719,174
Granted
May 2, 2017
Kind
B2
Abstract

Systems, methods, apparatuses, and computer readable medium are provided that cause a two dimensional image to appear three dimensional and also create a dynamic or animated illustrated images. The systems, methods, apparatuses and computer readable mediums implement displacement maps in a number of novel ways in conjunction with among other software, facial feature recognition software to recognize the areas of the face and allow the users to then customize those areas that are recognized. Furthermore, the created displacement maps are used to create all of the dynamic effects of an image in motion.

Claims (40)

1. A non-volatile non-transitory computer readable storage medium containing instructions which when executed by a computing device transforms a two dimensional static image into a sequence of images that provide a three dimensional animated motion effect for the two dimensional static image by a method comprising the steps of:

locating facial or head features on the two-dimensional image;

generating a characterization of the located facial or head features on the two dimensional image using feature recognition software;

generating an identification of elements other than facial or head features on the two dimensional image to be animated;

generating displacement maps based on the characterization of the located facial or head features and the elements other than facial or head features to be animated, wherein the displacement maps are overlaid over the located facial or head features or the elements other than facial or head features to provide a coded motion system for creating one or more motion effects on the one or more facial or head features or on the elements other than facial or head features to be animated; and

animating the one or more facial or head features or the elements other than facial or head features to be animated in the two dimensional image by creating one or more motion effects on the one or more facial or head features or the elements other than facial or head features to be animated based on the coded motion system provided by the displacement maps.

2. The computer readable medium of claim 1 , wherein locating the facial features on the two dimensional image is performed manually.

3. The computer readable medium of claim 1 , wherein locating the facial features on the two dimensional image is done using object recognition software.

4. The computer readable medium of claim 3 , wherein after locating the facial features on the two dimensional images, a user is enabled to further adjust the location.

5. The computer readable medium of claim 1 , wherein the two dimensional image is a digital photographic image.

6. The computer readable medium of claim 1 , wherein the two dimensional image is a scanned photographic image.

7. The computer readable medium of claim 1 , further comprising generating a background for the two-dimensional image.

8. An imaging display device which transforms a two-dimensional static image into a three-dimensional animated image comprising:

at least one client device including a processing unit, a memory, and a bus capable of uploading or retrieving at least one two-dimensional photographic image;

computer executable object recognition software for locating facial features on the at least one two-dimensional photographic image;

computer executable facial feature recognition software for detecting shapes of the facial features on the at least one two-dimensional photographic image;

a computer executable software module for creating displacement maps based on the characterization of the facial features, wherein the displacement maps are overlaid over the located facial features to provide a coded motion system for creating one or more motion effects on one or more facial features; and

a computer executable software module for causing one or more facial features of the at least one two-dimensional image to animate based on the created displacement maps.

9. The imaging display device of claim 8 , further comprising:

object recognition software for locating elements other than facial features on the at least one two-dimensional photographic image;

feature recognition software for detecting the shape of the elements other than facial features on the at least one two-dimensional photographic image;

a software module for creating displacement maps based on the characterization of the elements other than facial features; and

a software module for causing the elements other than facial features of the at least one two-dimensional image to animate based on the displacement maps.

10. The imaging display device of claim 8 , wherein the at least one client device communicates over a network to an image management service, wherein the image management service comprises:

the object recognition software;

the facial feature recognition software;

the software module for creating displacement maps; and

the software module for causing one or more portions of the at least one two-dimensional image to animate based on the displacement maps.

11. The image display device of claim 8 , further comprising an input device arranged to receive input from a user to refine the location and shape of the facial features on the at least one two dimensional photographic image.

12. An image processing system, said system comprising one or more processors;

and a non-volatile computer-readable storage medium carrying one or more sequences of instructions, for transforming a two-dimensional static image that includes at least one located facial feature to be animated into a sequence of images that provide a three dimensional animated motion effect for the two dimensional static image, said system further comprising:

facial recognition software encoded as a first sequence of instructions of the one or more sequences of instructions, which when executed by said one or more processors characterizes the at least one located facial feature on the two dimensional static image;

displacement maps generated by said one or more processors executing a second sequence of instructions of the one or more sequences of instructions, the displacement maps generated based on the characterization of the at least one located facial feature;

at least one coded motion system based on the displacement maps, wherein the displacement maps are overlaid over the at least one located facial feature or the elements other than the at least one facial feature; and

an animation module encoded as a third sequence of instructions of the one or more sequences of instructions, which when executed by said one or more processors causes the at least one located facial feature in the two-dimensional static image to animate based on the at least one color coded motion system.

13. The image processing system of claim 12 , further comprising:

at least one element other than facial features to be animated in the two-dimensional static image;

movement recognition software encoded as a fourth sequence of instructions of the one or more sequences of instructions, which when executed by said one or more processors characterizes the at least one element other than facial features; and

displacement maps generated based on the characterization of the at least one element other than facial features; and

an animation module encoded as a fifth sequence of instructions of the one or more sequences of instructions, which when executed by said one or more processors causes the at least one element other than facial features in the two-dimensional static image to animate.

Assignments (2)
COURT ORDER Recorded Jan 30, 2026
From: FACECAKE MARKETING TECHNOLOGIES, INC.
To: SOCCOL IP LLC
Reel/Frame 074607/0785 →
AMENDED JUDGMENT Recorded Nov 12, 2024
From: FACECAKE MARKETING TECHNOLOGIES INC.
To: HAGEN, RONALD
Reel/Frame 069340/0304 →
Continuity (3)
Continuation 12714518 · Feb 28, 2010
Provisional Application 61156537 · Mar 1, 2009
Related Publication 20150254892A1 · Sep 10, 2015