IP Library Granted Patent US 10,880,521
Granted Patent B2
US 10,880,521 · App. 16/547,358 · Granted Dec 29, 2020

System, method, and computer program for transmitting face models based on face data points

Inventors: William Guie Rivard (Menlo Park, CA); Brian J. Kindle (Sunnyvale, CA); Adam Barry Feder (Mountain View, CA)
Assignee: DUELIGHT LLC
H04N7/157G06T13/40G06T19/00G10L21/10H04L12/1827H04L51/04H04L51/046H04L65/403H04L65/80H04N7/147G06T2219/024G10L25/63G10L2021/105H04L51/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,880,521
App. No.
16/547,358
Granted
Dec 29, 2020
Kind
B2
Abstract

A system, method, and computer program are provided for receiving face models based on face data points. In use, a real-time face model is received, wherein the real-time face model includes one or more face data points. Real-time face data points are received, including additional one or more face data points. The real-time face model is manipulated based on the real-time face data points.

Claims (29)

1. A device, comprising:

a non-transitory memory storing instructions; and

one or more processors in communication with the non-transitory memory, wherein the one or more processors execute the instructions to:

receive a real-time face model, wherein the real-time face model includes one or more face data points and a plurality of face parameters, wherein the plurality of face parameters is correlated and occurs synchronously;

receive real-time face data points, including additional one or more face data points;

manipulate the real-time face model based on the real-time face data points.

2. The device of claim 1 , wherein face model includes a structure of a face, the structure including a geometric mesh or collection of geometric objects.

3. The device of claim 1 , wherein the one or more processors further execute the instructions to provide a real-time stream of at least one face associated with the real-time face model, the real-time stream being a video chat.

4. The device of claim 1 , wherein the one or more processors further execute the instructions to map the real-time face model to control levers on an animation rigging.

5. The device of claim 1 , wherein the manipulation includes modifying visual parameters associated with a face.

6. The device of claim 1 , wherein the real-time face model includes at least two of facial contours, minute data points, or main data points.

7. The device of claim 1 , wherein the plurality of face parameters are animation parameters associated with a particular movement and feature of at least one face.

8. The device of claim 7 , wherein the animation parameters include at least two of a movement of eyes, a movement of a nose, a movement of a jaw, a movement of a face bone structure, a movement of eyebrows, or a movement of lips.

9. The device of claim 1 , wherein the real-time face model includes audio data.

10. The device of claim 9 , wherein the device is operable such that the audio data is used to create an inference of how the manipulation is performed.

11. The device of claim 1 , wherein the real-time face model includes an image depth map, an audio map, and a correlation map.

12. The device of claim 11 , wherein the correlation map matches up audio associated with one or more of phonetics, intonations, or emotions, with the one or more face data points.

13. The device of claim 1 , wherein the device is operable such that receiving the real-time face model requires less data usage than receiving real time video frames.

14. The device of claim 1 , wherein the device is operable such that the real-time face model is further refined using historical data or additional data associated with at least one face.

15. The device of claim 1 , wherein the device is operable such that the real-time face model is automatically received based on a network latency threshold or a dropped packet threshold condition in place of additional video frames.

16. The device of claim 1 , wherein the device is further operable to receive a second real-time face model associated with a third party individual or character, receive second real-time face data points, and manipulate the second real-time face model based on the second real-time face data points.

17. A method, comprising:

receiving, using a processor, a real-time face model, wherein the real-time face model includes one or more face data points and a plurality of face parameters, wherein the plurality of face parameters is correlated and occurs synchronously;

receiving, using the processor, real-time face data points, including additional one or more face data points;

manipulating, using the processor, the real-time face model based on the real-time face data points.

18. A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:

receive a real-time face model, wherein the real-time face model includes one or more face data points and a plurality of face parameters, wherein the plurality of face parameters is correlated and occurs synchronously;

receive real-time face data points, including additional one or more face data points;

manipulate the real-time face model based on the real-time face data points.

Assignments (2)
SECURITY INTEREST Recorded Jul 30, 2021
From: DUELIGHT, LLC
To: ZILKA KOTAB, P.C.
Reel/Frame 057043/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: RIVARD, WILLIAM GUIE; KINDLE, BRIAN J.; FEDER, ADAM BARRY
To: DUELIGHT LLC
Reel/Frame 050269/0379 →
Cited By (5)
US 12,401,911 US 12,401,912 US 12,418,727 US 12,445,736 US 12,666,159