IP Library › Granted Patent US 11,024,072
Granted Patent B2
US 11,024,072 · App. 17/141,197 · Granted Jun 1, 2021

Apparatus and method for performing motion capture using a random pattern on capture surfaces

Inventors: Timothy Cotter (Sunnyvale, CA); Stephen G. Perlman (Palo Alto, CA); John Speck (Brainbridge Island, WA); Roger van der Laan (Redwood City, CA); Kenneth A. Pearce (San Francisco, CA); Greg LaSalle (Culver City, CA)
Assignee: Rearden Mova, LLC
G06T13/40G06K9/3216G06T7/20G06T7/246G06T7/292H04N5/2224H04N5/2256H04N5/2353H04N5/2354H04N5/247H04N13/239H04N13/243G06K2009/3225G06T2207/10016G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,024,072
App. No.
17/141,197
Granted
Jun 1, 2021
Kind
B2
Abstract

A method is described comprising: applying a random pattern to specified regions of an object; tracking the movement of the random pattern during a motion capture session; and generating motion data representing the movement of the object using the tracked movement of the random pattern.

Claims (49)

1. A system comprising:

a machine-readable medium having data stored thereon representing a rendered animated three-dimensional (3D) face;

the data including a rendering of a first plurality of 3D points on at least part of the rendered animated 3D face at a first plurality of time intervals correlated to a high resolution second plurality of 3D points on at least part of a surface of a performer's face at a second plurality of time intervals;

wherein the second plurality of 3D points on the surface of the performer's face were not identified by markers applied to the performer's face; and

wherein a processor automatically tracked the second plurality of 3D points.

2. The system of claim 1 wherein the first plurality of 3D points automatically tracked the second plurality of 3D points within regions of the performer's face that fold or deform.

3. The system of claim 1 wherein the second plurality of 3D points include some or all parts of eyes, lips, or teeth of the performer.

4. The system of claim 1 wherein the second plurality of 3D points at one or more time intervals corresponds to a facial expression.

5. The system of claim 1 wherein at least some of the time intervals are successive frame times.

6. The system of claim 1 wherein at least some of the time intervals are not successive frame times.

7. The system of claim 1 wherein the first plurality of 3D points represent at least part of a character's face different from the performer's face.

8. The system of claim 1 wherein the surface of the performer's face was captured by a plurality of cameras.

9. A method comprising:

communicating data representing a rendered animated three-dimensional (3D) face;

the data including a rendering of a first plurality of 3D points on at least part of the rendered animated 3D face at a first plurality of time intervals correlated to a high resolution second plurality of 3D points on at least part of a surface of a performer's face at a second plurality of time intervals;

wherein the second plurality of 3D points on the surface of the performer's face were not identified by markers applied to the performer's face; and

wherein a processor automatically tracked the second plurality of 3D points.

10. The method of claim 9 further comprising:

the first plurality of 3D points automatically tracked the second plurality of 3D points within regions of the performer's face that fold or deform.

11. The method of claim 9 further comprising:

the second plurality of 3D points include some or all parts of eyes, lips, or teeth of the performer.

12. The method of claim 9 wherein the second plurality of 3D points at one or more time intervals corresponds to a facial expression.

13. The method of claim 9 wherein at least some of the time intervals are successive frame times.

14. The method of claim 9 wherein at least some of the time intervals are not successive frame times.

15. The method of claim 9 further comprising:

the first plurality of 3D points representing at least part of a character's face different from the performer's face.

16. A system comprising:

a machine-readable medium having data stored thereon representing a rendered animated three-dimensional (3D) face;

the data including a rendering of a first plurality of 3D points on at least part of the rendered animated 3D face at a first plurality of time intervals correlated to a second plurality of 3D points on at least part of a surface of a performer's face at a second plurality of time intervals;

wherein the first plurality of 3D points automatically tracked the second plurality of 3D points within regions of the performer's face that fold or deform.

17. The system of claim 16 wherein the second plurality of 3D points on the surface of the performer's face were not identified by markers applied to the performer's face.

18. The system of claim 16 wherein the second plurality of 3D points include some or all parts of eyes, lips, or teeth of the performer.

19. The system of claim 16 wherein the second plurality of 3D points at one or more time intervals corresponds to a facial expression.

20. The system of claim 16 wherein at least some of the time intervals are successive frame times.

21. The system of claim 16 wherein at least some of the time intervals are not successive frame times.

22. The system of claim 16 wherein the first plurality of 3D points represent at least part of a character's face different from the performer's face.

23. The system of claim 16 wherein the surface of the performer's face was captured by a plurality of cameras.

24. A method comprising:

communicating data representing a rendered animated three-dimensional (3D) face;

the data including a rendering of a first plurality of 3D points on at least part of the rendered animated 3D face at a first plurality of time intervals correlated to a second plurality of 3D points on at least part of a surface of a performer's face at a second plurality of time intervals;

wherein the first plurality of 3D points automatically tracked the second plurality of 3D points within regions of the performer's face that fold or deform.

25. The method of claim 24 wherein the second plurality of 3D points on the surface of the performer's face were not identified by markers applied to the performer's face.

26. The method of claim 24 further comprising:

the second plurality of 3D points include some or all parts of eyes, lips, or teeth of the performer.

27. The method of claim 24 wherein the second plurality of 3D points at one or more time intervals corresponds to a facial expression.

28. The method of claim 24 further wherein at least some of the time intervals are not successive frame times.

29. The method of claim 24 wherein at least some of the time intervals are not successive frame times.

30. The method of claim 24 further comprising:

the first plurality of 3D points representing at least part of a character's face different from the performer's face.

Continuity (8)
Continuation 17087503 · Nov 2, 2020
Continuation 16792116 · Feb 14, 2020
Continuation 15713601 · Sep 22, 2017
Continuation 14754651 · Jun 29, 2015
Division 14187759 · Feb 24, 2014
Division 11255854 · Oct 20, 2005
Provisional Application 60724565 · Oct 7, 2005
Related Publication 20210125390A1 · Apr 29, 2021