IP Library Granted Patent US 11,232,595
Granted Patent B1
US 11,232,595 · App. 17/461,379 · Granted Jan 25, 2022

Three-dimensional assembly for motion capture calibration

Inventors: Dejan Momcilovic (Wellington, NZ); Jake Botting (Wellington, NZ)
Assignee: WETA DIGITAL LIMITED
G06T7/80G06T7/74H04N5/2253H04N5/247H04N17/002G06T2207/30208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,595
App. No.
17/461,379
Granted
Jan 25, 2022
Kind
B1
Abstract

Implementations facilitate the calibration of cameras in a live action scene. In some implementations, a system includes a base, where the base is configured to removably couple to a camera in the live action scene. The system further includes a plurality of extensions coupled to the base, where the plurality of extensions extends outwardly away from the base. The system further includes a plurality of reference points identifiable by a sensor, where the reference points are coupled to ends of corresponding extensions of the plurality of extensions, and where the plurality of extensions positions the plurality of reference points in a three-dimensional arrangement. Distances between pairs of reference points are based on one or more aspects of the extensions, and the distances between the pairs of reference points are used to compute reference point data generated from a performance capture system.

Claims (29)

1. An apparatus for calibrating cameras in a live action scene, the apparatus comprising:

a base, wherein the base is configured to removably couple to a camera in the live action scene;

a plurality of extensions coupled to the base, wherein the plurality of extensions extends outwardly away from the base; and

a plurality of reference points identifiable by a sensor, wherein the reference points are coupled to ends of corresponding extensions of the plurality of extensions, wherein the plurality of extensions positions the plurality of reference points in a three-dimensional arrangement, wherein distances between pairs of reference points are based on one or more aspects of the extensions, and wherein the distances between the pairs of reference points are used to compute reference point data generated from a performance capture system.

2. The apparatus of claim 1 , wherein the one or more aspects of the extensions comprises length.

3. The apparatus of claim 1 , wherein the distances between pairs of reference points are based on lengths of the extensions coupled to pairs of reference points.

4. The apparatus of claim 1 , wherein the distances between pairs of reference points are based on relative angles of the extensions coupled to pairs of reference points.

5. The apparatus of claim 1 , wherein the distances between pairs of reference points are changeable.

6. The apparatus of claim 1 , wherein one or more of the extensions are removably coupled to the base, wherein a distance between at least one pair of reference points is changeable based on replacing a first extension coupled to at least a first reference point of the at least one pair of reference points with a substitute extension, and wherein a length of the first extension is different from the substitute extension.

7. The apparatus of claim 1 , wherein the reference point data is used to compute a location and orientation of one or more cameras in the live action scene.

8. An system for calibrating cameras in a live action scene, the system comprising:

a base, wherein the base is configured to removably couple to a camera in the live action scene;

a plurality of extensions coupled to the base, wherein the plurality of extensions extends outwardly away from the base; and

a plurality of reference points identifiable by a sensor, wherein the reference points are coupled to ends of corresponding extensions of the plurality of extensions, wherein the plurality of extensions positions the plurality of reference points in a three-dimensional arrangement, wherein distances between pairs of reference points are based on one or more aspects of the extensions, and wherein the distances between the pairs of reference points are used to compute reference point data generated from a performance capture system.

9. The system of claim 8 , wherein the one or more aspects of the extensions comprise length.

10. The system of claim 8 , wherein the distances between pairs of reference points are based on lengths of the extensions coupled to pairs of reference points.

11. The system of claim 8 , wherein the distances between pairs of reference points are based on relative angles of the extensions coupled to pairs of reference points.

12. The system of claim 8 , wherein the distances between pairs of reference points are changeable.

13. The system of claim 8 , wherein one or more of the extensions are removably coupled to the base, wherein a distance between at least one pair of reference points is changeable based on replacing a first extension coupled to at least a first reference point of the at least one pair of reference points with a substitute extension, and wherein a length of the first extension is different from the substitute extension.

14. The system of claim 8 , wherein the reference point data is used to compute a location and orientation of one or more cameras in the live action scene.

15. A computer-implemented method for calibrating cameras in a live action scene, the method comprising:

receiving images of the live action scene from a plurality of cameras;

receiving reference point data generated from a performance capture system, wherein the reference point data is based on a plurality of reference points identifiable by a sensor, wherein the plurality of reference points are coupled to a plurality of extensions coupled to a base, wherein the base is configured to removably couple to a camera in the live action scene, wherein the plurality of extensions extends outwardly away from the base, wherein the reference points are coupled to ends of corresponding extensions of the plurality of extensions, wherein the plurality of extensions positions the plurality of reference points in a three-dimensional arrangement, and wherein distances between pairs of reference points are based on one or more aspects of the extensions; and

computing a location and orientation of one or more cameras in the live action scene based on the reference point data.

16. The method of claim 15 , wherein the one or more aspects of the extensions comprise length.

17. The method of claim 15 , wherein the distances between pairs of reference points are based on lengths of the extensions coupled to pairs of reference points.

18. The method of claim 15 , wherein the distances between pairs of reference points are based on relative angles of the extensions coupled to pairs of reference points.

19. The method of claim 15 , wherein the distances between pairs of reference points are changeable.

20. The method of claim 15 , wherein one or more of the extensions are removably coupled to the base, wherein a distance between at least one pair of reference points is changeable based on replacing a first extension coupled to at least a first reference point of the at least one pair of reference points with a substitute extension, and wherein a length of the first extension is different from the substitute extension.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: UNITY SOFTWARE INC.
To: UNITY TECHNOLOGIES SF
Reel/Frame 058980/0369 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: WETA DIGITAL LIMITED
To: UNITY SOFTWARE INC.
Reel/Frame 058978/0905 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2021
From: MOMCILOVIC, DEJAN; BOTTING, JAKE
To: WETA DIGITAL LIMITED
Reel/Frame 057919/0978 →
Continuity (2)
Provisional Application 63075769 · Sep 8, 2020
Provisional Application 63237510 · Aug 26, 2021
Cited By (1)
US 12,647,545