IP Library Granted Patent US 11,727,597
Granted Patent B2
US 11,727,597 · App. 16/714,453 · Granted Aug 15, 2023

Calibrating volumetric rig with structured light

Inventor: Scot Barbour (Culver City, CA)
Assignees: Sony Group Corporation; Sony Pictures Entertainment Inc.
G06T7/80G06T7/70H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,597
App. No.
16/714,453
Granted
Aug 15, 2023
Kind
B2
Abstract

Calibrating cameras in a rig, including: projecting light patterns onto surfaces of objects in a capture volume; capturing image data of the light patterns projected onto the surfaces of the objects using the cameras; and processing the captured image data to estimate a calibration data of the cameras, wherein processing the image data to estimate the calibration data includes measuring distortions in the light patterns.

Claims (30)

1. A method for calibrating cameras in a rig, the method comprising:

projecting light patterns onto surfaces of objects in a capture volume;

capturing image data of the light patterns projected onto the surfaces of the objects using the cameras; and

processing the captured image data to estimate a calibration data of the cameras; and

measuring distortions in the light patterns using the estimated calibration data of the cameras as camera angles relative to changes on the surfaces of the objects,

wherein the measured distortions in the light patterns of the captured image data identifies source information about which camera of the cameras is providing the image data.

2. The method of claim 1 , wherein projecting the light patterns comprises:

projecting the light patterns during primary capture segments to capture video image data; and

projecting the light patterns during secondary capture segments to estimate the calibration data of the cameras.

3. The method of claim 1 , wherein the calibration data includes changes in camera position based on the distortions in the captured image data of the light pattern.

4. The method of claim 1 , wherein the light patterns comprise checkerboard patterns.

5. The method of claim 1 , further comprising

identifying source cameras using the captured image data.

6. The method of claim 1 , wherein the light patterns projected onto the surfaces of the objects are non-visible light patterns.

7. An image capture system, comprising:

a plurality of light sources configured to project light patterns onto surfaces of objects in a capture volume;

a plurality of sensors configured to capture image data of the light patterns projected onto the surfaces of the objects by the plurality of light sources; and

a processor configured to process the image data captured by the plurality of sensors to estimate a calibration data for the plurality of sensors, and to measure distortions in the light patterns using the estimated calibration data of the sensors as angles of the plurality of sensors relative to changes on the surfaces of the objects,

wherein the measured distortions in the light patterns of the image data identifies source information about which sensor of the plurality of image sensors is providing the image data.

8. The system of claim 7 , wherein the calibration data includes changes in sensor position based on the distortions in the captured image data of the light pattern.

9. The system of claim 7 , wherein the light patterns comprise checkerboard patterns.

10. The system of claim 7 , wherein the light patterns projected onto the surfaces of the objects are non-visible light patterns.

11. The system of claim 7 , wherein the source information and the image data are used to determine parameters of the plurality of sensors.

12. The system of claim 11 , wherein the parameters comprise positions, orientations, and image settings of the plurality of sensors.

13. The system of claim 11 , wherein the calibration data for the plurality of sensors is estimated from the parameters.

14. The system of claim 11 , wherein the parameters comprise

at least one of sensor types, sensor configurations, and lens information.

15. The system of claim 7 , wherein the plurality of sensors comprises a plurality of cameras.

16. The system of claim 7 , wherein the plurality of sensors comprises a plurality of audio sensors.

17. The system of claim 7 , wherein the plurality of sensors comprises a plurality of thermal sensors.

Assignments (2)
CHANGE OF NAME Recorded Apr 21, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 063411/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: BARBOUR, SCOT
To: SONY CORPORATION; SONY PICTURES ENTERTAINMENT INC.
Reel/Frame 053143/0015 →
Continuity (2)
Provisional Application 62784249 · Dec 21, 2018
Related Publication 20200202571A1 · Jun 25, 2020