IP Library Granted Patent US 11,765,309
Granted Patent B2
US 11,765,309 · App. 16/990,267 · Granted Sep 19, 2023

Video capturing subject using IR light

Inventor: Felix Sauermann (Lawndale, CA)
Assignees: Sony Group Corporation; Sony Pictures Entertainment Inc.
H04N5/272G02B27/1006G02B27/1066H04N5/2621H04N5/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,765,309
App. No.
16/990,267
Granted
Sep 19, 2023
Kind
B2
Abstract

Video capture of a subject, including: capturing video data of the subject using a first camera; capturing infrared (IR) video data of the subject using a second camera linked to the first camera, in such a manner that the first and second camera share the same field of view, wherein the second camera is sensitive to IR light for capturing the IP video data of the subject; illuminating the subject with at least one IR light source; and processing the video data from the first camera and the IR video data from the second camera to identify an outline of the illuminated subject in the video data using the IR video data.

Claims (34)

1. A method for video capture of a subject from environment without a green screen using at least a main capture camera and an infrared (IR) sensitive camera, the method comprising:

determining a distance of focus from the main capture camera to the subject in real time;

linking the IR sensitive camera to the camera for a pixel to pixel match;

positioning at least one IR light source behind and around the subject in such a way that the back of the subject is illuminated;

illuminating the subject with the at least one IR light source to provide an outline of the subject;

defining the outline of and extracting the subject from the environment using the distance of focus and aided by the illumination of the subject with the at least one IR light source; and

enhancing the outline using contrast detection to detect areas with a highest amount of contrast as areas occupied by the subject.

2. The method of claim 1 , wherein the main capture camera includes at least one RGB color camera used for image capture.

3. The method of claim 1 , wherein the IR sensitive camera includes at least one IR sensor for capturing the IR video data of the subject.

4. The method of claim 1 , wherein the main capture camera is linked to the IR sensitive camera by means of a beam splitter.

5. The method of claim 4 , wherein the beam splitter enables the main capture camera and the IR sensitive camera to be aligned in such a way that every pixel on the main capture camera also has a counterpart on the IR sensitive camera.

6. The method of claim 1 , further comprising fitting walls and floors of the environment with IR absorbent material.

7. A system for video capture of a subject from environment without a green screen, the system comprising:

at least one camera, having a lens, for capturing video data of the subject in the environment, wherein the environment also includes walls and floors;

an encoder, connected to the lens of the at least one camera, for determining a focus distance from the at least one camera to the subject;

at least one IR sensor linked to the at least one camera, wherein the at least one IR sensor is sensitive to IR light for a pixel to pixel match and for capturing IR video data of the subject;

at least one IR light source positioned behind and around the subject in such a way that the back of the subject is illuminated to provide an outline of the subject; and

a video processor connected to the at least one camera and the at least one IR sensor, the video processor configured to process the video data from the at least one camera and the IR video data from the at least one sensor, to define the outline of and extract the subject in the video data from the environment using the IR video data, and to enhance the outline using contrast detection to detect areas with a highest amount of contrast as areas occupied by the subject.

8. The system of claim 7 , further comprising

a beam splitter to split light coming from the subject into two so that each of the at least one camera and the at least one IR sensor has an identical field of view.

9. The system of claim 8 , wherein the beam splitter is aligned in such a way that every pixel on the at least one camera has a counterpart on the at least one IR sensor.

10. The system of claim 7 , further comprising

IR absorbent material fitted into the walls and the floors.

11. The system of claim 7 , further comprising

a sub-processor to enhance and separate the subject from the environment using the focus distance.

12. A non-transitory computer-readable storage medium storing a computer program to capture video of a subject from environment without a green screen using at least a main capture camera and an infrared (IR) sensitive camera, the computer program comprising executable instructions that cause a computer to:

determine a distance of focus from the main capture camera to the subject in real time;

link the IR sensitive camera to the camera for a pixel to pixel match;

position at least one IR light source behind and around the subject in such a way that the back of the subject is illuminated;

illuminate the subject with the at least one IR light source to provide an outline of the subject;

define the outline of and extract the subject from the environment using the distance of focus and aided by the illumination of the subject with the at least one IR light source; and

enhance the outline using contrast detection: to detect areas with a highest amount of contrast as areas occupied by the subject.

13. The computer-readable storage medium of claim 12 , further comprising executable instructions that cause the computer to

command a beam splitter to split light coming from the subject into two so that each of the first camera and the second camera has an identical field of view.

Assignments (2)
CHANGE OF NAME Recorded Feb 10, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062700/0861 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2020
From: SAUERMANN, FELIX
To: SONY CORPORATION; SONY PICTURES ENTERTAINMENT INC.
Reel/Frame 054112/0418 →
Continuity (2)
Provisional Application 62947655 · Dec 13, 2019
Related Publication 20210185242A1 · Jun 17, 2021