IP Library Granted Patent US 11,849,244
Granted Patent B2
US 11,849,244 · App. 17/813,230 · Granted Dec 19, 2023

System and method for temporal keying in a camera

Inventors: Klaas Jan Damstra (Breda, NL); Marcel Koutstaal (Breda, NL)
Assignee: GRASS VALLEY CANADA
H04N5/275H04N7/0127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,849,244
App. No.
17/813,230
Granted
Dec 19, 2023
Kind
B2
Abstract

A system is provided for capturing a key signal within video frames that includes a camera that captures a sequence of media content of a live scene that includes an electronic display having a higher frame rate than an output frame rate of the camera, and a key signal processor that convert all frames in the sequence of media content to the output frame rate of the camera, analyzes a sequence of frames to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and combine remaining frames of the sequence of frames to create a live output signal. Moreover, the key signal processor determines, for each pixel in the frames, whether the pixel has a set chromaticity, and generates a key mask for each pixel in each frame.

Claims (39)

1. A system for capturing a key signal within video frames, the system comprising:

a camera configured to capture a sequence of media content of a live scene that includes an electronic display having a higher frame rate than an output frame rate of the camera; and

a key signal processor configured to:

convert all frames in the sequence of media content to the output frame rate of the camera,

analyze a sequence of frames of the captured media content to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and

combine remaining frames of the sequence of frames to create a live output signal, wherein the remaining frames do not include the at least one key frame from the sequence of frames,

wherein the key signal processor includes a pixel color detector configured to determine, for each pixel in each frame in the sequence of frames, whether the pixel has a set chromaticity, and to generate a key mask for each pixel in each frame, with the key mask indicating whether the pixel comprises the key frame.

2. The system of claim 1 , wherein the key signal processor includes a gain corrector configured to correct the at least one key frame.

3. The system of claim 1 , wherein the key signal processor includes a key signal output configured to multiplex a one bit stream of the key frame in a least significant bit of a blue channel, such that the key signal and the media content are output as a single data stream.

4. The system of claim 1 , wherein the key signal processor includes a key signal output that is configured to multiplex the live output signal with a metadata stream of the at least one key frame at the converted frame rate.

5. The system of claim 1 , wherein the electronic display is configured to insert a key color frame as the key signal in the sequence of media content, with the key color frame being inserted at a frequency configured such that a human viewer of the sequence of media content cannot detect the key color frame.

6. The system of claim 1 , wherein the key mask configures a downstream keyer to create a key and replace the respective pixels having the key frame in the sequence of frames with additional media content.

7. The system of claim 6 , wherein the key signal processor includes a pixel color detector that is configured to create a two bits value, with a first bit indicating whether a key color has been detected and a second bit indicating border information to enable the downstream keyer to determine a location of the respective pixel in the electronic display within the captured media content.

8. The system of claim 1 , wherein the key frame in the sequence of frames is positioned in a middle of the sequence of frames between frames of the media content.

9. The system of claim 1 , further comprising:

a memory,

wherein the key signal processor is configured to implement instructions on the memory so as to provide:

a frame rate capture adjustor configured to convert all frames in the sequence of media content to the output frame rate of the camera,

the pixel color detector configured to analyze the sequence of frames of the captured media content to determine the key signal based on the electronic display outputting the sequence of frames including the media content and the at least one key frame included in the sequence, and

the key signal output configured to combine the remaining frames of the sequence of frames to create the live output signal, wherein the remaining frames do not include the at least one key frame from the sequence of frames.

10. A system for capturing a key signal within video frames, the system comprising:

a memory; and

a key signal processor configured to implement instructions on the memory so as to provide:

convert frames in a sequence of media content of a live scene captured by a camera to an output frame rate of the camera, with the live scene including an electronic display having a higher frame rate than the output frame rate of the camera;

analyze a sequence of frames of the captured media content to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence; and

combine remaining frames of the sequence of frames to create a live output signal, wherein the remaining frames do not include the at least one key frame from the sequence of frames.

11. The system of claim 10 , wherein the key signal processor includes a pixel color detector configured to determine, for each pixel in each frame in the sequence of frames, whether the pixel has a set chromaticity, and to generate a key mask for each pixel in each frame, with the key mask indicating whether the pixel comprises the key frame.

12. The system of claim 11 , wherein the key mask configures a downstream keyer to create a key and replace the respective pixels having the key frame in the sequence of frames with additional media content.

13. The system of claim 12 , wherein the key signal processor includes a pixel color detector that is configured to create a two bits value, with a first bit indicating whether a key color has been detected and a second bit indicating border information to enable the downstream keyer to determine a location of the respective pixel in the electronic display within the captured media content.

14. The system of claim 10 , further comprising a gain corrector configured to correct the at least one key frame.

15. The system of claim 10 , wherein the key signal processor includes a key signal output configured to multiplex a one bit stream of the key frame in a least significant bit of a blue channel, such that the key signal and the media content are output as a single data stream.

16. The system of claim 10 , wherein the key signal processor includes a key signal output that is configured to multiplex the live output signal with a metadata stream of the at least one key frame at the converted frame rate.

17. The system of claim 10 , wherein the electronic display is configured to insert a key color frame as the key signal in the sequence of media content, with the key color frame being inserted at a frequency configured such that a human viewer of the sequence of media content cannot detect the key color frame.

18. The system of claim 10 , wherein the key frame in the sequence of frames is positioned in a middle of the sequence of frames between frames of the media content.

19. A system for capturing a key signal within video frames, the system comprising:

means for converting frames in a sequence of media content of a live scene captured by a camera to an output frame rate of the camera, with the live scene including an electronic display having a higher frame rate than the output frame rate of the camera;

means for analyzing a sequence of frames of the captured media content to determine the key signal based on the electronic display outputting a sequence of frames including media content and at least one key frame included in the sequence, and

means for combining remaining frames of the sequence of frames to create a live output signal, wherein the remaining frames do not include the at least one key frame from the sequence of frames.

20. The system of claim 19 , further comprising means for determining, for each pixel in each frame in the sequence of frames, whether the pixel has a set chromaticity, and means for generating a key mask for each pixel in each frame, with the key mask indicating whether the pixel comprises the key frame.

Assignments (3)
ASSIGNMENT OF INTELLECTUAL PROPERTY SECURITY AGREEMENTS Recorded Dec 12, 2025
From: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
To: MGG INVESTMENT GROUP LP
Reel/Frame 073959/0584 →
SECURITY INTEREST Recorded Mar 20, 2024
From: GRASS VALLEY CANADA; GRASS VALLEY LIMITED
To: MS PRIVATE CREDIT ADMINISTRATIVE SERVICES LLC
Reel/Frame 066850/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2022
From: DAMSTRA, KLAAS JAN; KOUTSTAAL, MARCEL
To: GRASS VALLEY CANADA
Reel/Frame 060563/0637 →