IP Library Granted Patent US 12,538,034
Granted Patent B2
US 12,538,034 · App. 18/582,031 · Granted Jan 27, 2026

Scene control apparatus, scene control method, image capture apparatus, and virtual studio system

Inventors: Satoru Kobayashi (Tokyo, JP); Gou Yamashita (Kanagawa, JP); Toshimasa Suzuki (Kanagawa, JP); Ayako Furesawa (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N23/74G06V10/141G06V10/60H04N23/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,538,034
App. No.
18/582,031
Granted
Jan 27, 2026
Kind
B2
Abstract

A scene control apparatus capable of suppressing changes in exposure settings of a camera that captures video with an image as the background is disclosed. The apparatus acquires information relating to luminance of a captured scene of an image capture apparatus and determines, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed. According to a result of the determination, the apparatus changes the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene.

Claims (65)

1 . A scene control apparatus comprising:

one or more processors that execute a program stored in a memory and thereby function as:

an acquisition unit configured to acquire information relating to luminance of a captured scene of an image capture apparatus;

a determination unit configured to determine, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

a control unit configured to change, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the control unit changes the brightness of the video so as to fall within a range of a luminance dynamic range of the image capture apparatus that is based on the information.

2 . The scene control apparatus according to claim 1 ,

wherein the determination unit determines that the brightness of at least one of the lighting equipment and the video needs to be changed, if it is determined, based on the information, that a sensitivity for capturing needs to be changed in the image capture apparatus.

3 . The scene control apparatus according to claim 2 ,

wherein the determination unit determines that the brightness of at least one of the lighting equipment and the video needs to be changed, if the sensitivity for capturing based on the information deviates from the luminance dynamic range of the image capture apparatus.

4 . The scene control apparatus according to claim 1 ,

wherein the control unit changes the brightness of the video by controlling a display apparatus configured to display the video.

5 . The scene control apparatus according to claim 1 ,

wherein the control unit changes the brightness of the video by changing data representing the video.

6 . The scene control apparatus according to claim 1 ,

wherein the control unit changes the brightness of the lighting equipment and the brightness of the video so as to compensate for an insufficient or excessive exposure amount in the image capture apparatus.

7 . The scene control apparatus according to claim 1 ,

wherein the control unit performs control such that, in a case where the image capture apparatus is performing exposure control such that a specific subject within the captured scene is appropriately exposed, the brightness of the video falls within the range of the luminance dynamic range of the image capture apparatus by changing the brightness of the lighting equipment lighting up the specific subject.

8 . The scene control apparatus according to claim 1 ,

wherein the control unit, in a case of changing the brightness of the video, changes the brightness of an entirety of the background represented by the video.

9 . The scene control apparatus according to claim 1 ,

wherein the control unit changes the brightness of the video by converting a luminance of data of the video in a nonlinear manner.

10 . The scene control apparatus according to claim 1 ,

wherein processing from acquisition of the information by the acquisition unit to changing of the brightness by the control unit is executed within one frame period of the image capture apparatus.

11 . The scene control apparatus according to claim 1 ,

wherein the control unit instructs the image capture apparatus to change an exposure setting, in a case where the captured scene or a region of the specific subject in the captured scene will not be correctly exposed even if the brightness of the lighting equipment and the brightness of the video are changed.

12 . A virtual studio system comprising:

an image capture apparatus;

a scene control apparatus;

a display apparatus configured to display a background of a captured scene of the image capture apparatus; and

lighting equipment configured to light up a subject present in the captured scene,

wherein the scene control apparatus comprising:

one or more processors that execute a program stored in a memory and thereby function as:

an acquisition unit configured to acquire information relating to luminance of a captured scene of an image capture apparatus;

a determination unit configured to determine, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

a control unit configured to change, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the control unit changes the brightness of the video so as to fall within a range of a luminance dynamic range of the image capture apparatus that is based on the information, and

wherein the image capture apparatus comprising:

one or more processors that execute a program stored in a memory and thereby function as:

a generation unit configured to generate information relating to a luminance of a captured scene;

an output unit configured to output the information to an external apparatus;

a determination unit configured to determine exposure settings that are based on the information; and

an image capture unit configured to capture based the exposure settings,

wherein the determination unit, in a case where the exposure settings that are based on the information change to exceed a predetermined range from current exposure settings, determines exposure settings that does not exceed the predetermined range from the current exposure settings.

13 . A scene control method for execution by a scene control apparatus, the method comprising:

acquiring information relating to luminance of a captured scene of an image capture apparatus;

determining, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

changing, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the changing changes the brightness of the video so as to fall within a range of a luminance dynamic range of the image capture apparatus that is based on the information.

14 . A non-transitory computer-readable medium storing a program that causes, when executed by a computer, the computer to function as a scene control apparatus comprising:

an acquisition unit configured to acquire information relating to luminance of a captured scene of an image capture apparatus;

a determination unit configured to determine, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

a control unit configured to change, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the control unit changes the brightness of the video so as to fall within a range of a luminance dynamic range of the image capture apparatus that is based on the information.

15 . A scene control apparatus comprising:

one or more processors that execute a program stored in a memory and thereby function as:

an acquisition unit configured to acquire information relating to luminance of a captured scene of an image capture apparatus;

a determination unit configured to determine, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

a control unit configured to change, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the control unit changes the brightness of the video by converting a luminance of data of the video in a nonlinear manner.

16 . A scene control method for execution by a scene control apparatus, the method comprising:

acquiring information relating to luminance of a captured scene of an image capture apparatus;

determining, based on the information, whether a brightness of at least one of lighting equipment configured to light up the captured scene and video that is displayed as a background of the captured scene needs to be changed; and

changing, according to a result of the determination, the brightness of at least one of the lighting equipment that lights up the captured scene and the video that is displayed as the background of the captured scene,

wherein the changing changes the brightness of the video by converting a luminance of data of the video in a nonlinear manner.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2024
From: KOBAYASHI, SATORU; YAMASHITA, GOU; SUZUKI, TOSHIMASA; FURESAWA, AYAKO
To: CANON KABUSHIKI KAISHA
Reel/Frame 066609/0571 →
Priority Claims (1)
JP 2023-032178 · Mar 2, 2023 · national
Continuity (1)
Related Publication 20240298090A1 · Sep 5, 2024
References Cited (12)
US 10120267B2 · Bonnier · 2018 [cited by examiner]
US 10251462B2 · Franke · 2019 [cited by examiner]
US 10527909B2 · Peterson · 2020 [cited by examiner]
US 20220030139A1 · Koppetz · 2022 [cited by examiner]
CN 108521859B · 2020 [cited by examiner]
JP 4003657B2 · 2007 [cited by examiner]
JP 7190594B1 · 2022 [cited by applicant]
TW 200913682A · 2009 [cited by examiner]
English translation of JP-4003657-B2 2007 (Year: 2007). [cited by examiner]
English translation of TW-200913682-A, 2009 (Year: 2009). [cited by examiner]
English translation of CN-108521859-B, 2020 (Year: 2020). [cited by examiner]
A European Search Report issued on Jul. 26, 2024, which is enclosed, that issued in the corresponding European Patent Application No. 24157245.2. [cited by applicant]