IP Library › Granted Patent US 11,190,673
Granted Patent B2
US 11,190,673 · App. 16/303,504 · Granted Nov 30, 2021

Control device, control method, and program

Inventors: Katsumasa Tanaka (Kawasaki, JP); Masahiro Handa (Tokyo, JP); Michio Aizawa (Yokohama, JP); Shogo Mizuno (Tokyo, JP); Akihiro Matsushita (Tokyo, JP); Keisuke Morisawa (Kawasaki, JP); Tomohiro Yano (Yokohama, JP); Mai Komiyama (Kamakura, JP); Kenichi Fujii (Tokyo, JP); Atsushi Date (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
H04N5/23203H04N5/23216H04N13/243
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,673
App. No.
16/303,504
Granted
Nov 30, 2021
Kind
B2
Abstract

A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.

Claims (29)

1. A control device comprising:

one or more memories storing instructions; and

one or more processors executing the instructions to:

obtain event information including information representing a type of event where imaging from a plurality of directions is to be performed;

cause a storage device to store the obtained event information and setting information of a system which generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the obtained event information and the setting information being associated with each other and the setting information including information regarding a specific position where a plurality of imaging devices is to be pointed and which is set for the type of the event; and

perform a setting process of the system based on the stored setting information, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the setting process of the system including a process of pointing the plurality of imaging devices to the specific position set for the type of the event.

2. The control device according to claim 1 , wherein the obtained event information includes information representing a starting time of the event which is the imaging target.

3. The control device according to claim 2 , wherein the setting process is started before the starting time specified in accordance with the stored setting information.

4. The control device according to claim 1 , wherein the setting process of the system is performed based on a setting list stored in the storage device.

5. The control device according to claim 1 , wherein the setting process includes a process of setting parameters associated with imaging performed by a plurality of imaging devices.

6. The control device according to claim 1 , wherein the setting process includes a process of setting parameters associated with image processing performed by an apparatus which generates the virtual viewpoint image.

7. The control device according to claim 1 , wherein the setting process includes a process of activating devices included in the system.

8. The control device according to claim 1 , wherein the stored setting information includes information representing a method for generating the virtual viewpoint image based on the image data.

9. The control device according to claim 1 , wherein the stored setting information includes information representing parameters associated with positioning of a plurality of imaging devices.

10. The control device according to claim 1 , wherein the stored setting information includes information representing designation available ranges of a virtual viewpoint associated with the generation of the virtual viewpoint image.

11. The control device according to claim 1 , wherein the stored setting information includes information representing a method for transmitting a foreground region extracted from the captured image in the system.

12. The control device according to claim 11 , wherein the information representing the method for transmitting a foreground region in the system includes at least one of information representing a compression rate of the foreground image and information representing a frame rate.

13. The control device according to claim 1 , wherein the stored setting information includes information representing a method for transmitting a background region extracted from the captured image in the system.

14. The control device according to claim 13 , wherein the information representing the method for transmitting a background region in the system includes at least one of information representing a compression rate of the background image and information representing a frame rate.

15. The control device according to claim 1 , wherein the information regarding the specific position includes at least one of information representing a number of specific positions, information representing a position of the specific position, and identification information of an imaging device corresponding to the specific position.

16. The control device according to claim 1 , wherein the storage device stores event information including information representing a type of event corresponding to a number of persons which is equal to or smaller than a threshold value and information representing a method for generating the virtual viewpoint image using 3D shape data generated based on the captured image which are associated with each other.

17. A control method comprising:

obtaining event information including information representing a type of event where imaging from a plurality of directions is to be performed;

causing a storage device to store the obtained event information and setting information of a system which generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the obtained event information and the setting information being associated with each other, and the setting information including information regarding a specific position where a plurality of imaging devices is to be pointed and which is set for the type of the event; and

performing a setting process of the system based on the stored setting information, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the setting process of the system including a process of pointing the plurality of imaging devices to a specific position set for the type of the event.

18. A non-transitory computer readable storage medium storing computer executable instructions for causing a computer to execute a control method comprising:

obtaining event information including information representing a type of event where imaging from a plurality of directions is to be performed;

causing a storage device to store the obtained event information and setting information of a system which generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the obtained event information and the setting information being associated with each other, and the setting information including information regarding a specific position where a plurality of imaging devices are to be pointed and which is set for the type of the event; and

performing a setting process of the system based on the stored setting information, before the imaging from the plurality of directions for generating the virtual viewpoint image is performed, the setting process of the system including a process of pointing the plurality of imaging devices to the specific position set for the type of the event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2018
From: TANAKA, KATSUMASA; HANDA, MASAHIRO; AIZAWA, MICHIO; MIZUNO, SHOGO; MATSUSHITA, AKIHIRO; MORISAWA, KEISUKE; YANO, TOMOHIRO; KOMIYAMA, MAI; FUJII, KENICHI; DATE, ATSUSHI
To: CANON KABUSHIKI KAISHA
Reel/Frame 047992/0444 →
Priority Claims (1)
JP JP2016-104432 · May 25, 2016 · national
Continuity (1)
Related Publication 20200329189A1 · Oct 15, 2020