IP Library › Granted Patent US 10,171,794
Granted Patent B2
US 10,171,794 · App. 15/075,220 · Granted Jan 1, 2019

Method for selecting cameras and image distribution system capable of appropriately selecting cameras

Inventors: Toru Matsunobu (Osaka, JP); Toshiyasu Sugio (Osaka, JP); Tatsuya Koyama (Kyoto, JP); Satoshi Yoshikawa (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
H04N13/243H04N13/296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,171,794
App. No.
15/075,220
Granted
Jan 1, 2019
Kind
B2
Abstract

In a method, M (M is a natural number smaller than N) cameras capturing images to be displayed are selected from N (N is a natural number equal to or larger than 2) cameras capturing images of a same scene. The method includes obtaining positions and image capture angles of the N cameras and selecting M cameras from the N cameras on the basis of the obtained positions and image capture angles of the N cameras.

Claims (91)

1. A method, comprising:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images by using a processor based on the positions and the image capture angles of the cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining:

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

2. The method according to claim 1 ,

wherein, in the selecting, cameras whose images hardly overlap with one another and whose images include a target space most comprehensively are selected as the second number of the cameras based on the positions and the image capture angles of the cameras.

3. The method according to claim 1 ,

wherein, in the selecting, cameras capturing images of a target space or a subject from a plurality of angles at regular intervals are selected as the second number of the cameras based on the positions and the image capture angles of the cameras.

4. The method according to claim 1 ,

wherein, in the obtaining, the positions and the image capture angles of the cameras are calculated by performing three-dimensional reconfiguration using the images captured by the cameras.

5. The method according to claim 1 ,

wherein, in the obtaining, the positions and the image capture angles of the cameras are calculated using information obtained by the sensors included in the cameras and transmitted from the cameras.

6. The method according to claim 1 ,

wherein, in the obtaining, focal distances of the cameras are also obtained, and

in the selecting, the second number of the cameras is selected based on the positions, the image capture angles, and the focal distances of the cameras.

7. The method according to claim 1 ,

wherein, in the determining, a subject is tracked over frames and, when tracking of the subject fails, the at least one of the second number of the cameras is determined to be switched in accordance with the first time and the second time.

8. The method according to claim 7 ,

wherein, in the determining, three-dimensional models of the subject are associated with one another between the frames, the associated three-dimensional models of the subject are projected onto a present frame, and, when the subject is not included in an obtained frame, the tracking of the subject fails.

9. The method according to claim 1 , further comprising:

determining whether to perform the selecting again in the frame after the selecting; and

selecting, when the selecting is determined to be performed again, the second number of the cameras again based on the positions and the image capture angles of the cameras.

10. The method according to claim 1 ,

wherein the selecting includes:

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

11. An image distribution system, comprising:

a processor; and

a memory including a program, the program causing the processor to execute operations including:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining:

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

12. A method, comprising:

obtaining positions and image capture angles of a first number of cameras capturing images of a same scene;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the N cameras;

determining whether to switch at least one of the second number of the cameras to another camera in a frame after the selecting; and

selecting, when the determining determines that the at least one of the second number of the cameras is to be switched, a new camera for the at least one of the second number of the cameras based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

in the determining:

when a time elapsed since a previous switching operation is shorter than a first time, the at least one of the second number of the cameras is determined not to be switched to another camera;

when the time elapsed since the previous switching operation is equal to or longer than the first time but shorter than a second time longer than the first time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a first criterion; and

when the time elapsed since the previous switching operation is equal to or longer than the second time, whether to switch the at least one of the second number of the cameras to another camera is determined in accordance with a second criterion, the at least one of the second number of the cameras being more likely to be switched to the another camera according to the second criterion than the first criterion.

13. A method, comprising:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images by using a processor based on the positions and the image capture angles of the cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes:

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

14. An image distribution system, comprising:

a processor; and

a memory including a program, the program causing the processor to execute operations including:

obtaining, using sensors included in a first number of cameras capturing images of a same scene, positions and image capture angles of the cameras;

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the cameras;

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes:

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

15. A method, comprising:

obtaining positions and image capture angles of a first number of cameras capturing images of a same scene; and

selecting, for display, a second number of the cameras capturing the images based on the positions and the image capture angles of the N cameras,

wherein the first number is a natural number at least equal to 2,

the second number is a natural number less than the first number, and

the selecting includes:

calculating first evaluation values of the cameras based on the images captured by the cameras;

calculating second evaluation values of camera groups, which are combinations of the second number of the cameras, based on the positions and the image capture angles of the cameras;

calculating a third evaluation value of each camera group based on the first evaluation values of the second number of the cameras included in each camera group and the second evaluation value of each camera group; and

selecting the second number of the cameras from a camera group having a highest third evaluation value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2016
From: MATSUNOBU, TORU; SUGIO, TOSHIYASU; KOYAMA, TATSUYA; YOSHIKAWA, SATOSHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 038143/0527 →
Priority Claims (1)
JP 2015-240655 · Dec 9, 2015 · national
Continuity (2)
Provisional Application 62154138 · Apr 29, 2015
Related Publication 20160323559A1 · Nov 3, 2016