IP Library › Granted Patent US 11,721,040
Granted Patent B2
US 11,721,040 · App. 16/577,403 · Granted Aug 8, 2023

Imaging system, calibration method, and calibrator

Inventors: Tatsuya Koyama (Kyoto, JP); Toshiyasu Sugio (Osaka, JP); Yoichi Sugino (Osaka, JP); Toru Matsunobu (Osaka, JP); Satoshi Yoshikawa (Hyogo, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T7/80B64C39/024G06T7/70B64U2101/30G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,040
App. No.
16/577,403
Granted
Aug 8, 2023
Kind
B2
Abstract

A calibrator for a camera includes a controlling circuit, a photographing circuit, a calculating circuit, and an instructing circuit. The controlling circuit is configured to control a movable body to move into a shooting area of the camera. A marker is provided on the movable body for calibration of the camera. The photographing circuit is configured to control the camera to photograph the marker. The calculating circuit is configured to calculate at least one parameter of the camera based on the photographed marker. The instructing circuit is configured to transmit the at least one parameter to the camera to calibrate the camera.

Claims (38)

1. An imaging system that calibrates a parameter of an imaging apparatus disposed in a predetermined position, the imaging system comprising:

a movement controller that causes a movable object that includes a marker for use in calibration to move into an imaging area of the imaging apparatus;

an imaging controller that causes the imaging apparatus to image the marker; and

a calibrator that calibrates an internal parameter of the imaging apparatus, using an image that includes the marker, the image being captured by the imaging apparatus imaging the marker, wherein

the movable object includes a display apparatus that displays the marker, and

the display apparatus is configured to change the shape of the marker displayed so that the shape of the marker included in an image captured by the imaging apparatus is rectangular or square.

2. The imaging system according to claim 1 , wherein

the movement controller causes the movable object to move, to cause the marker to be imaged over an entirety of an image sensor that is included in the imaging apparatus.

3. The imaging system according to claim 2 , wherein

using a result obtained by processing an image captured by the imaging apparatus, the movement controller causes the movable object to move, to include the marker over an entirety of an image captured by the imaging apparatus.

4. The imaging system according to claim 2 , wherein

the movement controller causes, using a result obtained by processing an image captured by the imaging apparatus, the movable object to move, to include the marker in a first area in a first image and to include the marker in a second area in a second image, the first image and the second image being included in a plurality of images captured by the imaging apparatus at different times,

each of the plurality of images including the first area and the second area, and

the first area and the second area being different areas from each other within each of the plurality of images.

5. The imaging system according to claim 4 , wherein

using a result obtained by processing an image captured by the imaging apparatus, the movement controller causes the movable object to move to positions in which the markers that have sharpness higher than or equal to predetermined sharpness are captured in the images.

6. The imaging system according to claim 1 , wherein

the imaging controller causes the imaging apparatus to capture an image in a state in which the imaging apparatus has at least one of a predetermined focal distance or a predetermined aperture.

7. The imaging system according to claim 1 , wherein

the marker has first feature points, and

the calibrator obtains information indicating a relative positional relationship of the first feature points, and calibrates the internal parameter of the imaging apparatus, using the information and second feature points obtained by processing the image including the marker and captured by the imaging apparatus.

8. A calibration method performed by an imaging system that calibrates a parameter of an imaging apparatus, the calibration method comprising:

causing a movable object that includes a marker for use in calibration to move into an imaging area of the imaging apparatus, the movable object also including a display apparatus that displays the marker;

causing the imaging apparatus to image the marker;

calibrating an internal parameter of the imaging apparatus, using an image that includes the marker, the image being captured by the imaging apparatus imaging the marker; and

changing, by the display apparatus, the shape of the marker displayed so that the shape of the marker included in an image captured by the imaging apparatus is rectangular or square.

9. A calibrator for a camera, comprising:

a controlling circuit configured to control a movable body to move into a shooting area of the camera, a marker being provided on the movable body for calibration of the camera and a display apparatus also being provided on the movable body that displays the marker;

a photographing circuit configured to control the camera to photograph the marker;

a calculating circuit configured to calculate at least one parameter of the camera based on the photographed marker; and

an instructing circuit configured to transmit the at least one parameter to the camera to calibrate the camera, wherein

the display apparatus is configured to change the shape of the marker displayed so that the shape of the photographed marker is rectangular or square.

10. The calibrator according to claim 9 , wherein the at least one parameter includes at least one of a focal distance, an aberration, or an image center.

11. The calibrator according to claim 9 , wherein the controlling circuit, the photographing circuit, the calculating circuit, and the instructing circuit are implemented in a single processor.

12. The calibrator according to claim 9 , wherein the movable body is an unmanned aircraft.

13. The imaging system according to claim 1 , wherein the shape of the marker displayed on the display apparatus that has been changed is different from rectangular or square.

14. The calibration method according to claim 8 , wherein the shape of the marker displayed on the display apparatus that has been changed is different from rectangular or square.

15. The calibrator according to claim 9 , wherein the shape of the marker displayed on the display apparatus that has been changed is different from rectangular or square.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2020
From: KOYAMA, TATSUYA; SUGIO, TOSHIYASU; SUGINO, YOICHI; MATSUNOBU, TORU; YOSHIKAWA, SATOSHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 051575/0766 →
Priority Claims (1)
JP 2017-071998 · Mar 31, 2017 · national
Continuity (2)
Continuation PCTJP2018012301 · Mar 27, 2018
Related Publication 20200027242A1 · Jan 23, 2020
Cited By (1)
US 12,657,772