IP Library Granted Patent US 10,171,803
Granted Patent B2
US 10,171,803 · App. 14/837,709 · Granted Jan 1, 2019

Image capturing apparatus, calibration method, and non-transitory computer-readable medium for calculating parameter for a point image restoration process

Inventors: Kenkichi Hayashi (Saitama, JP); Masahiko Sugimoto (Saitama, JP); Yousuke Naruse (Saitama, JP)
Assignee: FUJIFILM Corporation
H04N17/002G06T5/003G06T7/80H04N5/208H04N5/2178H04N5/2353H04N5/2356H04N5/23209H04N5/23222H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,171,803
App. No.
14/837,709
Granted
Jan 1, 2019
Kind
B2
Abstract

An image capturing apparatus according to an aspect of the present invention includes an image capturing unit, a display unit that displays an imaged picture imaged by the image capturing unit and a guide linearly shaped along a sagittal direction or a tangential direction in the imaged picture, the guide assisting imaging of a calibration image used for calibration in a point image restoration process, and a parameter calculation unit that calculates a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

Claims (46)

1. An image capturing apparatus comprising:

an image capturing unit;

a display unit, including a processor, that displays an imaged picture imaged by the image capturing unit and a guide linearly shaped along a sagittal direction or a tangential direction in at least one of four corners of the imaged picture, the guide assisting imaging of a calibration image used for calibration in a point image restoration process;

a guide indication control unit included in the display unit that performs display control of the guide assisting the imaging of the calibration image used for the calibration in the point image restoration process; and

a parameter calculation unit that calculates a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

2. The image capturing apparatus according to claim 1 , wherein the guide displayed on the display unit is arranged depending on an image height of the imaged picture.

3. The image capturing apparatus according to claim 1 , wherein the guide displayed on the display unit is a first guide or a second guide not parallel with the first guide.

4. The image capturing apparatus according to claim 1 , wherein

the image capturing unit has a bracketing imaging mode, and

the parameter calculation unit calculates the parameter for the point image restoration process on the basis of a plurality of the calibration images imaged with bracketing by the image capturing unit with assistance from the guide.

5. The image capturing apparatus according to claim 4 , wherein the image capturing unit images the calibration image for each f-number in the bracketing imaging mode.

6. The image capturing apparatus according to claim 1 , wherein the parameter calculation unit calculates the parameter for the point image restoration process on the basis of the plurality of the calibration images imaged by the image capturing unit with assistance from the guide.

7. The image capturing apparatus according to claim 1 , wherein

the display unit further displays an imaging condition for imaging the calibration image, and

the parameter calculation unit calculates the parameter for the point image restoration process under the imaging condition on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

8. The image capturing apparatus according to claim 1 , wherein the image capturing unit has an interchangeable lens.

9. The image capturing apparatus according to claim 1 , wherein the image capturing unit has a lens which modulates a phase to extend a depth of field.

10. The image capturing apparatus according to claim 1 , further comprising a parameter holding unit that stores therein in advance the parameter for the point image restoration process,

wherein

the parameter calculation unit adjusts the parameter stored in the parameter holding unit on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

11. The image capturing apparatus according to claim 1 , further comprising:

an image analysis unit that analyzes the imaged picture; and

an image analysis determination unit that determines whether or not the imaged picture is adequate as the calibration image on the basis of an analysis result of the imaged picture by the image analysis unit and outputs a determination result,

wherein

the display unit further displays determination information on the basis of the determination result.

12. The image capturing apparatus according to claim 11 , wherein the image analysis unit analyzes the imaged picture regarding a brightness or blur amount of the imaged picture.

13. The image capturing apparatus according to claim 12 , wherein

the image analysis unit acquires information on the f-number regarding the imaged picture, and analyzes the brightness of the imaged picture on the basis of a threshold of a exposure time set for the calibration, a threshold of an imaging sensitivity set for the calibration, and the acquired information on the f-number.

14. The image capturing apparatus according to claim 11 , wherein

the image analysis unit further includes a coincidence degree determination unit that determines a coincidence degree between the guide and the imaged picture imaged by the image capturing unit and outputs a resultant coincidence degree, and

the image analysis determination unit determines whether or not the imaged picture is adequate as the calibration image on the basis of the resultant coincidence degree.

15. The image capturing apparatus according to claim 6 , further comprising:

an optical transfer function holding unit that stores therein in advance information on an optical transfer function of the lens as the parameter for the point image restoration process; and

an optical transfer function determination unit that determines whether or not a difference is larger than a threshold, the difference being a difference between information on an optical transfer function of a lens calculated by the parameter calculation unit on the basis of the plurality of the calibration images imaged by the image capturing unit and the information on the optical transfer function of the lens stored in the optical transfer function holding unit, and outputs a determination result concerning the optical transfer function,

wherein

the display unit further displays determination information on the basis of the determination result concerning the optical transfer function.

16. The image capturing apparatus according to claim 15 , wherein the information on the optical transfer function of the lens is at least one of a modulation transfer function and phase transfer function of the lens.

17. The image capturing apparatus according to claim 11 , wherein the display unit displays an indication prompting change of the imaged picture depending on the determination result output by the image analysis determination unit.

18. The image capturing apparatus according to claim 15 , wherein the display unit displays an indication prompting retake of the calibration image depending on the determination result output by the optical transfer function determination unit.

19. A calibration method comprising:

a displaying step of displaying a captured image imaged by an image capturing unit and a guide assisting imaging of a calibration image used for calibration in a point image restoration process on a display unit, the display unit including a processor, the guide linearly shaped along a sagittal direction or a tangential direction in at least one of four corners of the captured image, a guide indication control unit included in the display unit performing display control of the guide assisting the imaging of the calibration image used for the calibration in the point image restoration process; and

a parameter calculating step of calculating a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

20. A non-transitory computer-readable medium having a program recorded therein, the program for causing a processor, when an instruction stored in the medium is read out by the processor, to execute:

a displaying step of displaying a captured image imaged by an image capturing unit and a guide assisting imaging of a calibration image used for calibration in a point image restoration process on a display unit, the guide linearly shaped along a sagittal direction or a tangential direction in at least one of four corners of the captured image, a guide indication control unit included in the display unit performing display control of the guide assisting the imaging of the calibration image used for the calibration in the point image restoration process; and

a parameter calculating step of calculating a parameter for the point image restoration process on the basis of the calibration image imaged by the image capturing unit with assistance from the guide.

21. The image capturing image apparatus of claim 1 , wherein the point image restoration process is based on a point spread function.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2015
From: HAYASHI, KENKICHI; SUGIMOTO, MASAHIKO; NARUSE, YOUSUKE
To: FUJIFILM CORPORATION
Reel/Frame 036446/0232 →
Priority Claims (1)
JP 2013-066622 · Mar 27, 2013 · national
Continuity (2)
Continuation PCTJP2013080412 · Nov 11, 2013
Related Publication 20150365661A1 · Dec 17, 2015