IP Library › Granted Patent US 10,951,835
Granted Patent B1
US 10,951,835 · App. 16/808,554 · Granted Mar 16, 2021

Imaging device, method, and storage medium

Inventors: Masako Kashiwagi (Ageo Saitama, JP); Nao Mishima (Tokyo, JP)
Assignee: KABUSHIKI KAISHA TOSHIBA
H04N5/2621H04N5/232127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,951,835
App. No.
16/808,554
Granted
Mar 16, 2021
Kind
B1
Abstract

According to one embodiment, an imaging device includes a first optical system including a lens and is configured to control a position of the lens to adjust a focal point. The imaging device includes first storage and a processor. The first storage is configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image. The processor is configured to acquire an image influenced by aberration of the first optical system, input the acquired image to the statistical model and acquire distance information, and control the position of the lens included in the first optical system.

Claims (45)

1. An imaging device comprising a first optical system including a lens and configured to control a position of the lens to adjust a focal point, the imaging device further comprising:

first storage configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image; and

a processor configured to:

acquire an image influenced by aberration of the first optical system;

input the acquired image to the statistical model and acquire distance information indicative of a distance to a subject in the image; and

control the position of the lens included in the first optical system.

2. The imaging device of claim 1 , wherein the processor is configured to:

select the subject included in the acquired image; and

acquire a distance to the selected subject.

3. The imaging device of claim 2 , wherein

the processor is configured to control the position of the lens included in the first optical system to make the selected subject come into focus.

4. The imaging device of claim 2 , wherein

the processor is configured to control the position of the lens included in the first optical system to make the selected subject not come into focus.

5. The imaging device of claim 1 , wherein

the processor is configured to select the subject based on a user operation.

6. The imaging device of claim 1 , wherein

the statistical model is stored in the first storage for each lens used in the second optical system, and

the processor is configured to input the acquired image to a statistical model corresponding to the lens included in the first optical system and acquire distance information indicative of the distance to the subject in the image.

7. The imaging device of claim 6 , wherein

bokeh changing nonlinearly in accordance with the distance to the subject in the image includes bokeh further changing in accordance with the position in the image.

8. The imaging device of claim 6 , wherein the processor is configured to:

acquire lens information on the lens included in the first optical system;

select a statistical model corresponding to a lens specified based on the lens information, from the first storage; and

input the acquired image to the specified statistical model and acquire distance information indicative of the distance to the subject in the image.

9. The imaging device of claim 6 , further comprising:

second storage configured to store a first aberration map indicative of distribution of bokeh which occurs in an image influenced by aberration of the second optical system using the lens and which depends on a distance to the subject in the image and a position in the image, for each statistical model corresponding to each of lenses used in the second optical system, wherein

the processor is configured to:

specify a first aberration map stored in the second storage, based on bokeh which occurs in an image influenced by aberration of the first optical system; and

input the acquired image to a statistical model corresponding to the specified first aberration map and acquires distance information indicative of a distance to the subject in the image.

10. The imaging device of claim 1 , wherein the processor is configured to:

display an image influenced by aberration of the first optical system;

select a subject in the displayed image in accordance with a user operation; and

input information on a region including the selected subject to a statistical model corresponding to the lens included in the first optical system and acquire distance information indicative of a distance to the subject;

control a position of the lens included in the first optical system so as to make the selected subject come into focus, based on the acquired distance information; and

capture an image in a state where the position of the lens is controlled.

11. A method executed by an imaging device comprising a first optical system including a lens and configured to control a position of the lens to adjust a focal point, the imaging device further comprising first storage configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image,

the method comprising:

acquiring an image influenced by aberration of the first optical system;

inputting the acquired image to the statistical model and acquiring distance information indicative of a distance to a subject in the image; and

controlling the position of the lens included in the first optical system.

12. A non-transitory computer-readable storage medium having stored thereon a computer program which is executable by a computer of an imaging device comprising a first optical system including a lens and configured to control a position of the lens to adjust a focal point, the imaging device further comprising first storage configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image,

the computer program comprising instructions capable of causing the computer to execute functions of:

acquiring an image influenced by aberration of the first optical system;

inputting the acquired image to the statistical model and acquiring distance information indicative of a distance to a subject in the image; and

controlling the position of the lens included in the first optical system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: KASHIWAGI, MASAKO; MISHIMA, NAO
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 053534/0056 →
Priority Claims (1)
JP JP2019-166564 · Sep 12, 2019 · national
Cited By (2)
US 12,243,252 US 12,450,699