IP Library Granted Patent US 10,536,640
Granted Patent B2
US 10,536,640 · App. 16/127,245 · Granted Jan 14, 2020

Imaging device, operation method, image processing device, and image processing method

Inventor: Junya Kitagawa (Saitama, JP)
Assignee: FUJIFILM CORPORATION
H04N5/23264G02B27/0025G06T7/70H04N5/2254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,536,640
App. No.
16/127,245
Granted
Jan 14, 2020
Kind
B2
Abstract

The imaging device includes an imaging optical system, imaging unit having an imaging element and for capturing a video by imaging a subject image through the imaging optical system, a camera shake detection unit configured to detect camera shake, an optical correction unit configured to optically correct the camera shake detected by the camera shake detection unit by changing a position of the imaging optical system or the imaging element in a case where the optical correction unit is turned on and to stop the correction in a case where the optical correction unit is turned off, and a reset determination unit for determining whether or not to reset the position of the imaging optical system or the imaging element. The optical correction unit resets the position of the imaging optical system or the imaging element in a case where the reset determination unit determines to reset the position of the imaging optical system or the imaging element. The imaging device further includes an electronic correction unit configured to electronically correct a change of a position of a subject, based on an operation of the reset by the optical correction unit, in an image captured by the imaging unit in a case where the reset by the optical correction unit is started.

Claims (42)

1. An imaging device comprising:

an imaging optical system that includes one or more lens;

an imaging unit having an imaging element, for capturing a video by imaging a subject image through the imaging optical system;

a camera shake detection unit configured to detect camera shake;

an optical correction unit configured to optically correct the camera shake detected by the camera shake detection unit in a case where the optical correction unit is turned on by changing a position of the imaging optical system or the imaging element, and to stop the correction in a case where the optical correction unit is turned off; and

a reset determination unit configured to determine whether or not to reset the position of the imaging optical system or the imaging element,

wherein the optical correction unit resets the position of the imaging optical system or the imaging element in a case where the reset determination unit determines to reset the position of the imaging optical system or the imaging element,

wherein the imaging device further comprises an electronic correction unit configured to electronically correct a change of a position of a subject, based on an operation of the reset by the optical correction unit, in an image captured by the imaging unit in a case where the reset by the optical correction unit is started, and

wherein the electronic correction unit performs correction for canceling the change of the position of the subject in the image based on the operation of the reset of the position of the imaging optical system or the imaging element during the operation of the reset by the optical correction unit, and performs correction for returning the canceled position of the subject to an original position in a case where the optical correction unit is turned on again.

2. The imaging device according to claim 1 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where the imaging optical system or the imaging element reaches a correction limit due to the correction by the optical correction unit.

3. The imaging device according to claim 1 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where the imaging optical system or the imaging element is positioned within an edge region of a correctable range by the optical correction unit for a predetermined set time or longer.

4. The imaging device according to claim 1 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where panning is started in a state in which the optical correction unit is turned on.

5. The imaging device according to claim 1 , further comprising:

a shake detection unit configured to detect shake of an imaging device main body,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where an integral value of a value detected by the shake detection unit exceeds a set threshold value.

6. The imaging device according to claim 1 , further comprising:

a shake detection unit configured to detect shake of an imaging device main body,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where a state in which a value detected by the shake detection unit is a value smaller than a set threshold value is continued for a predetermined set time.

7. An operation method of an imaging device which includes an imaging optical system that includes one or more lens, an imaging unit having an imaging element, for capturing a video by imaging a subject image through the imaging optical system, a camera shake detection unit configured to detect camera shake, an optical correction unit configured to optically correct the camera shake by changing a position of the imaging optical system or the imaging element, a reset determination unit configured to determine whether or not to reset the position of the imaging optical system or the imaging element, and an electronic correction unit configured to electronically correct a change of a position of a subject in an image captured by the imaging unit, the method comprising:

causing the camera shake detection unit to detect the camera shake and causing the optical correction unit to optically correct the detected camera shake in a case where the optical correction unit is turned on;

causing the reset determination unit to determine whether or not to reset the position of the imaging optical system or the imaging element; and causing the optical correction unit to stop the correction and start the reset of the position of the imaging optical system or the imaging element in a case where the reset determination unit determines to reset the position of the imaging optical system or the imaging element, causing the electronic correction unit to perform correction for electronically canceling the change of the position of the subject, based on an operation of the reset by the optical correction unit, in the image captured by the imaging unit during the operation of the reset by the optical correction unit, and causing the electronic correction unit to perform correction for returning the canceled position of the subject to an original position in a case where the optical correction unit is turned on again.

8. The operation method according to claim 7 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where the imaging optical system or the imaging element reaches a correction limit due to the correction by the optical correction unit.

9. The operation method according to claim 7 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where the imaging optical system or the imaging element is positioned within an edge region of a correctable range by the optical correction unit for a predetermined set time or longer.

10. The operation method according to claim 7 ,

wherein the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where panning is started in a state in which the optical correction unit is turned on.

11. The operation method according to claim 7 , wherein:

the imaging device further includes a shake detection unit configured to detect shake of an imaging device main body, and

the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where an integral value of a value detected by the shake detection unit exceeds a set threshold value.

12. The operation method according to claim 7 , wherein:

the imaging device further includes a shake detection unit configured to detect shake of an imaging device main body, and

the reset determination unit determines to reset the position of the imaging optical system or the imaging element in a case where a state in which a value detected by the shake detection unit is a value smaller than a set threshold value is continued for a predetermined set time.

13. An image processing device comprising:

an input unit configured to input image data of a video captured in an imaging device and data indicating a timing when a reset by an optical correction unit is started, the imaging device including an imaging optical system that includes one or more lens, an imaging unit having an imaging element, for capturing a video by imaging a subject image through the imaging optical system, a camera shake detection unit configured to detect camera shake, the optical correction unit configured to optically correct the camera shake detected by the camera shake detection unit in a case where the optical correction unit is turned on by changing a position of the imaging optical system or the imaging element, and to stop the correction in a case where the optical correction unit is turned off, and a reset determination unit configured to determine whether or not to reset the position of the imaging optical system or the imaging element, the optical correction unit resetting the position of the imaging optical system or the imaging element in a case where the reset determination unit determines to reset the position of the imaging optical system or the imaging element; and

an electronic correction unit configured to electronically correct a change of a position of a subject, based on an operation of the reset by the optical correction unit, in the image data in a case where the data indicating the timing when the reset by the optical correction unit is started indicates the start of the reset in the image data input by the input unit.

14. An image processing method comprising:

inputting image data of a video captured in an imaging device and data indicating a timing when a reset by an optical correction unit is started, the imaging device including an imaging optical system that includes one or more lens, an imaging unit having an imaging element, for capturing a video by imaging a subject image through the imaging optical system, a camera shake detection unit configured to detect camera shake, the optical correction unit configured to optically correct the camera shake detected by the camera shake detection unit in a case where the optical correction unit is turned on by changing a position of the imaging optical system or the imaging element, and to stop the correction in a case where the optical correction unit is turned off, and a reset determination unit configured to determine whether or not to reset the position of the imaging optical system or the imaging element, the optical correction unit resetting the position of the imaging optical system or the imaging element in a case where the reset determination unit determines to reset the position of the imaging optical system or the imaging element; and

electronically correcting a change of a position of a subject, based on an operation of the reset by the optical correction unit, in the image data in a case where the data indicating the timing when the reset by the optical correction unit is started indicates the start of the reset in the input image data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2018
From: KITAGAWA, JUNYA
To: FUJIFILM CORPORATION
Reel/Frame 046873/0516 →
Priority Claims (1)
JP 2016-069139 · Mar 30, 2016 · national
Continuity (2)
Continuation PCTJP2017011820 · Mar 23, 2017
Related Publication 20190007617A1 · Jan 3, 2019