IP Library Granted Patent US 9,143,685
Granted Patent B2
US 9,143,685 · App. 13/114,576 · Granted Sep 22, 2015

Image stabilization device, image stabilization method, and program

Inventors: Nobuhiro Ogawa (Tokyo, JP); Tatsumi Sakaguchi (Kanagawa, JP); Shinji Watanabe (Tokyo, JP)
Assignee: Sony Corporation
H04N5/23254H04N5/23258H04N5/23267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,143,685
App. No.
13/114,576
Granted
Sep 22, 2015
Kind
B2
Abstract

Provided is an image stabilization device including a motion sensor for detecting motion data, an image data display unit for displaying image data, a shake coefficient calculation unit for calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor, and a motion correction unit for performing control on the image data display unit to move the image data in a direction of cancelling the shaking in a case the shake coefficient calculated by the shake coefficient calculation unit becomes less than a predetermined first threshold.

Claims (51)

1. An image stabilization device comprising:

a motion sensor that detects motion data of the image stabilization device;

an image data display that displays image data; and

a computer configured to:

calculate a shake coefficient indicating intensity of shaking based on time-series motion data detected by the motion sensor, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

perform control of the image data display, in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated by the computer becomes less than a predetermined first threshold, to move an entire area of the image data in a direction of cancelling the shaking; and

end the control to move the entire area of the image data in the direction of cancelling the shaking in a case that the shake coefficient calculated by the computer becomes less than a predetermined second threshold that is less than the predetermined first threshold.

2. The image stabilization device according to claim 1 ,

wherein the computer performs control of moving the entire area of the image data in such a way that a degree of cancellation of the shaking gradually increases as the shake coefficient becomes less than the predetermined first threshold, and performs control of moving the entire area of the image data in such a way that the degree of cancellation of the shaking gradually decreases as the shake coefficient nears the predetermined second threshold.

3. The image stabilization device according to claim 2 , wherein the computer performs control of moving the entire area of the image data within a range allowing display of a protected area set in the image data.

4. The image stabilization device according to claim 3 , wherein the computer is configured to:

calculate a maximum movement amount of the image data based on a relationship between a frame position of a display screen on which the image data is displayed and a frame position of the protected area; and

perform control of moving the entire area of the image data within a range that does not exceed the maximum movement amount calculated by the circuitry computer.

5. The image stabilization device according to claim 4 ,

wherein, when a predetermined time has elapsed in a state where the shake coefficient calculated by the computer is less than the predetermined first threshold, the computer performs the control of moving the entire area of the image data in the direction of cancelling the shaking after performing scaling on the image data.

6. The image stabilization device according to claim 3 ,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the computer performs control of moving each layer forming the entire area of the image data according to the degree of cancellation of the shaking set for the use of each layer.

7. The image stabilization device according to claim 1 , wherein the computer is configured to:

estimate, from motion data detected by the motion sensor at present and in a past, motion data to be detected at a next time point;

determine a degree of cancellation of the shaking based on the motion data estimated by the computer; and

perform control of moving the entire area of the image data according to the degree of cancellation of the shaking determined by the computer.

8. The image stabilization device according to claim 1 ,

wherein the image data is formed from a plurality of layers,

wherein a different use is set for each layer,

wherein a different degree of cancellation of the shaking is set for each use, and

wherein the computer performs control of moving each layer forming the entire area of the image data according to the degree of cancellation of the shaking set for the use of each layer.

9. The image stabilization device according to claim 1 ,

wherein, when a predetermined time has elapsed in a state where the shake coefficient calculated by the computer is less than the predetermined first threshold, the computer performs the control of moving the entire area of the image data in the direction of cancelling the shaking after performing scaling on the image data.

10. The image stabilization device according to claim 1 ,

wherein the computer sets the predetermined first threshold so that a range of the shaking indicated by the shake coefficient when the shake coefficient is the predetermined first threshold is about 10% of a size of the entire area of the image data display, and the computer sets the predetermined second threshold so that a range of the shaking indicated by the shake coefficient when the shake coefficient is the predetermined second threshold is about 1% of the size of the entire area of the image data display.

11. The image stabilization device according to claim 1 ,

wherein the computer does not perform the control of the image data display to move the entire area of the image data in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.

12. An image stabilization method of an image stabilization device, the image stabilization method comprising:

detecting motion data of the image stabilization device;

displaying image data;

calculating, using a computer, a shake coefficient indicating intensity of shaking based on time-series motion data detected in the detecting, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

moving, using the computer, an entire area of the image data displayed in the displaying in a direction of cancelling the shaking in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated in the calculating becomes less than a predetermined first threshold; and

ending, using the computer, the moving in a case that the shake coefficient calculated in the calculating becomes less than a predetermined second threshold that is less than the predetermined first threshold.

13. The image stabilization method according to claim 12 ,

wherein the computer does not move the entire area of the image data displayed in the displaying in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.

14. A non-transitory computer readable medium including executable instructions, which when executed by a computer cause the computer to execute an image stabilization method of an image stabilization device, the image stabilization method comprising:

detecting motion data of the image stabilization device;

displaying image data;

calculating a shake coefficient indicating intensity of shaking based on time-series motion data detected in the detecting, the shake coefficient being an amplitude value obtained in a predetermined frequency domain above a predetermined frequency threshold among the time-series motion data;

moving an entire area of the image data in a direction of cancelling the shaking in a case that the shake coefficient is obtained in the predetermined frequency domain above the predetermined frequency threshold, and the shake coefficient calculated in the calculating becomes less than a predetermined first threshold; and

ending the moving in a case that the shake coefficient calculated in the calculating becomes less than a predetermined second threshold that is less than the predetermined first threshold.

15. The non-transitory computer readable medium according to claim 14 ,

wherein the entire area of the image data is not moved in the direction of cancelling the shaking in a case that the shake coefficient is not obtained in the predetermined frequency domain above the predetermined frequency threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2011
From: OGAWA, NOBUHIRO; SAKAGUCHI, TATSUMI; WATANABE, SHINJI
To: SONY CORPORATION
Reel/Frame 026333/0128 →
Priority Claims (1)
JP 2010-130437 · Jun 7, 2010 · national
Continuity (1)
Related Publication 20110298937A1 · Dec 8, 2011