IP Library Granted Patent US 7,893,963
Granted Patent B2
US 7,893,963 · App. 11/134,593 · Granted Feb 22, 2011

Digital camera which estimates and corrects small camera rotations

Assignee: Eastman Kodak Company
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,893,963
App. No.
11/134,593
Granted
Feb 22, 2011
Kind
B2
Abstract

A method of detecting and correcting camera rotation in a digital camera, that includes the steps of: capturing a digital image to provide a captured digital image; and analyzing the captured digital image to detect a set of lines. The set of lines are used to determine a rotation angle of the captured digital image; and the captured digital image is modified based on the rotation angle, before storing the modified digital image.

Claims (51)

1. A method of detecting and correcting a small camera rotation in a digital image captured by a portable hand held digital camera, comprising using a processor to perform the steps of:

a) capturing a digital image of a scene using the portable hand held digital camera to provide a captured digital image, wherein the portable hand held digital camera is not held level during the capture of the digital image, being unintentionally positioned at a small rotation relative to the scene;

b) analyzing the captured digital image to detect a set of lines corresponding to horizontal or vertical structures in the scene;

c) computing at least two parameters representing each individual line in the set of lines;

d) determining a rotation angle of the captured digital image responsive to intersection points determined between two or more lines from the set of lines, wherein the intersection points are determined responsive to the parameters representions of the two or more lines from the set of lines, and wherein the magnitude of the rotation angle is less than or equal to 45 degrees and corresponds to the unintentional small rotation relative to the scene;

e) warping the captured digital image based on the rotation angle; and

f) storing the warped digital image.

2. The method claimed in claim 1 , wherein analyzing the captured digital image includes computing gradient information at a number of locations in the captured digital image.

3. The method claimed in claim 1 , further comprising the step of using a gravitational orientation sensor for determining vertical axis of the captured digital image.

4. The method claimed in claim 3 , wherein step d) above uses the vertical axis to determine the rotation angle.

5. The method claimed in claim 1 , wherein the rotation angle and the warped digital image are stored in a memory of the portable hand held digital camera.

6. The method claimed in claim 5 , wherein the rotation angle and the warped digital image are both stored in an image file.

7. The method claimed in claim 1 , further comprising the step of displaying the warped digital image.

8. The method claimed in claim 7 , further comprising the step of employing a user interface to enable a user to select the captured digital image or the warped digital image for storage.

9. The method claimed in claim 7 , further comprising displaying the captured digital image.

10. The method claimed in claim 1 , further comprising the step of determining a vanishing point location from the set of lines.

11. The method claimed in claim 10 , wherein the rotation angle is computed from the vanishing point location.

12. A method of detecting and correcting a small camera rotation in a digital image captured by a portable hand held digital camera, comprising using a processor to perform the steps of:

a) capturing a digital image of a scene using the portable hand held digital camera to provide a captured digital image, wherein the portable hand held digital camera is not held level during the capture of the digital image, being unintentionally positioned at a small rotation relative to the scene;

b) using a gravitational orientation sensor for determining a vertical axis of the captured digital image

c) analyzing the captured digital image to detect a set of lines corresponding to horizontal or vertical structures in the scene;

d) computing at least two parameters representing each individual line in the set of lines;

e) determining a rotation angle of the captured digital image responsive to intersection points determined between two or more lines from the set of lines, wherein the intersection points are determined responsive to the parameters representions of the two or more lines from the set of lines, and wherein the magnitude of the rotation angle is less than or equal to 45 degrees and corresponds to the unintentional small rotation relative to the scene;

f) warping the captured digital image based on the rotation angle and the vertical axis; and

g) storing the modified digital image.

13. The method claimed in claim 12 wherein step e) above uses the vertical axis to determine the small rotation angle.

14. The method claimed in claim 12 , wherein analyzing the captured digital image includes computing gradient information at a number of locations in the captured digital image.

15. The method claimed in claim 12 , wherein analyzing the captured digital image includes detecting a set of lines in the captured digital image.

16. The method claimed in claim 12 , wherein analyzing the captured digital image includes detecting a vanishing point location.

17. A method of detecting and correcting a small camera rotation in a digital image captured by a portable hand held digital camera, comprising using a processor to perform the steps of:

a) capturing a digital image of a scene using the portable hand held digital camera to provide a captured digital image, wherein the portable hand held digital camera is not held level during the capture of the digital image, being unintentionally positioned at a small rotation relative to the scene;

b) analyzing the captured digital image to detect a set of lines corresponding to horizontal or vertical structures in the scene;

c) computing at least two parameters representing each individual line in the set of lines;

d) determining a rotation angle of the captured digital image responsive to intersection points determined between two or more lines from the set of lines, wherein the intersection points are determined responsive to the parameters representions of the two or more lines from the set of lines, and wherein the magnitude of the rotation angle is less than or equal to 45 degrees and corresponds to the unintentional small rotation relative to the scene;

e) warping the captured digital image based on the rotation angle;

f) displaying the warped digital image;

g) employing a user interface to enable a user to select either the captured digital image or the warped digital image for storage; and

h) storing the selected digital image.

18. The method claimed in claim 17 , wherein the user interface enables the user to selectively display either the captured digital image or the modified digital image.

19. The method claimed in claim 17 , wherein analyzing the captured digital image includes detecting a vanishing point location.

20. A portable hand held digital camera comprising:

a) an image sensor for capturing an image of a scene;

b) a first memory for storing the captured image;

c) a processor for analyzing the captured image to:

i) detect a set of lines corresponding to horizontal or vertical structures in the scene;

ii) compute at least two parameters representing each individual line in the set of lines;

iii) determine a rotation angle of the captured image using the set of line responsive to intersection points determined between two or more lines from the detected set of lines, wherein the intersection points are determined responsive to the parameters representions of the two or more lines from the set of lines, and wherein the magnitude of the rotation angle is less than or equal to 45 degrees and corresponds to unintentional small rotations introduced into the digital image when the portable hand held digital camera is not held level during the capture of a digital image, the portable hand held digital camera being unintentionally positioned at a small rotation relative to the scene; and;

iv) provide a warped image based on the rotation angle;

d) a display for displaying the warped image;

e) a user interface for selecting the warped image or the captured image; and

f) a second memory for storing the selected image.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 030294/0093 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2005
From: GALLAGHER, ANDREW C.; PARULSKI, KENNETH A.
To: EASTMAN KODAK COMPANY
Reel/Frame 016591/0658 →
Continuity (3)
Continuation In Part 09663056 · Sep 15, 2000
Provisional Application 60192400 · Mar 27, 2000
Related Publication 20050212931A1 · Sep 29, 2005