IP Library Granted Patent US 7,162,102
Granted Patent B2
US 7,162,102 · App. 10/025,357 · Granted Jan 9, 2007

Method and system for compositing images to produce a cropped image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,162,102
App. No.
10/025,357
Granted
Jan 9, 2007
Kind
B2
Abstract

A method for producing a cropped digital image, includes the steps of: providing a plurality of partially overlapping source digital images; providing a cropping aspect ratio L:H, the cropping aspect ratio being the ratio of the length to the height of the cropped digital image; providing a cropping criterion, the cropping criterion being a criterion for the size and location of the cropped digital image; combining the source digital images to form a composite digital image; selecting the cropping region of the composite digital image according to the cropping criterion, said cropping region being a rectangular region having aspect ratio L:H, and having size and location determined by the cropping criterion; and, cropping the composite digital image to the cropping region to form a cropped digital image.

Claims (79)

1. A method for producing a cropped digital image, comprising the steps of:

providing a plurality of partially overlapping source digital images;

providing a cropping aspect ratio L:H, the cropping aspect ratio being the ratio of the length to the height of the cropped digital image;

providing a cropping criterion, the cropping criterion being a criterion for the size and location of the cropped digital image;

combining the source digital images to form a composite digital image;

automatically selecting the cropping region of the composite digital image according to the cropping criterion, said cropping region being a rectangular region having said aspect ratio L:H, and having size and location determined by the cropping criterion; and,

cropping the composite digital image to the cropping region to form a cropped digital image;

wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of one of the sets:

a) the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the composite digital image; and

b) the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the main subject of the composite digital image.

2. The method claimed in claim 1 , wherein the step of providing source digital images further comprises the step of digitizing source photographic images to form source digital images.

3. The method claimed in claim 1 , further comprising the step of:

resizing the cropped digital image for display.

4. The method claimed in claim 1 , further comprising the step of:

resizing the cropped digital image for hardcopy output.

5. The method claimed in claim 1 , further comprising the step of:

transforming the pixel values of the cropped digital image to an output device compatible color space.

6. The method claimed in claim 1 , wherein the step of combining source digital images further comprises the steps of:

i) warping the source digital images to compensate for distortion due to perspective projection, yielding warped digital images;

ii) aligning the warped digital images to identify overlapping regions; and

iii) blending the warped digital images in the overlapping regions to form a composite digital image.

7. The method claimed in claim 6 , wherein the step of blending warped digital images includes calculating a weighted average of the pixel values in the overlapping region.

8. The method claimed in claim 6 , wherein the step of blending warped digital images further comprises the steps of:

i) projecting the warped digital images to simulate image capture on parallel image planes, forming projected digital images;

ii) morphing the projected digital images in the overlapping regions to form a projected composite digital image;

iii) choosing viewing parameters for a composite digital image; and,

iv) re-projecting the projected composite digital image to simulate image capture with the chosen viewing parameters, forming a composite digital image.

9. The method claimed in claim 1 , wherein the step of combining source digital images further comprises warping the composite digital image to simulate projection onto a geometrical surface suitable for viewing.

10. The method claimed in claim 1 , wherein the aspect ratio is a portrait aspect ratio and a landscape aspect ratio.

11. The method claimed in claim 1 , wherein the aspect ratio is one of: 3:2, 16:9, 3:1, 2:3, 9:16, and 1:3.

12. The method claimed in claim 1 , wherein the aspect ratio is included as meta-data with at least one of the source digital images.

13. A computer program product stored on a computer readable medium for performing the method of claim 1 .

14. The method of claim 1 wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the composite digital image.

15. The method of claim 1 wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the main subject of the composite digital image.

16. The method of claim 1 wherein the source digital images have pixel values that are linearly or logarithmically related to scene intensity and the step of providing source digital images further comprises applying a metric exposure transform to a source digital image, wherein said exposure transform changes the pixel values of the source digital image such that, following said applying, the pixel values of the source digital image are linearly or logarithmically related to scene intensity.

17. A method for producing a cropped digital image, comprising the steps of:

a) providing a plurality of partially overlapping source digital images;

b) providing a cropping aspect ratio L:H, the cropping aspect ratio being the ratio of the length to the height of the cropped digital image;

c) providing a cropping criterion, the cropping criterion being a criterion for the size and location of the cropped digital image;

d) combining the source digital images to form a composite digital image;

e) automatically selecting the cropping region of the composite digital image according to the cropping criterion, said cropping region being a rectangular region having said aspect ratio L:H, and having size and location determined by the cropping criterion; and,

f) cropping the composite digital image to the cropping region to form a cropped digital image;

wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the composite digital image;

and wherein the source digital images have pixel values that are linearly or logarithmically related to scene intensity and the step of providing source digital images further comprises applying a metric exposure transform to a source digital image such that the pixel values of the source digital image are changed by said transform and are linearly or logarithmically related to scene intensity.

18. A method for producing a cropped digital image, comprising the steps of:

providing a plurality of partially overlapping source digital images;

providing a cropping aspect ratio L:H, the cropping aspect ratio being the ratio of the length to the height of the cropped digital image;

providing a cropping criterion, the cropping criterion being a criterion for the size and location of the cropped digital image;

combining the source digital images to form a composite digital image;

computing a main subject of the composite digital image;

automatically selecting the cropping region of the composite digital image according to the cropping criterion, said cropping region being a rectangular region having said aspect ratio L:H, and having size and location determined by the cropping criterion; and,

cropping the composite digital image to the cropping region to form a cropped digital image;

wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the main subject of the composite digital image.

19. The method claimed in claim 5 , wherein the source digital images have pixel values that are linearly or logarithmically related to scene intensity.

20. The method claimed in claim 19 , wherein the step of providing source digital images further comprises applying a metric transform to a source digital image such that the pixel values of the source digital image changed by said transform are linearly or logarithmically related to scene intensity.

21. The method claimed in claim 19 , wherein the step of providing source digital images further comprises applying linear exposure transform(s) to one or more of the source digital images, wherein said transform(s) produce source digital images having pixel values that closely match in an overlapping region.

22. The method claimed in claim 19 , wherein the step of providing source digital images further comprises applying radial exposure transform(s) to one or more of the source digital images to compensate for exposure falloff.

23. The method of claim 18 wherein said computing is automatic using a reasoning engine.

24. A system for producing a cropped digital image, comprising:

a plurality of partially overlapping source digital images;

means for specifying a cropping aspect ratio L:H, the cropping aspect ratio being the ratio of the length to the height of the cropped digital image;

means for specifying a cropping criterion, the cropping criterion being a criterion for the size and location of the cropped digital image;

means for combining the source digital images to form a composite digital image;

means for automatically computing a main subject of the composite digital image using a reasoning engine;

means for automatically selecting the cropping region of the composite digital image according to the cropping criterion, said cropping region being a rectangular region having said aspect ratio L:H, and having size and location determined by the cropping criterion; and,

means for cropping the composite digital image to the cropping region to form a cropped digital image

wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of:

the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the main subject of the composite digital image.

25. A method for producing a cropped digital image, comprising the steps of:

providing a plurality of partially overlapping source digital images;

providing a cropping aspect ratio;

providing a cropping criterion, said cropping criterion being a criterion for a size and location of the cropped digital image;

combining said source digital images to form a composite digital image;

automatically selecting a cropping region of said composite digital image according to said cropping criterion, said cropping region being a rectangular region having said aspect ratio, and said size and said location determined by said cropping criterion; and,

cropping said composite digital image to said cropping region;

wherein the cropping criterion specifies that the cropped digital image is the composite digital image region that is largest in area of one of the sets:

a) the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the composite digital image; and

b) the set of all composite digital image regions having said aspect ratio L:H that are centered at the centroid of the main subject of the composite digital image

and wherein the source digital images have pixel values that are linearly or logarithmically related to scene intensity and the step of providing source digital images further comprises applying a metric exposure transform to a source digital image such that the pixel values of the source digital image are changed by said transform and are linearly or logarithmically related to scene intensity.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Aug 15, 2023
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 064599/0304 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: INTELLECTUAL VENTURES FUND 83 LLC
To: MONUMENT PEAK VENTURES, LLC
Reel/Frame 041941/0079 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2013
From: EASTMAN KODAK COMPANY
To: INTELLECTUAL VENTURES FUND 83 LLC
Reel/Frame 030387/0571 →
PATENT RELEASE Recorded Feb 1, 2013
From: CITICORP NORTH AMERICA, INC.; WILMINGTON TRUST, NATIONAL ASSOCIATION
To: EASTMAN KODAK COMPANY; EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC.; FAR EAST DEVELOPMENT LTD.; KODAK (NEAR EAST), INC.; KODAK AMERICAS, LTD.; KODAK PORTUGUESA LIMITED; KODAK REALTY, INC.; LASER-PACIFIC MEDIA CORPORATION; KODAK AVIATION LEASING LLC; KODAK PHILIPPINES, LTD.; NPEC INC.; FPC INC.; KODAK IMAGING NETWORK, INC.; PAKON, INC.; QUALEX INC.; CREO MANUFACTURING AMERICA LLC
Reel/Frame 029913/0001 →
SECURITY INTEREST Recorded Feb 21, 2012
From: EASTMAN KODAK COMPANY; PAKON, INC.
To: CITICORP NORTH AMERICA, INC., AS AGENT
Reel/Frame 028201/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2001
From: CAHILL, NATHAN D.; RAY, LAWRENCE A.
To: EASTMAN KODAK COMPANY
Reel/Frame 012402/0430 →