IP Library Granted Patent US 8,983,230
Granted Patent B2
US 8,983,230 · App. 13/810,940 · Granted Mar 17, 2015

Global error minimization in image mosaicking using graph laplacians and its applications in microscopy

Inventors: Parmeshwar Khurd (Princeton, NJ); Rafiou Oketokoun (North Reading, MA); Ali Kamen (Skillman, NJ); Leo Grady (Millbrae, CA); Hari Sundar (Austin, TX); John V. Frangioni (Wayland, MA); Tejas Gajera (Lawrenceville, NJ)
Assignees: Siemens Corporation; Beth Israel Deaconess Medical Center
G06T11/60G06T3/0068G06T3/4038G06T2207/10056G06T7/0026G06T2200/32G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,983,230
App. No.
13/810,940
Granted
Mar 17, 2015
Kind
B2
Abstract

An image mosaicking method includes performing pairwise registration of a plurality of tiles ( 101 ), determining absolute homographies for each of the plurality of tiles according to the pairwise registration ( 102 B), and performing a blending of the plurality of tiles to obtain a stitched image according to the absolute homographies ( 103 ).

Claims (154)

1. A non-transitory computer-readable storage medium with an executable program stored thereon, wherein the program instructs a microprocessor to perform an image mosaicking method, the method comprising:

performing pairwise registration of a plurality of tiles;

receiving prior homography information for each of the plurality of tiles;

determining absolute homographies for each of the plurality of tiles according to the pairwise registration by minimizing a following objective function

E

(

p

1

,

,

p

N

)

=

1

2

i

=

1

N

j

Nbd

(

i

)

p

i

-

p

j

-

p

~

ij

2

+

λ

2

i

=

1

N

p

i

-

p

~

i

2

,

wherein N is a number of tiles, Nbd(i) denote a set of tiles that share any overlap with tile i, p i denotes a homography of tile i, {tilde over (p)} ij denotes a translation obtained by applying the pairwise registration between neighboring tiles i and j, {tilde over (p)} i denotes the prior homography of tile i, and λ denotes a predetermined weighting for the prior homography; and

performing a blending of the plurality of tiles to obtain a stitched image according to the absolute homographies.

2. The computer-readable storage medium of claim 1 , wherein performing the pairwise registration comprises maximizing a similarity measure.

3. The computer-readable storage medium of claim 1 , wherein determining the absolute homographies for each of the plurality of tiles comprises revising the pairwise registration according to an objective function for an edge incidence matrix of the plurality of tiles.

4. The computer-readable storage medium of claim 1 , wherein performing the blending comprises an alpha-blending approach wherein a weight alpha is determined by raising a normalized distance of a pixel from an edge of its tile to an exponent.

5. The computer-readable storage medium of claim 1 , wherein determining the absolute homographies for each tile comprises solving a linear system such that a global measure of registration is minimized.

6. The computer-readable storage medium of claim 1 , wherein determining the absolute homographies for each tile comprises determining connected components given the pairwise registration of the plurality of tiles.

7. A computer-implemented method of performing image mosaicking, the method performed by the computer comprising the steps of:

performing pairwise registration of a plurality of tiles;

receiving prior homography information for each of the plurality of tiles;

determining absolute homographies for each of the plurality of tiles according to the pairwise registration by minimizing a following objective function

E

(

p

1

,

,

p

N

)

=

1

2

i

=

1

N

j

Nbd

(

i

)

p

i

-

p

j

-

p

~

ij

2

+

λ

2

i

=

1

N

p

i

-

p

~

i

2

,

wherein N is a number of tiles, Nbd(i) denote a set of tiles that share any overlap with tile i, p i denotes a homography of tile i, {tilde over (p)} ij denotes a translation obtained by applying the pairwise registration between neighboring tiles i and j, {tilde over (p)} i denotes the prior homography of tile i, and λ denotes a predetermined weighting for the prior homography; and

performing a blending of the plurality of tiles to obtain a stitched image according to the absolute homographies.

8. The method of claim 7 , wherein performing the pairwise registration comprises maximizing a similarity measure.

9. The method of claim 7 , wherein determining the absolute homographies for each of the plurality of tiles comprises revising the pairwise registration according to an objective function for an edge incidence matrix of the plurality of tiles.

10. The method of claim 7 , wherein performing the blending comprises an alpha-blending approach wherein a weight alpha is determined by raising a normalized distance of a pixel from an edge of its tile to an exponent.

11. The method of claim 7 , wherein determining the absolute homographies for each tile comprises solving a linear system such that a global measure of registration is minimized.

12. The method of claim 7 , wherein determining the absolute homographies for each tile comprises determining connected components given the pairwise registration of the plurality of tiles.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2026
From: SIEMENS CORPORATION
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 073918/0483 →
CONFIRMATORY LICENSE Recorded Jan 29, 2015
From: BETH ISRAEL DEACONESS MEDICAL CENTER
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 034843/0641 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2013
From: KHURD, PARMESHWAR; KAMEN, ALI; GRADY, LEO; SUNDAR, HARI
To: SIEMENS CORPORATION
Reel/Frame 030643/0317 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2013
From: OKETOKOUN, RAFIOU; FRANGIONI, JOHN V.; GAJERA, TEJAS
To: BETH ISRAEL DEACONESS MEDICAL CENTER
Reel/Frame 030436/0281 →
Continuity (2)
Provisional Application 61367484 · Jul 26, 2010
Related Publication 20130243352A1 · Sep 19, 2013