IP Library Granted Patent US 10,991,107
Granted Patent B2
US 10,991,107 · App. 16/060,875 · Granted Apr 27, 2021

Method for aligning at least one part of one digital image to at least one part of another digital image

Inventors: Guido Schuster (Stäfa, CH); Thorsten Zerfass (Mülheim an der Ruhr, DE); Thomas Unterer (Lachen, CH); Jan Hauth (Kaiserslautern, DE); Maiko Lohel (Hilden, DE)
Assignee: QIAGEN GmbH
G06T7/32G06T3/20G06T2207/10064G06T2207/20021G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,991,107
App. No.
16/060,875
Granted
Apr 27, 2021
Kind
B2
Abstract

The present invention relates to a method and a system for aligning at least one part of a second digital image with at least one part of a first digital image comprising: dividing the at least one part of the first digital image into a plurality of tiles t_fi; dividing the at least one part of the second digital image into a plurality of tiles t_si; creating a plurality of correlation images fci; determining the position of a global maximum correlation value p_ν′ for each of the plurality of correlation images fci_ν′; calculating a plurality of first offset vectors fov, the offset vector fov_ν″ representing the offset between the tile t_siν″ and the corresponding tile t_fiν″; and aligning the at least one part of the second digital image with the at least one part of the first digital image by applying the corresponding first offset vectors fov.

Claims (48)

1. A computer implemented method for aligning at least one part of a second digital image with at least one part of a first digital image, the method comprising:

dividing the at least one part of the first digital image into a first plurality of tiles;

dividing the at least one part of the second digital image into a second plurality of tiles, wherein each tile of the second plurality of tiles corresponds to a tile of the first plurality of tiles;

creating a plurality of correlation images by computing a correlation between each tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles;

determining a position of a global maximum correlation value for each of the plurality of correlation images;

calculating a plurality of offset vectors, wherein each offset vector of the plurality of offset vectors represents an offset between a tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles based on a center position of a corresponding correlation image of the plurality of correlation images and the position of the global maximum correlation value of the corresponding correlation image of the plurality of correlation images; and

aligning the at least one part of the second digital image with the at least one part of the first digital image by applying the plurality of offset vectors.

2. The method according to claim 1 , wherein the first plurality of tiles and the second plurality of tiles fully cover the first and second digital image respectively, and the aligning further comprises:

transforming a position of at least one object in each tile of the first plurality of tiles by applying a corresponding offset vector of the plurality of offset vectors.

3. The method according to claim 2 , wherein the at least one object is a bead configured to receive deoxyribonucleic acid (DNA) or ribonucleic acid (RNA).

4. The method according to claim 1 , wherein the first plurality of tiles and the second plurality of tiles are distributed over the first and second digital image respectively to cover a part of the first and second digital image.

5. The method according to claim 4 , wherein the first plurality of tiles and the second plurality of tiles are equally sized and distributed on a regular grid having a cell size larger than a size of the tiles of the first plurality of tiles and the second plurality of tiles.

6. The method according to claim 4 , further comprising:

assigning each offset vector of the plurality of offset vectors to a predetermined region of a corresponding tile of the first plurality of tiles.

7. The method according to claim 6 , wherein the predetermined region is a center of the corresponding tile of the first plurality of tiles.

8. The method according to claim 4 , further comprising:

performing a regression analysis step to determine parameters of a predetermined function based on an assigned offset vector of the plurality of first offset vectors, and the aligning further comprises:

transforming the second digital image by applying the predetermined function.

9. The method according to claim 8 , wherein the predetermined function is a degree three polynomial function.

10. The method according to claim 2 , wherein the first plurality of tiles and the second plurality of tiles are distributed on the first and second digital image, respectively, to not overlap.

11. The method according to claim 1 , further comprising:

creating a first correlation image by computing a correlation between the at least one part of the first digital image and the at least one part of the second digital image;

determining the position of the global maximum correlation value for the first correlation image; and

calculating an offset vector between the at least one part of the first digital image and the at least one part of the second digital image by considering a center position of the first correlation image and the position of the global maximum correlation value of the first correlation image.

12. The method according to claim 11 , further comprising:

transforming the at least one part of the second digital image by applying the calculated offset vector.

13. The method according to claim 1 , wherein each tile of the first plurality of tiles has a same first length in a first direction and a same second length in a second direction that is perpendicular to the first direction, wherein the first length and the second length are 128 pixels.

14. The method according to claim 13 , wherein each tile of the second plurality of tiles has the first length in the first direction and the second length in the second direction.

15. The method according to claim 1 , wherein the first or the second digital image contains at least one object carrying a fluorescent compound, and wherein the first digital image or the second digital image is obtained by an optical imaging system during emission of electromagnetic radiation by the fluorescent compound.

16. The method according to claim 1 , wherein the first digital image or the second digital image is obtained by an optical imaging system during reflective illumination, preferably during reflective white-light illumination.

17. The method according to claim 1 , wherein the correlation between the tile of the first plurality of tiles and the corresponding tile of the second plurality of tiles is computed by phase-correlation or cross-correlation of the tile of the first plurality of tiles and the corresponding tile of the second plurality of tiles.

18. The method according to claim 11 , wherein the correlation between the at least one part of the first digital image and the at least one part of the second digital image is computed by phase-correlation or cross-correlation of the at least one part of the first digital image and the at least one part of the second digital image.

19. A computer system for aligning at least one part of a second digital image with at least one part of a first digital image, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

divide the at least one part of the first digital image into a first plurality of tiles;

divide the at least one part of the second digital image into a second plurality of tiles, wherein each tile of the second plurality of tiles corresponds to a tile of the first plurality of tiles;

create a plurality of correlation images by computing a correlation between each tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles;

determine a position of a global maximum correlation value for each of the plurality of correlation images; and

calculate a plurality of offset vectors, wherein an offset vector of the plurality of offset vectors represents an offset between a tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles based on a center position of a corresponding correlation image of the plurality of correlation images and the position of the global maximum correlation value of the corresponding correlation image of the plurality of correlation images; and

align the at least one part of the second digital image with the at least one part of the first digital image by applying the plurality of offset vectors.

20. A non-transitory computer readable media having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

dividing at least one part of a first digital image into a first plurality of tiles;

dividing at least one part of a second digital image into a second plurality of tiles, wherein each tile of the second plurality of tiles corresponds to a tile of the first plurality of tiles;

creating a plurality of correlation images by computing a correlation between each tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles;

determining a position of a global maximum correlation value for each of the plurality of correlation images;

calculating a plurality of offset vectors, wherein an offset vector of the plurality of offset vectors represents an offset between a tile of the first plurality of tiles and a corresponding tile of the second plurality of tiles based on a center position of a corresponding correlation image of the plurality of correlation images and the position of the global maximum correlation value of the corresponding correlation image of the plurality of correlation images; and

aligning the at least one part of the second digital image with the at least one part of the first digital image by applying the plurality of offset vectors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2018
From: SCHUSTER, GUIDO; ZERFASS, THORSTEN; UNTERER, THOMAS; HAUTH, JAN; LOHEL, MAIKO
To: QIAGEN GMBH
Reel/Frame 047465/0406 →
Priority Claims (1)
EP 15199409 · Dec 10, 2015 · regional
Continuity (1)
Related Publication 20200273183A1 · Aug 27, 2020