IP Library Granted Patent US 9,729,749
Granted Patent B2
US 9,729,749 · App. 15/376,202 · Granted Aug 8, 2017

Data management in a linear-array-based microscope slide scanner

Inventors: Greg J. Crandall (Rancho Santa Fe, CA); Ole Eichhorn (Westlake Village, CA); Allen H. Olson (San Diego, CA); Dirk G. Soenksen (Carlsbad, CA)
Assignee: LEICA BIOSYSTEMS IMAGING, INC.
H04N1/1903G02B21/008G02B21/34G02B21/367H04N1/053H04N1/193H04N1/19573H04N5/2256H04N2201/04727H04N2201/04755
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,729,749
App. No.
15/376,202
Granted
Aug 8, 2017
Kind
B2
Abstract

Systems and methods for capturing image data using a line scan camera. In an embodiment, a line scan camera captures image data of a sample as a plurality of image stripes. A processor may coarsely align two or more of the plurality of image stripes according to a synchronization process while the line scan camera is capturing at least one of the plurality of image stripes. Subsequently, the processor may also finely align the two or more image stripes using pattern matching.

Claims (45)

1. A system for capturing image data using a line scan camera, the system comprising:

an objective lens positioned for viewing at least a portion of a sample during constant relative motion;

a line scan camera optically coupled to the objective lens and configured to capture image data of the sample as a plurality of image stripes; and

at least one processor configured to,

while the line scan camera is capturing at least one of the plurality of image stripes of the sample, coarsely align two or more adjacent ones of the plurality of image stripes of the sample, and,

subsequently, finely align the two or more adjacent ones of the plurality of image stripes of the sample by testing a plurality of possible X-Y offset values within overlapping regions of adjacent ones of the two or more image stripes to determine an X-Y offset pair having a maximum correlation, wherein the X-Y offset pair comprises an X-Y offset for a first one of the adjacent image stripes and an X-Y offset for a second one of the adjacent image stripes.

2. The system of claim 1 , further comprising an illumination source, wherein the coarse alignment is performed according to a synchronization process that comprises:

for each of the two or more image stripes, capturing an area comprising an area preceding a predetermined scan area, the scan area, and an area following the scan area, and, during capture by the line scan camera of one or more lines of image data corresponding to a beginning of the scan area, using the illumination source to illuminate the one or more lines of image data; and,

aligning the two or more image stripes based on the illuminated one or more lines of image data in each of the two or more image stripes.

3. The system of claim 2 , wherein the at least one processor, prior to storing each of the two or more image stripes, eliminates, from each image stripe, image data corresponding to the area preceding the scan area and the area following the scan area.

4. The system of claim 2 , wherein the illuminated one or more lines of image data comprise a plurality of lines of image data.

5. The system of claim 1 , further comprising:

a position encoder that indicates a position of the sample; and

a trigger to start and stop capturing of image data by the line scan camera;

wherein coarsely aligning comprises,

when the position encoder indicates that the position of the sample corresponds to a beginning of a predetermined scan area, controlling the trigger to start capture of image data by the line scan camera, and,

when the position encoder indicates that the position of the sample corresponds to an end of the scan area, controlling the trigger to stop capture of image data by the line scan camera.

6. The system of claim 1 , wherein finely aligning further comprises selecting the plurality of possible X-Y offset values by selecting edge pixels within the overlapping regions of the adjacent image stripes.

7. The system of claim 6 , wherein selecting edge pixels within the overlapping regions of the adjacent image stripes comprises:

sorting pixels in the overlapping regions according to intensity gradient values; and

selecting a subset of the sorted pixels having highest intensity gradient values as the edge pixels.

8. The system of claim 1 , wherein the plurality of possible X-Y offset values comprise a range of X values that corresponds to a coarse alignment uncertainty representing a data latency within a synchronization process.

9. The system of claim 8 , further comprising a mechanical stage configured to move the sample relative to the objective lens, wherein the plurality of possible X-Y offset values comprise a range of Y values that corresponds to a mechanical motion uncertainty of the mechanical stage.

10. A method for capturing image data using a line scan camera, the method comprising:

by a line scan camera, capturing image data of a sample as a plurality of image stripes; and,

by at least one processor,

while the line scan camera is capturing at least one of the plurality of image stripes of the sample, coarsely aligning two or more adjacent ones of the plurality of image stripes of the sample, and,

subsequently, finely aligning the two or more adjacent ones of the plurality of image stripes of the sample by testing a plurality of possible X-Y offset values within overlapping regions of adjacent ones of the two or more image stripes to determine an X-Y offset pair having a maximum correlation, wherein the X-Y offset pair comprises an X-Y offset for a first one of the adjacent image stripes and an X-Y offset for a second one of the adjacent image stripes.

11. The method of claim 10 , wherein the coarse alignment is performed according to a synchronization process that comprises:

for each of the two or more image stripes, capturing an area comprising an area preceding a predetermined scan area, the scan area, and an area following the scan area, and, during capture by the line scan camera of one or more lines of image data corresponding to a beginning of the scan area, using an illumination source to illuminate the one or more lines of image data; and,

aligning the two or more image stripes based on the illuminated one or more lines of image data in each of the two or more image stripes.

12. The method of claim 11 , further comprising:

eliminating, from each image stripe, image data corresponding to the area preceding the scan area and the area following the scan area; and

storing each of the two or more image stripes without the eliminated image data.

13. The method of claim 11 , wherein the illuminated one or more lines of image data comprise a plurality of lines of image data.

14. The method of claim 10 , wherein the synchronization process comprises:

by a position encoder, indicating a position of the sample;

when the position encoder indicates that the position of the sample corresponds to a beginning of a predetermined scan area, controlling a trigger to start capture of image data by the line scan camera, and,

when the position encoder indicates that the position of the sample corresponds to an end of the scan area, controlling the trigger to stop capture of image data by the line scan camera.

15. The method of claim 10 , wherein finely aligning further comprises selecting the plurality of possible X-Y offset values by selecting edge pixels within the overlapping regions of the adjacent image stripes.

16. The method of claim 15 , wherein selecting edge pixels within the overlapping regions of the adjacent image stripes comprises:

sorting pixels in the overlapping regions according to intensity gradient values; and

selecting a subset of the sorted pixels having highest intensity gradient values as the edge pixels.

17. The method of claim 10 , wherein the plurality of possible X-Y offset values comprise a range of X values that corresponds to a coarse alignment uncertainty representing a data latency within a synchronization process.

18. The method of claim 17 , wherein the plurality of possible X-Y offset values comprise a range of Y values that corresponds to a mechanical motion uncertainty of a mechanical stage configured to move the sample.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2016
From: CRANDALL, GREG J.; EICHHORN, OLE; OLSON, ALLEN H.; SOENKSEN, DIRK G.
To: APERIO TECHNOLOGIES, INC.
Reel/Frame 040714/0394 →
CHANGE OF NAME Recorded Dec 12, 2016
From: APERIO TECHNOLOGIES, INC.
To: LEICA BIOSYSTEMS IMAGING, INC.
Reel/Frame 040887/0146 →
Continuity (9)
Continuation 14275084 · May 12, 2014
Continuation 13347077 · Jan 10, 2012
Continuation 13114998 · May 24, 2011
Continuation 12914356 · Oct 28, 2010
Continuation 12235479 · Sep 22, 2008
Continuation 11379648 · Apr 21, 2006
Continuation 10371586 · Feb 21, 2003
Continuation In Part 09563437 · May 3, 2000
Related Publication 20170094095A1 · Mar 30, 2017