Data management in a linear-array-based microscope slide scanner
View Patent ↗Systems and methods for processing, storing, and viewing extremely large imagery data rapidly produced by a linear-array-based microscope slide scanner are provided. The system receives, processes, and stores imagery data produced by the linear scanner as a series of overlapping image stripes and combines the data into a seamless and contiguous baseline image. The baseline image is logically mapped into a plurality of regions that are individually addressed to facilitate viewing and manipulation of the baseline image. The system enables dynamic imagery data compression while scanning and capturing new image stripes that eliminates the overhead associated with storing uncompressed image stripes. The system also creates intermediate level images, thereby organizing the baseline image into a variable level pyramid structure referred to as a virtual slide. The system facilitates the use of virtual slides in applications such as telemedicine, telepathology, microscopy education, and analysis of high value specimens like tissue arrays.
1. A system for capturing imagery data using a line scan camera, the system comprising:
an objective lens positioned for viewing at least a portion of a sample during constant relative motion;
a line scan camera optically coupled to the objective lens and configured to capture imagery data of the sample as a plurality of image stripes; and
at least one processor configured to align two or more of the plurality of image stripes by
buffering at least two adjacent image stripes in a memory, each of the at least two adjacent image stripes comprising an overlap region, the overlap region comprising imagery data from a same region of the sample as imagery data in another of the at least two adjacent image strips, and
performing pattern matching on the overlap regions of the at least two adjacent image stripes by
selecting two or more X-Y offsets of the overlap regions of the at least two adjacent image stripes,
for each of the two or more X-Y offsets, determining a measurement of alignment by
selecting a plurality of pixels from the overlap region of one of the at least two adjacent image stripes,
selecting a subset of one or more of the plurality of pixels having the highest intensity value, and
for each of the X-Y offsets,
for each pixel in the subset of one or more of the plurality of pixels having the highest intensity value, determining a difference between the intensity value of that pixel and an intensity value of a pixel from the overlap region of another one of the at least two adjacent image stripes, and
determining the measurement of alignment based on the determined differences in intensity values, and
selecting one of the two or more X-Y offsets for which the measurement of alignment indicates a maximum correlation between the overlap regions of the at least two adjacent image stripes.
2. The system of claim 1 , wherein determining the measurement of alignment based on the determined differences in intensity values comprises:
for each pixel in the subset of one or more of the plurality of pixels having the highest intensity value, squaring the determined difference in intensity value; and
summing the squared determined differences to generate the measurement of alignment.
3. The system of claim 1 , wherein the at least one processor is configured to align the two or more of the plurality of image stripes while at least one of the plurality of image stripes is being captured.
4. The system of claim 1 , wherein each of the plurality of image stripes comprise two or more color channels, and the at least one processor is further configured to compensate for chromatic aberrations by shifting pixels for at least one of the two or more color channels.
5. The system of claim 1 , wherein the at least one processor is further configured to store a baseline image comprising the plurality of image stripes in a rapid sequential access file.
6. The system of claim 5 , wherein the at least one processor is further configured to:
generate one or more lower resolution images from the baseline image; and
store the one or more lower resolution images in the rapid sequential access file.
7. The system of claim 5 , wherein the at least one processor is configured to store the baseline image in the rapid sequential access file as a plurality of image tiles.
8. A system for capturing imagery data using a line scan camera, the system comprising:
an objective lens positioned for viewing at least a portion of a sample during constant relative motion;
a line scan camera optically coupled to the objective lens and configured to capture imagery data of the sample as a plurality of image stripes, and capture imagery data of a blank area; and
at least one processor configured to
align two or more of the plurality of image stripes, and
perform illumination correction for the plurality of image stripes by,
for each of one or more color channels of the line scan camera, computing an average intensity value for each row of pixels in the imagery data of the blank area,
for each of the one or more color channels and for each row of pixels in the imagery data of the blank area, computing a ratio between a predetermined intensity value and the average intensity value of the row of pixels, and
modifying an intensity of at least one row of pixels in one or more of the plurality of image stripes based on the ratio computed for a corresponding row of pixels in the imagery data of the blank area.
9. The system of claim 8 , wherein the predetermined intensity value is an intensity value that represents white.
10. The system of claim 8 , wherein each of the plurality of image stripes comprise two or more color channels, and the at least one processor is further configured to compensate for chromatic aberrations by shifting pixels for at least one of the two or more color channels.
11. The system of claim 8 , wherein the at least one processor is further configured to store a baseline image comprising the plurality of image stripes in a rapid sequential access file.
12. The system of claim 11 , wherein the at least one processor is further configured to:
generate one or more lower resolution images from the baseline image; and
store the one or more lower resolution images in the rapid sequential access file.
13. The system of claim 11 , wherein the at least one processor is configured to store the baseline image in the rapid sequential access file as a plurality of image tiles.
14. The system of claim 8 , wherein the at least one processor is configured to align the two or more of the plurality of image stripes while at least one of the plurality of image stripes is being captured.
15. A method for capturing imagery data using a line scan camera, the method comprising:
by a line scan camera, capturing imagery data of a sample as a plurality of image stripes; and,
by at least one processor, aligning two or more of the plurality of image stripes by
buffering at least two adjacent image stripes in a memory, each of the at least two adjacent image stripes comprising an overlap region, the overlap region comprising imagery data from a same region of the sample as imagery data in another of the at least two adjacent image stripes, and
performing pattern matching on the overlap regions of the at least two adjacent image stripes by
selecting two or more X-Y offsets of the overlap regions of the at least two adjacent image stripes,
for each of the two or more X-Y offsets, determining a measurement of alignment by
selecting a plurality of pixels from the overlap region of one of the at least two adjacent image stripes,
selecting a subset of one or more of the plurality of pixels having the highest intensity value, and
for each of the X-Y offsets,
for each pixel in the subset of one or more of the plurality of pixels having the highest intensity value, determining a difference between the intensity value of that pixel and an intensity value of a pixel from the overlap region of another one of the at least two adjacent image stripes, and
determining the measurement of alignment based on the determined differences in the intensity values, and
selecting one of the two or more X-Y offsets for which the measurement of alignment indicates a maximum correlation between the overlap regions of the at least two adjacent image stripes.
16. The method of claim 15 , wherein determining the measurement of alignment based on the determined differences in intensity values comprises:
for each pixel in the subset of one or more of the plurality of pixels having the highest intensity value, squaring the determined difference in intensity value; and
summing the squared determined differences to generate the measurement of alignment.
17. The method of claim 15 , wherein the at least one processor aligns the two or more of the plurality of image stripes while at least one of the plurality of image stripes is being captured.
18. The method of claim 15 , wherein each of the plurality of image stripes comprise two or more color channels, and wherein the method further comprises, by the at least one processor, compensating for chromatic aberrations by shifting pixels for at least one of the two or more color channels.
19. The method of claim 15 , further comprising storing a baseline image comprising the plurality of image stripes in a rapid sequential access file.
20. The method of claim 19 , further comprising:
generating one or more lower resolution images from the baseline image; and
storing the one or more lower resolution images in the rapid sequential access file.
21. A method for capturing imagery data using a line scan camera, the method comprising:
by a line scan camera,
capturing imagery data of a blank area, and
capturing imagery data of a sample as a plurality of image stripes; and
by at least one processor,
aligning two or more of the plurality of image stripes, and
performing illumination correction for the plurality of image stripes by
for each of one or more color channels of the line scan camera, computing an average intensity value for each row of pixels in the imagery data of the blank area,
for each of the one or more color channels and for each row of pixels in the imagery data of the blank area, computing a ratio between an intensity value that represents white and the average intensity value of the row of pixels, and
modifying an intensity of at least one row of pixels in one or more of the plurality of image stripes based on the ratio computed for a corresponding row of pixels in the imagery data of the blank area.
22. The method of claim 21 , wherein each of the plurality of image stripes comprise two or more color channels, and wherein the method further comprises, by the at least one processor, compensating for chromatic aberrations by shifting pixels for at least one of the two or more color channels.
23. The method of claim 21 , further comprising storing a baseline image comprising the plurality of image stripes in a rapid sequential access file.
24. The method of claim 23 , further comprising:
generating one or more lower resolution images from the baseline image; and
storing the one or more lower resolution images in the rapid sequential access file.
25. The method of claim 21 , wherein the at least one processor aligns the two or more of the plurality of image stripes while at least one of the plurality of image stripes is being captured.