IP Library Granted Patent US 8,953,859
Granted Patent B2
US 8,953,859 · App. 14/138,536 · Granted Feb 10, 2015

Viewing three dimensional digital slides

Inventor: Ole Eichhorn (Westlake Village, CA)
Assignee: Leica Biosystems Imaging, Inc.
G06T15/00G02B21/367G06T15/10G02B21/34G06T2207/30056G06T15/08G06T2207/20224G06T5/50G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,953,859
App. No.
14/138,536
Granted
Feb 10, 2015
Kind
B2
Abstract

Systems and methods for providing a view of a digital slide image. In an embodiment, a digital slide image file is accessed. The digital slide image file may comprise a plurality of first image planes representing an image of at least a portion of a slide specimen at varying focal depths. Then, a three-dimensional object is constructed from the digital slide image file. The three-dimensional image object comprises a plurality of second image planes that are derived from one or more of the first image planes and may comprise at least one image plane that has been interpolated from one or more of the first image planes. In addition, a two-dimensional and/or three-dimensional view of the three-dimensional object may be generated.

Claims (55)

1. A method for providing a view of a digital slide image, the method comprising using at least one hardware processor to:

access at least one digital slide image file, wherein the digital slide image file comprises a plurality of first image planes representing an image of at least a portion of a slide specimen at varying focal depths;

construct a three-dimensional image object from the at least one digital slide image file, wherein the three-dimensional image object comprises a plurality of second image planes derived from one or more of the plurality of first image planes, wherein the plurality of second image planes comprise at least one image plane that has been interpolated from one or more of the plurality of first image planes, and wherein constructing the three-dimensional image object from the at least one digital slide image file comprises,

if one of the plurality of first image planes corresponds to a top surface of the three-dimensional image object, using that first image plane as the top surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the top surface of the three-dimensional image object, interpolating the top surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the top surface,

if one of the plurality of first image planes corresponds to a bottom surface of the three-dimensional image object, using that first image plane as the bottom surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the bottom surface of the three-dimensional image object, interpolating the bottom surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the bottom surface, and

constructing the three-dimensional object using the top surface and the bottom surface; and

generate a view of the three-dimensional image object.

2. The method of claim 1 , further comprising:

receiving a request for the view;

determining a type of view for the view from among a plurality of types of views based on the request, wherein the plurality of types of views comprise a two-dimensional view and a three-dimensional view;

and generating the view of the three-dimensional image object according to the determined type of view.

3. The method of claim 1 , wherein the view is a two-dimensional view.

4. The method of claim 3 , wherein the two-dimensional view is a cross-layer two-dimensional view, and wherein generating the cross-layer two-dimensional view of the three-dimensional image object comprises:

identifying at least three points within the three-dimensional image object that represent a cross-layer two-dimensional plane;

obtaining image data from two or more contiguous ones of the plurality of second image planes of the three-dimensional image object based on the identified at least three points; and

combining the image data from the two or more contiguous second image planes to form the cross-layer two-dimensional view.

5. The method of claim 4 , wherein obtaining image data from two or more contiguous second image planes comprises interpolating image data using one or more of the two or more contiguous second image planes.

6. The method of claim 1 , wherein the view is a three-dimensional view.

7. The method of claim 6 , further comprising receiving a request for the three-dimensional view, wherein the request comprises at least a height, width, and depth, and wherein generating the three-dimensional view of the three-dimensional image object comprises deriving a prism from the three-dimensional image object using the height, width, and depth as a corner of the prism.

8. The method of claim 7 , further comprising providing a plurality of cross-sectional views of the prism.

9. The method of claim 7 , wherein deriving the prism comprises determining a surface of the prism, within the three-dimensional image object, according to an equation.

10. A system for providing a view of a digital slide image, the system comprising:

at least one hardware processor; and

one or more modules that, when executed by the at least one hardware processor,

access at least one digital slide image file, wherein the digital slide image file comprises a plurality of first image planes representing an image of at least a portion of a slide specimen at varying focal depths,

construct a three-dimensional image object from the at least one digital slide image file, wherein the three-dimensional image object comprises a plurality of second image planes derived from one or more of the plurality of first image planes, wherein the plurality of second image planes comprise at least one image plane that has been interpolated from one or more of the plurality of first image planes, and wherein constructing the three-dimensional image object from the at least one digital slide image file comprises,

if one of the plurality of first image planes corresponds to a top surface of the three-dimensional image object, using that first image plane as the top surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the top surface of the three-dimensional image object, interpolating the top surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the top surface,

if one of the plurality of first image planes corresponds to a bottom surface of the three-dimensional image object, using that first image plane as the bottom surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the bottom surface of the three-dimensional image object, interpolating the bottom surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the bottom surface, and

constructing the three-dimensional object using the top surface and the bottom surface, and

generate a view of the three-dimensional image object.

11. The system of claim 10 , wherein the view is a cross-layer two-dimensional view, and wherein generating the cross-layer two-dimensional view of the three-dimensional image object comprises:

identifying at least three points within the three-dimensional image object that represent a cross-layer two-dimensional plane;

obtaining image data from two or more contiguous ones of the plurality of second image planes of the three-dimensional image object based on the identified at least three points; and

combining the image data from the two or more contiguous second image planes to form the cross-layer two-dimensional view.

12. The system of claim 11 , wherein obtaining image data from two or more contiguous second image planes comprises interpolating image data using one or more of the two or more contiguous second image planes.

13. The system of claim 10 , wherein the view is a three-dimensional view, wherein the one or more modules further receive a request for the three-dimensional view, wherein the request comprises at least a height, width, and depth, and wherein generating the three-dimensional view of the three-dimensional image object comprises deriving a prism from the three-dimensional image object using the height, width, and depth as a corner of the prism.

14. A non-transitory computer-readable medium having one or more sequences of instructions stored thereon that, when executed by a processor, cause the processor to:

access at least one digital slide image file, wherein the digital slide image file comprises a plurality of first image planes representing an image of at least a portion of a slide specimen at varying focal depths;

construct a three-dimensional image object from the at least one digital slide image, wherein the three-dimensional image object comprises a plurality of second image planes derived from one or more of the plurality of first image planes, wherein the plurality of second image planes comprise at least one image plane that has been interpolated from one or more of the plurality of first image planes, and wherein constructing the three-dimensional image object from the at least one digital slide image file comprises,

if one of the plurality of first image planes corresponds to a top surface of the three-dimensional image object, using that first image plane as the top surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the top surface of the three-dimensional image object, interpolating the top surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the top surface,

if one of the plurality of first image planes corresponds to a bottom surface of the three-dimensional image object, using that first image plane as the bottom surface for the three-dimensional image object,

if none of the plurality of first image planes correspond to the bottom surface of the three-dimensional image object, interpolating the bottom surface for the three-dimensional image object using at least one of the plurality of first image planes that is nearest to the bottom surface, and

constructing the three-dimensional object using the top surface and the bottom surface; and

generate a view of the three-dimensional image object.

15. The non-transitory computer-readable medium of claim 14 , wherein the view is a cross-layer two-dimensional view, and wherein generating the cross-layer two-dimensional view of the three-dimensional image object comprises:

identifying at least three points within the three-dimensional image object that represent a cross-layer two-dimensional plane;

obtaining image data from two or more contiguous ones of the plurality of second image planes of the three-dimensional image object based on the identified at least three points; and

combining the image data from the two or more contiguous second image planes to form the cross-layer two-dimensional view.

16. The non-transitory computer-readable medium of claim 15 , wherein obtaining image data from two or more contiguous second image planes comprises interpolating image data using one or more of the two or more contiguous second image planes.

17. The non-transitory computer-readable medium of claim 14 , wherein the view is a three-dimensional view, wherein the one or more sequences of instructions further cause the processor to receive a request for the three-dimensional view, wherein the request comprises at least a height, width, and depth, and wherein generating the three-dimensional view of the three-dimensional image object comprises deriving a prism from the three-dimensional image object using the height, width, and depth as a corner of the prism.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2015
From: EICHHORN, OLE
To: APERIO TECHNOLOGIES, INC.
Reel/Frame 034653/0066 →
CHANGE OF NAME Recorded Jan 7, 2015
From: APERIO TECHNOLOGIES, INC.
To: LEICA BIOSYSTEMS IMAGING, INC.
Reel/Frame 034729/0808 →
Continuity (5)
Continuation 13482869 · May 29, 2012
Continuation 12871676 · Aug 30, 2010
Continuation 11341097 · Jan 27, 2006
Provisional Application 60647542 · Jan 27, 2005
Related Publication 20140111509A1 · Apr 24, 2014