Systems and methods to process electronic images to provide improved visualization and rendering of histopathology slides
A method for processing an electronic image including receiving, by a viewer, the electronic image and a FOV (field of view), wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, loading, by the viewer, a plurality of tiles within the FOV, determining, by the viewer, a state of the plurality of tiles in a cache, and in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the viewer, the plurality of tiles to a display.
1. A computer-implemented method for processing an electronic image, the method comprising:
receiving, by a slide viewer running on a web browser, the electronic image and a field of view (FOV) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting one or more electronic images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more electronic images.
2. The computer-implemented method of claim 1 , wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.
3. The computer-implemented method of claim 1 , further comprising:
loading, by the slide viewer, the one or more electronic images of the one or more second tiles based on requesting the one or more images.
4. The computer-implemented method of claim 3 , wherein the loading of the one or more electronic images further comprises:
loading, by the slide viewer, the one or more electronic images into the cache.
5. The computer-implemented method of claim 1 , further comprising:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more images and do not have the one or more textures in the cache.
6. The computer-implemented method of claim 1 , further comprising:
pruning, by the slide viewer, the cache of one or more unused electronic images or textures for the one or more second tiles prior to rendering the plurality of tiles.
7. The computer-implemented method of claim 1 , wherein the slide viewer comprises at least one of:
the cache,
a core processor,
a renderer, or
a loader.
8. A computer system for processing an electronic image, the computer system comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to perform operations comprising:
receiving, by a slide viewer, the electronic image and a field of view (FOV), wherein the FOV of the electronic image includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting, by the slide viewer, one or more electronic images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more electronic images.
9. The computer system of claim 8 , wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.
10. The computer system of claim 8 , wherein the operations further comprise:
loading, by the slide viewer, the one or more electronic images of the one or more second tiles based on requesting the one or more electronic images.
11. The computer system of claim 10 , wherein the loading of the one or more electronic images further comprises:
loading, by the slide viewer, the one or more electronic images into the cache.
12. The computer system of claim 8 , wherein the operations further comprise:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more electronic images and do not have the one or more textures in the cache.
13. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations for processing an electronic image, the operations comprising:
receiving, by a slide viewer, the electronic image and a field of view (FOV) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;
loading, by the slide viewer and from a cache of the slide viewer, one or more first tiles of a plurality of tiles within the FOV;
determining, by the slide viewer, that one or more second tiles of the plurality of tiles within the FOV are not in the cache;
requesting, by the slide viewer, one or more images of the one or more second tiles based on the determining;
determining, by the slide viewer and after requesting the one or more electronic images, that the one or more second tiles have the one or more electronic images and do not have one or more textures in the cache; and
rendering, by the slide viewer, the plurality of tiles to a display after requesting the one or more images.
14. The non-transitory computer-readable medium of claim 13 , wherein the loading of the one or more first tiles further comprises:
loading, by the slide viewer, the one or more first tiles from the cache in one or more groups in an order of priority based on the magnification factor of the FOV or based on a magnification level of the one or more first tiles.
15. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise:
loading, by the slide viewer, the one or more textures for the one or more second tiles to a graphics processing unit (GPU) of the slide viewer based on determining that the one or more second tiles have the one or more electronic images and do not have the one or more textures in the cache.
16. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise:
pruning the cache of one or more unused electronic images or textures for the one or more second tiles prior to rendering the plurality of tiles.
17. The non-transitory computer-readable medium of claim 13 , wherein the slide viewer comprises at least one of:
the cache,
a core processor,
a renderer, or
a loader.