IP Library Granted Patent US 11,416,963
Granted Patent B2
US 11,416,963 · App. 17/398,388 · Granted Aug 16, 2022

Systems and methods to process electronic images to provide improved visualization and rendering of histopathology slides

Inventors: Alexandre Kirszenberg (New York, NY); Razik Yousfi (New York, NY); Thomas Fresneau (New York, NY); Peter Schueffler (New York, NY)
Assignee: PAIGE.AI, INC.
G06T1/60G06T7/0012G06V20/69H04N5/2259H04N5/23293H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,416,963
App. No.
17/398,388
Granted
Aug 16, 2022
Kind
B2
Abstract

A method for processing an electronic image including receiving, by a viewer, the electronic image and a FOV (field of view), wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, loading, by the viewer, a plurality of tiles within the FOV, determining, by the viewer, a state of the plurality of tiles in a cache, and in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the viewer, the plurality of tiles to a display.

Claims (68)

1. A computer-implemented method for processing an electronic image, the method comprising:

receiving, by a slide viewer running on a web browser, the electronic image and a FOV (field of view) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;

loading, by the slide viewer, a plurality of tiles within the FOV;

determining, by the slide viewer, a state of loading of the plurality of tiles in a cache from a storage device;

determining, by the slide viewer, whether the cache has a maximum occupancy;

in response to determining that the cache has the maximum occupancy, sorting, by the slide viewer, the cache based on the FOV; and

in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the slide viewer, the plurality of tiles to a display.

2. The computer-implemented method of claim 1 , further comprising:

determining, by the slide viewer, that the state of loading of a tile of the plurality of tiles in the cache is a tile request state;

in response to the determining, sending, by the slide viewer, the tile request state to a tile server;

receiving, by the slide viewer, a data transfer from the tile server, the data transfer responsive to the tile server receiving the tile request state, wherein the data transfer includes tile data corresponding to the tile of the plurality of tiles;

moving, by the slide viewer, the tile of the plurality of tiles to the fully loaded state; and

rendering, by the slide viewer, the plurality of tiles.

3. The computer-implemented method of claim 1 , wherein receiving the electronic image includes loading, by the slide viewer, a set of tiles into the cache at a lower magnification level than a default magnification level for display.

4. The computer-implemented method of claim 1 , the loading the plurality of tiles within the FOV of the electronic image further comprising:

determining, by the slide viewer, whether the cache stores a tile of the plurality of tiles;

in response to determining that the cache stores the tile, determining, by the slide viewer, whether the tile has a magnification level equal or greater than the magnification factor; and

in response to determining that the tile does have the magnification level equal or greater than the magnification factor, loading, by the slide viewer, the tile from the cache.

5. The computer-implemented method of claim 4 , further comprising:

in response to determining that the tile does not have the magnification level equal or greater than the magnification factor, retrieving, by the slide viewer, a stored tile corresponding to the tile of the plurality of tiles, where the stored tile has a highest stored magnification level.

6. The computer-implemented method of claim 1 , wherein the electronic image is a WSI (whole slide image).

7. The computer-implemented method of claim 6 , wherein the WSI includes a pyramidal structure of a plurality of images, the pyramidal structure of the plurality of images including at least one WSI magnification level, wherein the at least one WSI magnification level includes a set of tiles corresponding to the magnification factor.

8. The computer-implemented method of claim 1 , the sorting the cache based on the FOV of the electronic image further comprising:

leaving, by the slide viewer, at least one tile of the plurality of tiles stored in the cache, the leaving according to an order of priority, wherein the leaving continues until the cache is at or below the maximum occupancy; and

in response to determining that the cache is at or below the maximum occupancy, removing, by the slide viewer, any remaining tiles of the plurality of tiles from the cache.

9. The computer-implemented method of claim 8 , wherein the order of priority includes a FOV tile with a magnification level equal or greater than the magnification factor, a FOV bordering tile with the magnification level equal or greater than the magnification factor, a plurality of FOV tiles with the magnification level less than the magnification factor in a descending magnification level order, and at least one other tile.

10. A computer system for processing an electronic image, the computer system comprising:

at least one memory storing instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

receiving, by a slide viewer running on a web browser, the electronic image and a FOV (field of view) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;

loading, by the slide viewer, a plurality of tiles within the FOV of the electronic image, the loading further comprising:

determining, by the slide viewer, whether a cache stores a tile of the plurality of tiles;

in response to determining that the cache stores the tile, determining, by the slide viewer, whether the tile has a magnification level equal or greater than the magnification factor; and

in response to determining that the tile does have the magnification level equal or greater than the magnification factor, loading, by the slide viewer, the tile from the cache and in response to determining that the tile does not have the magnification level equal or greater than the magnification factor, retrieving, by the slide viewer, a stored tile corresponding to the tile of the plurality of tiles, where the stored tile has a highest stored magnification level;

determining, by the slide viewer, a state of loading of the plurality of tiles in a cache from a storage device; and

in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the slide viewer, the plurality of tiles to a display.

11. The computer system of claim 10 , further comprising:

determining, by the slide viewer, that the state of loading of a tile of the plurality of tiles in the cache is a tile request state;

in response to the determining, sending, by the slide viewer, the tile request state to a tile server;

receiving, by the slide viewer, a data transfer from the tile server, the data transfer responsive to the tile server receiving the tile request state, wherein the data transfer includes tile data corresponding to the tile of the plurality of tiles;

moving, by the slide viewer, the tile of the plurality of tiles to the fully loaded state; and

rendering, by the slide viewer, the plurality of tiles.

12. The computer system of claim 10 , wherein receiving the electronic image includes loading, by the slide viewer, a set of tiles into the cache at a lower magnification level than a default magnification level for display.

13. The computer system of claim 10 , wherein the electronic image is a WSI (whole slide image).

14. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations for processing an electronic image, the operations comprising:

receiving, by a slide viewer running on a web browser, the electronic image and a FOV (field of view) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;

loading, by the slide viewer, a plurality of tiles within the FOV;

determining, by the slide viewer, a state of loading of the plurality of tiles in a cache from a storage device;

determining, by the slide viewer, whether the cache has a maximum occupancy; and

in response to determining that the cache has the maximum occupancy, sorting, by the slide viewer, the cache based on the FOV; and

in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the slide viewer, the plurality of tiles to a display.

15. The non-transitory computer-readable medium of claim 14 , the sorting the cache based on the FOV of the electronic image further comprising:

leaving, by the slide viewer, at least one tile of the plurality of tiles stored in the cache, the leaving according to an order of priority, wherein the leaving continues until the cache is at or below the maximum occupancy; and

in response to determining that the cache is at or below the maximum occupancy, removing, by the slide viewer, any remaining tiles of the plurality of tiles from the cache.

16. The non-transitory computer-readable medium of claim 15 , wherein the order of priority includes a FOV tile with a magnification level equal or greater than the magnification factor, a FOV bordering tile with the magnification level equal or greater than the magnification factor, a plurality of FOV tiles with the magnification level less than the magnification factor in a descending magnification level order, and at least one other tile.

17. A computer-implemented method for processing an electronic image, the method comprising:

receiving, by a slide viewer running on a web browser, the electronic image and a FOV (field of view) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor;

loading, by the slide viewer, a plurality of tiles within the FOV, the loading further comprising:

determining, by the slide viewer, whether a cache stores a tile of the plurality of tiles;

in response to determining that the cache stores the tile, determining, by the slide viewer, whether the tile has a magnification level equal or greater than the magnification factor; and

in response to determining that the tile does have the magnification level equal or greater than the magnification factor, loading, by the slide viewer, the tile from the cache and in response to determining that the tile does not have the magnification level equal or greater than the magnification factor, retrieving, by the slide viewer, a stored tile corresponding to the tile of the plurality of tiles, where the stored tile has a highest stored magnification level;

determining, by the slide viewer, a state of loading of the plurality of tiles in a cache from a storage device; and

in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the slide viewer, the plurality of tiles to a display.

18. A computer-implemented method for processing an electronic image, the method comprising:

receiving, by a slide viewer running on a web browser, the electronic image and a FOV (field of view) of the electronic image, wherein the FOV includes at least one coordinate, at least one dimension, and a magnification factor, wherein the electronic image is a WSI (whole slide image), wherein the WSI includes a pyramidal structure of a plurality of images, the pyramidal structure of the plurality of images including at least one WSI magnification level, wherein the at least one WSI magnification level includes a set of tiles corresponding to the magnification factor;

loading, by the slide viewer, a plurality of tiles within the FOV;

determining, by the slide viewer, a state of loading of the plurality of tiles in a cache from a storage device; and

in response to determining that the state of the plurality of tiles in the cache is a fully loaded state, rendering, by the slide viewer, the plurality of tiles to a display.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: PAIGE.AI, INC.
Reel/Frame 075589/0752 →
SECURITY INTEREST Recorded Oct 21, 2025
From: PAIGE.AI, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073216/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2021
From: KIRSZENBERG, ALEXANDRE; YOUSFI, RAZIK; FRESNEAU, THOMAS; SCHUEFFLER, PETER
To: PAIGE.AI, INC.
Reel/Frame 057739/0209 →
Continuity (2)
Provisional Application 63064401 · Aug 11, 2020
Related Publication 20220051364A1 · Feb 17, 2022