IP Library Granted Patent US 11,210,787
Granted Patent B1
US 11,210,787 · App. 17/377,260 · Granted Dec 28, 2021

Systems and methods for processing electronic images

Inventors: Ran Godrich (New York, NY); Jillian Sue (New York, NY); Leo Grady (Darien, CT); Thomas Fuchs (New York, NY)
Assignee: Paige.AI, Inc.
G06T7/0012G06N20/00G16H50/20G06T2207/10056G06T2207/20081G06T2207/30024G06T2207/30096G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,210,787
App. No.
17/377,260
Granted
Dec 28, 2021
Kind
B1
Abstract

An image processing method including receiving a target image of a slide corresponding to a target specimen comprising a tissue sample of a patient; generating a machine learning system by processing a plurality of training images, each training image comprising an image of human tissue and a label characterizing at least one of a slide morphology, a diagnostic value, a pathologist review outcome, and an analytic difficulty; automatically identifying, using the machine learning system, an area of interest of the target image by analyzing microscopic features extracted from multiple image regions in the target image; determining, using the machine learning system, a probability of a target feature being present in the area of interest of the target image based on an average probability; and determining, using the machine learning system, a prioritization value, of a plurality of prioritization values.

Claims (45)

1. An image processing method, comprising:

receiving a target image of a slide corresponding to a target specimen comprising a tissue sample of a patient;

generating a machine learning system by processing a plurality of training images, each training image comprising an image of human tissue and a diagnostic label characterizing at least one of a slide morphology, a diagnostic value, a pathologist review outcome, and an analytic difficulty;

automatically identifying, using the machine learning system, an area of interest of the target image by analyzing microscopic features extracted from multiple image regions in the target image;

determining, using the machine learning system, a probability of a target feature being present in the area of interest of the target image based on an average probability;

determining, using the machine learning system, a prioritization value, of a plurality of prioritization values, of the target image based on the probability of the target feature being present in the target image, the prioritization value comprising a first prioritization value determined based on preferences of a first user and a second prioritization value determined based on preferences of a second user;

upon determining that the target feature comprises a feature in the target image indicating that further preparation is to be performed, then preparing a new slide for the target image prior to a user review;

outputting, using the machine learning system, a plurality of digitized pathology images; and

ordering, using the machine learning system, the digitized pathology images based on the plurality of prioritization values associated with the digitized pathology images, and a placement of the target image based on the prioritization value of the target image based on the target feature.

2. The method of claim 1 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

3. The method of claim 1 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

4. The method of claim 3 , wherein the further preparation is performed by preparing a new slide for the target image based on at least one of a specimen recut, an immunohistochemical stain, additional diagnostic testing, additional consultation, and/or a special stain, being performed prior to a user review.

5. The method of claim 1 , wherein the diagnostic label comprises a diagnostic feature of the target image.

6. The method of claim 5 , the diagnostic feature comprising at least one of cancer presence, cancer grade, treatment effects, precancerous lesions, biomarkers for treatment selection, and/or presence of infectious organisms.

7. The method of claim 1 , wherein the diagnostic label comprises an artifact label corresponding to at least one of scanning lines, missing tissue, and/or blur.

8. An image processing system, comprising:

a memory storing instructions; and

a processor configured to execute the instructions to perform operations comprising:

receiving a target image of a slide corresponding to a target specimen comprising a tissue sample of a patient;

generating a machine learning system by processing a plurality of training images, each training image comprising an image of human tissue and a diagnostic label characterizing at least one of a slide morphology, a diagnostic value, a pathologist review outcome, and an analytic difficulty;

automatically identifying, using the machine learning system, an area of interest of the target image by analyzing microscopic features extracted from multiple image regions in the target image;

determining, using the machine learning system, a probability of a target feature being present in the area of interest of the target image based on an average probability;

determining, using the machine learning system, a prioritization value, of a plurality of prioritization values, of the target image based on the probability of the target feature being present in the target image, the prioritization value comprising a first prioritization value determined based on preferences of a first user and a second prioritization value determined based on preferences of a second user;

upon determining that the target feature comprises a feature in the target image indicating that further preparation is to be performed, then preparing a new slide for the target image prior to a user review;

outputting, using the machine learning system, a plurality of digitized pathology images; and

ordering, using the machine learning system, the digitized pathology images based on the plurality of prioritization values associated with the digitized pathology images, and a placement of the target image based on the prioritization value of the target image based on the target feature.

9. The system of claim 8 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

10. The system of claim 8 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

11. The system of claim 8 , wherein the further preparation is performed for the target image based on at least one of a specimen recut, an immunohistochemical stain, additional diagnostic testing, additional consultation, and/or a special stain, being performed prior to a user review.

12. The system of claim 8 , wherein the diagnostic label comprises a diagnostic feature of the target image.

13. The system of claim 12 , the diagnostic feature comprising at least one of cancer presence, cancer grade, treatment effects, precancerous lesions, biomarkers for treatment selection, and/or presence of infectious organisms.

14. The system of claim 8 , wherein the diagnostic label comprises an artifact label corresponding to at least one of scanning lines, missing tissue, and/or blur.

15. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform an image processing method, the method comprising:

receiving a target image of a slide corresponding to a target specimen comprising a tissue sample of a patient;

generating a machine learning system by processing a plurality of training images, each training image comprising an image of human tissue and a diagnostic label characterizing at least one of a slide morphology, a diagnostic value, a pathologist review outcome, and an analytic difficulty;

automatically identifying, using the machine learning system, an area of interest of the target image by analyzing microscopic features extracted from multiple image regions in the target image;

determining, using the machine learning system, a probability of a target feature being present in the area of interest of the target image based on an average probability;

determining, using the machine learning system, a prioritization value, of a plurality of prioritization values, of the target image based on the probability of the target feature being present in the target image, the prioritization value comprising a first prioritization value determined based on preferences of a first user and a second prioritization value determined based on preferences of a second user;

upon determining that the target feature comprises a feature in the target image indicating that further preparation is to be performed, then preparing a new slide for the target image prior to a user review;

outputting, using the machine learning system, a plurality of digitized pathology images; and

ordering, using the machine learning system, the digitized pathology images based on the plurality of prioritization values associated with the digitized pathology images, and a placement of the target image based on the prioritization value of the target image based on the target feature.

16. The non-transitory computer-readable medium of claim 15 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

17. The non-transitory computer-readable medium of claim 15 , wherein the diagnostic label comprises a preparation value corresponding to a likelihood that the further preparation is to be performed by preparing a new slide for the target image.

18. The non-transitory computer-readable medium of claim 17 , wherein the further preparation is performed by preparing a new slide for the target image based on at least one of a specimen recut, an immunohistochemical stain, additional diagnostic testing, additional consultation, and/or a special stain, being performed prior to a user review.

19. The non-transitory computer-readable medium of claim 15 , wherein the diagnostic label comprises a diagnostic feature of the target image, the diagnostic feature comprising at least one of cancer presence, cancer grade, treatment effects, precancerous lesions, biomarkers for treatment selection, and/or presence of infectious organisms.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: PAIGE.AI, INC.
Reel/Frame 075589/0752 →
SECURITY INTEREST Recorded Oct 21, 2025
From: PAIGE.AI, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073216/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2021
From: GODRICH, RAN; SUE, JILLIAN; GRADY, LEO; FUCHS, THOMAS
To: PAIGE.AI, INC.
Reel/Frame 056879/0179 →
Continuity (2)
Continuation 16887855 · May 29, 2020
Provisional Application 62855199 · May 31, 2019
Cited By (4)
US 12,347,215 US 12,475,564 US 12,614,378 US 12,639,808