IP Library Granted Patent US 11,315,029
Granted Patent B2
US 11,315,029 · App. 17/303,164 · Granted Apr 26, 2022

Systems and methods for processing images to classify the processed images for digital pathology

Inventors: Supriya Kapur (New York, NY); Christopher Kanan (Rochester, NY); Thomas Fuchs (New York, NY); Leo Grady (Darien, CT)
Assignee: PAIGE.AI, INC.
G06N5/04G06N20/00G06T7/0012G06T2207/20076G06T2207/20081G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,315,029
App. No.
17/303,164
Granted
Apr 26, 2022
Kind
B2
Abstract

Systems and methods are disclosed for receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient, applying a machine learning model, which may also be known as a machine learning system, to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated, and outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

Claims (105)

1. A computer-implemented method for analyzing an image corresponding to a specimen, the method comprising:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning model to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

in response to the quality assessment for the target image being less than a predetermined value, outputting a recommendation for increasing a quality of the target image; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

2. The computer-implemented method of claim 1 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen; and

outputting the prediction of the specimen type of the target specimen.

3. The computer-implemented method of claim 1 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen;

determining whether a confidence value of the prediction exceeds a predetermined threshold; and

in response to determining that the confidence value of the prediction does not exceed the predetermined threshold, outputting an alert indicating that the specimen type of the target specimen is not identifiable.

4. The computer-implemented method of claim 1 , further comprising:

determining a confidence value of a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen; and

outputting the confidence value.

5. The computer-implemented method of claim 4 , further comprising:

identifying a prior treatment associated with the patient; and

determining the confidence value of the prediction of the specimen type based at least in part on the prior treatment associated with the patient.

6. The computer-implemented method of claim 1 , wherein the recommendation comprises any one or any combination of a specimen cut, a scanning parameter, a slide reconstruction, and/or a slide marking.

7. The computer-implemented method of claim 1 , further comprising:

determining, using the target image and the machine learning model, whether the target specimen is post-treatment or pre-treatment.

8. The computer-implemented method of claim 1 , further comprising:

determining, using the target image and the machine learning model, whether the target specimen is post-treatment or pre-treatment;

upon determining that the target specimen is post-treatment, determining a predicted degree to which the target specimen has been treated based on the target image; and

outputting the predicted degree to which the target specimen has been treated.

9. A system for analyzing an image corresponding to a specimen, the system comprising:

at least one memory storing instructions; and

at least one processor executing the instructions to perform operations comprising a process including:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning system to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning system having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

in response to the quality assessment for the target image being less than a predetermined value, outputting a recommendation for increasing a quality of the target image; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

10. The system of claim 9 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen; and

outputting the prediction of the specimen type of the target specimen.

11. The system of claim 9 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen;

determining whether a confidence value of the prediction exceeds a predetermined threshold; and

in response to determining that the confidence value of the prediction does not exceed the predetermined threshold, outputting an alert indicating that the specimen type of the target specimen is not identifiable.

12. The system of claim 9 , the operations further comprising:

determining a confidence value of a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen; and

outputting the confidence value.

13. The system of claim 12 , the operations further comprising:

identifying a prior treatment associated with the patient; and

determining the confidence value of the prediction of the specimen type based at least in part on the prior treatment associated with the patient.

14. The system of claim 9 , wherein the recommendation comprises a specimen cut, a scanning parameter, a slide reconstruction, and/or a slide marking.

15. The system of claim 9 , the operations further comprising:

determining, using the target image and the machine learning system, whether the target specimen is post-treatment or pre-treatment.

16. The system of claim 9 , the operations further comprising:

determining, using the target image and the machine learning system, whether the target specimen is post-treatment or pre-treatment;

upon determining that the target specimen is post-treatment, determining a predicted degree to which the target specimen has been treated based on the target image; and

outputting the predicted degree to which the target specimen has been treated.

17. A non-transitory computer-readable medium storing instructions that, when executed by processor, cause the processor to perform a method for analyzing an image corresponding to a specimen, the method comprising:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning model to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

in response to the quality assessment for the target image being less than a predetermined value, outputting a recommendation for increasing a quality of the target image; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

18. The non-transitory computer-readable medium of claim 17 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target specimen; and

outputting the prediction of the specimen type of the target specimen.

19. A computer-implemented method for analyzing an image corresponding to a specimen, the method comprising:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

identifying a prior treatment associated with the patient;

applying a machine learning model to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

determining a confidence value of a prediction of a specimen type of the target specimen based at least in part on the prior treatment associated with the patient;

outputting the confidence value; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

20. A computer-implemented method for analyzing an image corresponding to a specimen, the method comprising:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning model to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic,

outputting the predicted degree to which the target specimen has been treated; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

21. A computer-implemented method for analyzing an image corresponding to a specimen, the method comprising:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning model to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning model having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

determining, using the target image and the machine learning model, whether the target specimen is post-treatment or pre-treatment;

upon determining that the target specimen is post-treatment, determining a predicted degree to which the target specimen has been treated based on the target image;

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

22. A system for analyzing an image corresponding to a specimen, the system comprising:

at least one memory storing instructions; and

at least one processor executing the instructions to perform operations comprising a process including:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

identifying a prior treatment associated with the patient;

applying a machine learning system to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning system having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

determining a confidence value of a prediction of a specimen type of the target specimen based at least in part on the prior treatment associated with the patient;

outputting the confidence value; and

the training images comprising images of human tissue and/or images that are algorithmically generated;

determining, using the target image and the machine learning model, whether the target specimen is post-treatment or pre-treatment; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

23. A system for analyzing an image corresponding to a specimen, the system comprising:

at least one memory storing instructions; and

at least one processor executing the instructions to perform operations comprising a process including:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning system to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning system having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

determining, using the target image and the machine learning system, whether the target specimen is post-treatment or pre-treatment; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

24. A system for analyzing an image corresponding to a specimen, the system comprising:

at least one memory storing instructions; and

at least one processor executing the instructions to perform operations comprising a process including:

receiving a target image corresponding to a target specimen, the target specimen comprising a tissue sample of a patient;

applying a machine learning system to the target image to determine at least one characteristic of the target specimen and/or at least one characteristic of the target image, the machine learning system having been generated by processing a plurality of training images to identify a quality assessment and predict at least one characteristic, the training images comprising images of human tissue and/or images that are algorithmically generated;

determining, using the target image and the machine learning system, whether the target specimen is post-treatment or pre-treatment;

upon determining that the target specimen is post-treatment, determining a predicted degree to which the target specimen has been treated based on the target image;

outputting the predicted degree to which the target specimen has been treated; and

outputting the at least one characteristic of the target specimen and/or the at least one characteristic of the target image.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: PAIGE.AI, INC.
Reel/Frame 075589/0752 →
SECURITY INTEREST Recorded Oct 21, 2025
From: PAIGE.AI, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073216/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2021
From: KAPUR, SUPRIYA; KANAN, CHRISTOPHER; FUCHS, THOMAS; GRADY, LEO
To: PAIGE.AI, INC.
Reel/Frame 056760/0200 →
Continuity (4)
Continuation 17112435 · Dec 4, 2020
Continuation 16875616 · May 15, 2020
Provisional Application 62848703 · May 16, 2019
Related Publication 20210279611A1 · Sep 9, 2021
Cited By (1)
US 12,236,365