IP Library Granted Patent US 12,217,483
Granted Patent B2
US 12,217,483 · App. 18/488,364 · Granted Feb 4, 2025

Systems and methods for processing electronic images for generalized disease detection

Inventors: Belma Dogdas (Ridgewood, NJ); Christopher Kanan (Pittsford, NY); Thomas Fuchs (New York, NY); Leo Grady (Darien, CT)
Assignee: PAIGE.AI, Inc.
G06V10/764G06T7/0012G06V10/82G06V20/698G16H30/40G16H50/20G06T2207/20081G06T2207/30024G06T2207/30096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,483
App. No.
18/488,364
Granted
Feb 4, 2025
Kind
B2
Abstract

Systems and methods are disclosed for generating a specialized machine learning model by receiving a generalized machine learning model generated by processing a plurality of first training images to predict at least one cancer characteristic, receiving a plurality of second training images, the first training images and the second training images include images of tissue specimens and/or images algorithmically generated to replicate tissue specimens, receiving a plurality of target specialized attributes related to a respective second training image of the plurality of second training images, generating a specialized machine learning model by modifying the generalized machine learning model based on the plurality of second training images and the target specialized attributes, receiving a target image corresponding to a target specimen, applying the specialized machine learning model to the target image to determine at least one characteristic of the target image, and outputting the characteristic of the target image.

Claims (49)

1. A computer-implemented method for processing electronic images, the method comprising:

receiving a generalized machine learning model;

receiving a plurality of training images, a quantity of training images being insufficient to generate a machine learning model that meets a threshold;

receiving a plurality of target specialized attributes each related to a respective training image of the plurality of training images;

generating a specialized machine learning model by modifying the generalized machine learning model based on the plurality of training images and respective target specialized attributes, the specialized machine learning model meeting the threshold, the specialized machine learning model being generated in accordance with a large-margin scheme built over one or more features of the generalized machine learning model;

receiving a target image corresponding to a target specimen;

applying the specialized machine learning model to the target image to determine at least one characteristic of the target image; and

outputting the at least one characteristic of the target image.

2. The computer-implemented method of claim 1 , further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target image; and

outputting the prediction of the specimen type of the target specimen.

3. The computer-implemented method of claim 1 , wherein the plurality of target specialized attributes are one or more biomarkers present within each respective training image.

4. The computer-implemented method of claim 1 , wherein the generalized machine learning model comprises a plurality of layers and modifying the generalized machine learning model further comprises modifying one or more outer layers of the generalized machine learning model.

5. The computer-implemented method of claim 1 , wherein modifying the generalized machine learning model further comprises removing an output layer of the generalized machine learning model.

6. The computer-implemented method of claim 1 , wherein the plurality of target specialized attributes are one or more indications of characteristic outputs selected from a disease presence, staging variable presence, drug response, toxicity, or cancer classification.

7. The computer-implemented method of claim 1 , wherein the plurality of target specialized attributes are based on at least one of drug response information, cancer recurrence prediction information, or toxicity assessment information.

8. The computer-implemented method of claim 1 , wherein the large-margin scheme reduces generalization.

9. The computer-implemented method of claim 1 , wherein each of the training images are generated based on a same category of pathology specimens and wherein a category of pathology specimens is selected from histology, cytology, immunohistochemistry, or a combination thereof.

10. The computer-implemented method of claim 1 , wherein modifying a generalized machine learning model further comprises adjusting the generalized machine learning model to have outputs based on the target specialized attributes.

11. The computer-implemented method of claim 1 , wherein generalized machine learning model is generated by processing a plurality of first training images to predict at least one cancer characteristic.

12. The computer-implemented method of claim 1 , wherein the at least one characteristic of the target image is one of a cancer diagnosis, a tumor characterization, or biomarker detection.

13. A system comprising:

at least one memory storing instructions; and

at least one processor executing the instructions to perform operations comprising:

receiving a generalized machine learning model;

receiving a plurality of training images, a quantity of training images being insufficient to generate a machine learning model that meets a threshold;

receiving a plurality of target specialized attributes each related to a respective training image of the plurality of training images;

generating a specialized machine learning model by modifying the generalized machine learning model based on the plurality of training images and the respective target specialized attributes, the specialized machine learning model meeting the threshold, the specialized machine learning model being generated in accordance with large-margin scheme built over one or more features of the generalized machine learning model;

receiving a target image corresponding to a target specimen;

applying the specialized machine learning model to the target image to determine at least one characteristic of the target image; and

outputting the at least one characteristic of the target image.

14. The system of claim 13 , the operations further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target image; and

outputting the prediction of the specimen type of the target specimen.

15. The system of claim 13 , wherein the large-margin scheme reduces generalization.

16. The system of claim 13 , wherein the generalized machine learning model comprises a plurality of layers and modifying the generalized machine learning model further comprises modifying one or more outer layers of the generalized machine learning model.

17. The system of claim 13 , wherein modifying the generalized machine learning model further comprises removing an output layer of the generalized machine learning model.

18. A non-transitory computer-readable medium storing instructions that, when executed by processor, cause the processor to perform operations comprising:

receiving a generalized machine learning model;

receiving a plurality of training images, wherein a quantity of training images being insufficient to generate a machine learning model that meets a threshold;

receiving a plurality of target specialized attributes each related to a respective training image of the plurality of training images;

generating a specialized machine learning model by modifying the generalized machine learning model based on the plurality of training images and the respective target specialized attributes, the specialized machine learning model meeting the threshold, the specialized machine learning model being generated in accordance with a large margin scheme built over one or more features of the generalized machine learning model;

receiving a target image corresponding to a target specimen;

applying the specialized machine learning model to the target image to determine at least one characteristic of the target image; and

outputting the at least one characteristic of the target image.

19. The non-transitory computer-readable medium of claim 18 , the operations further comprising:

determining a prediction of a specimen type of the target specimen based on the at least one characteristic of the target image; and

outputting the prediction of the specimen type of the target specimen.

20. The non-transitory computer-readable medium of claim 18 , wherein the plurality of target specialized attributes are one or more biomarkers present within each respective training image.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: PAIGE.AI, INC.
Reel/Frame 075589/0752 →
SECURITY INTEREST Recorded Oct 21, 2025
From: PAIGE.AI, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073216/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2023
From: DOGDAS, BELMA; KANAN, CHRISTOPHER; FUCHS, THOMAS; GRADY, LEO
To: PAIGE.AI, INC.
Reel/Frame 065429/0981 →
Continuity (5)
Continuation 17710613 · Mar 31, 2022
Continuation 17380595 · Jul 20, 2021
Continuation 17126865 · Dec 18, 2020
Provisional Application 62956876 · Jan 3, 2020
Related Publication 20240046615A1 · Feb 8, 2024
References Cited (41)
US 10936160B2 · Sieniek · 2021 [cited by examiner]
US 20170007187A1 · Breneisen et al. · 2017 [cited by applicant]
US 20170053398A1 · Mahoor · 2017 [cited by examiner]
US 20170091937A1 · Barnes · 2017 [cited by examiner]
US 20170357844A1 · Comaniciu et al. · 2017 [cited by applicant]
US 20180240041A1 · Koch · 2018 [cited by examiner]
US 20180247107A1 · Murthy et al. · 2018 [cited by applicant]
US 20190050982A1 · Song et al. · 2019 [cited by applicant]
US 20190073569A1 · Ben-Ari et al. · 2019 [cited by applicant]
US 20190156159A1 · Kopparapu · 2019 [cited by applicant]
US 20190347557A1 · Khan · 2019 [cited by applicant]
US 20190355114A1 · Muehlberg et al. · 2019 [cited by applicant]
US 20190370965A1 · Lay et al. · 2019 [cited by applicant]
US 20190391154A1 · Baral · 2019 [cited by applicant]
US 20200105413A1 · Vladimirova · 2020 [cited by examiner]
US 20200160032A1 · Allen et al. · 2020 [cited by applicant]
US 20200176112A1 · Sati · 2020 [cited by examiner]
US 20200210767A1 · Do et al. · 2020 [cited by applicant]
US 20200225811A1 · Sieniek · 2020 [cited by applicant]
US 20200250817A1 · Leng et al. · 2020 [cited by applicant]
US 20200272864A1 · Faust et al. · 2020 [cited by applicant]
US 20200303072A1 · Drokin · 2020 [cited by examiner]
US 20200372636A1 · Ha · 2020 [cited by applicant]
US 20200388028A1 · Agus et al. · 2020 [cited by applicant]
CN 107330954A · 2017 [cited by applicant]
CN 107492090A · 2017 [cited by applicant]
CN 107995428A · 2018 [cited by applicant]
CN 108137712A · 2018 [cited by applicant]
CN 109308495A · 2019 [cited by applicant]
CN 110023994A · 2019 [cited by applicant]
CN 110121749A · 2019 [cited by applicant]
CN 110599451A · 2019 [cited by applicant]
FR 3041292A1 · 2017 [cited by applicant]
KR 102057649B1 · 2019 [cited by applicant]
WO 2017055412A1 · 2017 [cited by applicant]
WO 2019084697A1 · 2019 [cited by applicant]
WO 2019157214A2 · 2019 [cited by applicant]
Bentaieb et al., “Deep Learning Models for Digital Pathology”, arXiv: 1910.12329, pp. 1-58 (Year: 2019). [cited by applicant]
H. Shin et al. “Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning,” in IEEE Transactions on Medical Imaging, vol. 35, No. 5, pp. 1285-1298,… [cited by applicant]
International Search Report and Written Opinion in International Application No. PCT/US2020/066045, dated Mar. 24, 2021 (14 pages). [cited by applicant]
Komura et al., “Machine Learning Methods for Histopathological Image Analysis”, Computational and Structural Biotechnology Journal 16 (2018), pp. 34-42 (Year: 2018). [cited by applicant]