IP Library Granted Patent US 11,823,378
Granted Patent B2
US 11,823,378 · App. 17/107,433 · Granted Nov 21, 2023

Systems and methods for processing electronic images to detect contamination in specimen preparations

Inventors: Patricia Raciti (New York, NY); Christopher Kanan (New York, NY); Thomas Fuchs (New York, NY); Leo Grady (New York, NY)
Assignee: Paige.AI, Inc.
G06T7/0012G06T7/11G06T7/194G06V10/764G06V10/776G06V10/82G06V10/993G06V20/69G06T2207/10056G06T2207/20081G06T2207/20084G06T2207/30024G06V2201/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,823,378
App. No.
17/107,433
Granted
Nov 21, 2023
Kind
B2
Abstract

Systems and methods are disclosed for receiving one or more digital images associated with a tissue specimen, detecting one or more image regions from a background of the one or more digital images, determining a prediction, using a machine learning system, of whether at least one first image region of the one or more image regions comprises at least one external contaminant, the machine learning system having been trained using a plurality of training images to predict a presence of external contaminants and/or a location of any external contaminants present in the tissue specimen, and determining, based on the prediction of whether a first image region comprises an external contaminant, whether to process the image region using an processing algorithm.

Claims (48)

1. A computer-implemented method for processing an electronic image corresponding to a tissue specimen, the method comprising:

receiving one or more digital images associated with a tissue specimen;

detecting one or more image regions from a background of the one or more digital images;

determining a prediction, using a machine learning system, that at least a first image region of the one or more image regions comprises at least one foreign tissue contaminant, the machine learning system having been trained using a plurality of training images associated with a plurality of tissue specimens to predict a presence of one or more foreign tissue contaminants and/or a location of the one or more foreign tissue contaminants present in the plurality of training images; and

determining, based on the prediction that the first image region comprises the at least one foreign tissue contaminant, to not process the first image region using a processing algorithm.

2. The computer implemented method of claim 1 , wherein the background of the one or more digital images comprises a portion of the one or more digital images that is not the tissue specimen.

3. The computer implemented method of claim 1 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises:

thresholding based on color intensity, texture features, and/or Otsu's method.

4. The computer implemented method of claim 1 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises using one or more segmentation algorithms.

5. The computer implemented method of claim 1 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises using bounding box detection.

6. The computer implemented method of claim 1 , further comprising:

storing the one or more digital images in at least one database along with a timestamp associated with the one or more digital images.

7. The computer implemented method of claim 1 , wherein the machine learning system is implemented by a convolutional neural network (CNN), Region CNN (R-CNN), Faster R-CNN, Mask R-CNN, Convolutional Graph Neural Network, and/or Relationship Neural Network.

8. The computer implemented method of claim 1 , wherein the machine learning system is implemented by feature extraction using hand-engineered features and at least one from among: a random forest, support vector machine (SVM), and/or deep learning.

9. The computer implemented method of claim 8 , wherein the hand-engineered features comprise at least one from Scale-Invariant Feature Transform (SIFT), Speeded up robust features (SURF), Rotation Invariant Feature Transform (RIFT), Oriented feature from accelerated segment test (FAST) and/or Rotated Binary Robust Independent Elementary Features (BRIEF) (ORB).

10. The computer implemented method of claim 1 , wherein the machine learning system is trained using the plurality of training images by:

receiving the plurality of training images, wherein at least one training image of the plurality of training images includes at least one foreign tissue contaminant in a background of the at least one training image;

receiving information about a localization of the at least one foreign tissue contaminant included in the at least one training image of the plurality of training images;

receiving information about a tissue type of the tissue specimen depicted in the at least one training image;

detecting one or more image regions from the background of the at least one training image; and

training the machine learning system to indicate a presence of the at least one foreign tissue contaminant in the at least one training image and/or a specific location of the at least one foreign tissue contaminant present in the at least one training image.

11. The computer implemented method of claim 1 , further comprising:

receiving information about a tissue type of the tissue specimen shown in the one or more digital images of the received one or more digital images; and

determining the prediction at least in part based on the tissue type.

12. A system for processing an electronic image corresponding to a tissue specimen, the system comprising:

at least one memory storing instructions; and

at least one processor configured to execute the instructions to perform operations comprising:

receiving one or more digital images associated with a tissue specimen;

detecting one or more image regions from a background of the one or more digital images;

determining a prediction, using a machine learning system, that at least a first image region of the one or more image regions comprises at least one foreign tissue contaminant, the machine learning system having been trained using a plurality of training images associated with a plurality of tissue specimens to predict a presence of one or more foreign tissue contaminants and/or a location of the one or more foreign tissue contaminants present in the plurality of training images; and

determining, based on the prediction that the first image region comprises the at least one foreign tissue contaminant, to not process the first image region using a processing algorithm.

13. The system of claim 12 , wherein the background of the one or more digital images comprises a portion of the one or more digital images that is not the tissue specimen.

14. The system of claim 12 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises:

thresholding based on color intensity, texture features, and/or Otsu's method.

15. The system of claim 12 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises using one or more segmentation algorithms.

16. The system of claim 12 , wherein the detecting of the one or more image regions from the background of the one or more digital images comprises using bounding box detection.

17. The system of claim 12 , wherein the machine learning system is trained using the plurality of training images by:

receiving the plurality of training images, wherein at least one training image of the plurality of training images includes at least one foreign tissue contaminant in a background of the at least one training image;

receiving information about a localization of the at least one foreign tissue contaminant included in the at least one training image of the plurality of training images;

receiving information about a tissue type of the tissue specimen depicted in the at least one training image;

detecting one or more image regions from the background of the at least one training image; and

training a machine learning system to indicate a presence of the at least one foreign tissue contaminant in the at least one training image and/or a specific location of the at least one foreign tissue contaminant present in the at least one training image.

18. The system of claim 12 , wherein the machine learning system is implemented by CNN, R-CNN, Faster R-CNN, Mask R-CNN, Convolutional Graph Neural Network, and/or Relationship Neural Network.

19. At least one non-transitory computer readable medium for processing an electronic image corresponding to a tissue specimen, the at least one non-transitory computer readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving one or more digital images associated with a tissue specimen;

detecting one or more image regions from a background of the one or more digital images;

determining a prediction, using a machine learning system, that at least a first image region of the one or more image regions comprises at least one foreign tissue contaminant, the machine learning system having been trained using a plurality of training images associated with a plurality of tissue specimens to predict a presence of one or more foreign tissue contaminants and/or a location of the one or more foreign tissue contaminants present in the plurality of training images; and

determining, based on the prediction that the first image region comprises the at least one foreign tissue contaminant, to not process the first image region using a processing algorithm.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: PAIGE.AI, INC.
Reel/Frame 075589/0752 →
SECURITY INTEREST Recorded Oct 21, 2025
From: PAIGE.AI, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 073216/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2020
From: RACITI, PATRICIA; KANAN, CHRISTOPHER; FUCHS, THOMAS; GRADY, LEO
To: PAIGE.AI, INC.
Reel/Frame 054511/0397 →
Continuity (2)
Provisional Application 62951504 · Dec 20, 2019
Related Publication 20210192729A1 · Jun 24, 2021
Cited By (1)
US 12,217,423