IP Library Granted Patent US 12,586,190
Granted Patent B2
US 12,586,190 · App. 18/544,074 · Granted Mar 24, 2026

System and method of classification of biological particles

Inventors: Carlos Ramirez (Miami, FL); Steven Cadavid (Delray Beach, FL); Jindan Zhou (Palmetto Bay, FL)
Assignee: Iris International, Inc.
G06T7/0012G06T7/001G06T7/33G06T7/41G16B5/00G16B40/10G16B50/30G16H10/40G16H30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,586,190
App. No.
18/544,074
Granted
Mar 24, 2026
Kind
B2
Abstract

A method and system for classification of cells and particles in a biological sample using an automated image-based feature extraction and classification architecture. A method operates by applying a mask or series of masks to an image, extracting features from the unmasked portions of the image based on the content and location of colored pixels, selecting a subset of the extracted features, and mapping the subset of the extracted features into a classifier architecture. In a majority of cases, the first level model architecture provides an accurate identification of the cell or particle. In a minority of cases, the classification of the cell or particle requires a second level step requiring the use of numerical or categorical values from the first level in combination with a second level model.

Claims (31)

1 . A method of determining a classification of a particle in a biological sample comprising:

acquiring an image of the particle with a digital camera;

receiving the image of the particle at a processor system; and

utilizing the processor system to execute computer executable code stored on a non-transitory computer readable medium, the computer executable code comprising instructions that, when executed on the processor system, cause the processor system to:

input a first set of features into a first classifier, the first classifier configured to provide a first label among a set of labels and a first probability value associated with the first label, and

input a second set of features into a second classifier if the first probability value is below a first threshold, the second classifier configured to provide a second label among the set of labels.

2 . The method of claim 1 , wherein the second label is utilized if the second label is at or above a second threshold.

3 . The method of claim 2 , wherein the first and second thresholds are different numerical amounts.

4 . The method of claim 1 , wherein inputting the first set of features into a first classifier comprises applying a first mask to the image.

5 . The method of claim 4 , wherein inputting the first set of features into a second classifier comprises applying a second mask to the image.

6 . The method of claim 5 , wherein the first mask and the second mask are circular or ring-shaped.

7 . The method of claim 5 , wherein an application of each mask reveals different pixels concentrically outside a center of the image.

8 . The method of claim 7 , further comprising clustering a first set of pixels into a group, creating a color palette from the clustered group of pixels, determining a label for the image based in part on the color palette, or any combination thereof.

9 . The method of claim 4 , further comprising normalizing the image to a size of the first mask.

10 . The method of claim 1 , wherein the first set of features and the second set of features comprise different sets of features.

11 . A method of determining a classification of a particle in a biological sample comprising:

acquiring an image of the particle with a digital camera;

receiving the image of the particle at a processor system;

utilizing the processor system to execute computer executable code stored on a non-transitory computer readable medium, the computer executable code comprising instructions that, when executed on the processor system, cause the processor system to:

input a first set of features into a first classifier, the first classifier configured to provide a first label among a set of labels and a first probability value associated with the first label, and

input a second set of features into a second classifier, the second classifier configured to provide a second label, and

apply the first label if the first probability value is at or above a first threshold, and apply the second label if the second label is at or above a second threshold among the set of labels.

12 . The method of claim 11 , wherein the first and second thresholds are different numerical amounts.

13 . The method of claim 11 , wherein inputting the first set of features into a first classifier comprises applying a first mask to the image.

14 . The method of claim 13 , further comprising normalizing the first mask to a unit magnitude, using a chosen color space, including red-green-blue (RGB) hue-saturation-value (HSV), hue-saturation-lightness (HSL), or hue-saturation-brightness (HSB), or any combination thereof.

15 . The method of claim 13 , wherein inputting the first set of features into a second classifier comprises applying a second mask to the image.

16 . The method of claim 15 , wherein the first mask and the second mask are circular or ring-shaped.

17 . The method of claim 15 , wherein an application of each mask reveals different pixels concentrically outside a center of the image.

18 . The method of claim 13 , further comprising normalizing the image to a size of the first mask.

19 . The method of claim 18 , further comprising clustering a first set of pixels into a group, creating a color palette from the clustered group of pixels, determining a label for the image based in part on the color palette, or any combination thereof.

20 . The method of claim 11 , wherein the first set of features and the second set of features comprise different sets of features.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2023
From: RAMIREZ, CARLOS; CADAVID, STEVEN; ZHOU, JINDAN
To: IRIS INTERNATIONAL, INC.
Reel/Frame 065901/0944 →
Continuity (4)
Continuation 17850234 · Jun 27, 2022
Continuation 16324795
Provisional Application 62377851 · Aug 22, 2016
Related Publication 20240212149A1 · Jun 27, 2024
References Cited (67)
US 4612614A · Deindoerfer et al. · 1986 [cited by applicant]
US 7236623B2 · Chapoulaud et al. · 2007 [cited by applicant]
US 8879813B1 · Solanki et al. · 2014 [cited by applicant]
US 11403751B2 · Ramirez et al. · 2022 [cited by applicant]
US 20040126008A1 · Chapoulaud · 2004 [cited by applicant]
US 20050251347A1 · Perona · 2005 [cited by applicant]
US 20150110348A1 · Solanki et al. · 2015 [cited by applicant]
US 20180025211A1 · Aragaki · 2018 [cited by applicant]
US 20190228527A1 · Ramirez et al. · 2019 [cited by applicant]
US 20220335609A1 · Ramirez et al. · 2022 [cited by applicant]
CN 102663406A · 2012 [cited by applicant]
CN 103745210A · 2014 [cited by applicant]
CN 105408746A · 2016 [cited by applicant]
CN 109952614A · 2019 [cited by applicant]
CN 109952614B · 2023 [cited by applicant]
EP 3500964A1 · 2019 [cited by applicant]
HK 40010506A · 2020 [cited by applicant]
JP 2001512824A · 2001 [cited by applicant]
JP 2004505233A · 2004 [cited by applicant]
JP 2007309804A · 2007 [cited by applicant]
JP 2015137857A · 2015 [cited by applicant]
JP 2019529882A · 2019 [cited by applicant]
JP 7104691B2 · 2022 [cited by applicant]
JP 2022137166A · 2022 [cited by applicant]
WO WO2018039216A1 · 2018 [cited by applicant]
“U.S. Appl. No. 16/324,795, Advisory Action mailed Jan. 27, 2021”, 5 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Advisory Action mailed Dec. 15, 2021”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Corrected Notice of Allowability mailed Apr. 28, 2022”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Corrected Notice of Allowability mailed Jun. 30, 2022”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Examiner Interview Summary mailed Nov. 23, 2021”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Final Office Action mailed Oct. 7, 2021”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Final Office Action mailed Nov. 18, 2020”, 21 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Non Final Office Action mailed May 4, 2021”, 23 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Non Final Office Action mailed Jul. 6, 2020”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Notice of Allowance mailed Mar. 24, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Preliminary Amendment filed Feb. 11, 2019”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Response filed Jan. 15, 2021 to Final Office Action mailed Nov. 18, 2020”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Response filed Aug. 4, 2021 to Non Final Office Action mailed May 4, 2021”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Response filed Oct. 5, 2020 to Non Final Office Action mailed Jul. 6, 2020”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/324,795, Response filed Dec. 1, 2021 to Final Office Action mailed Oct. 7, 2021”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/850,234, Non Final Office Action mailed Apr. 21, 2023”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 17/850,234, Notice of Allowance mailed Oct. 6, 2023”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/850,234, Preliminary Amendment filed Jun. 28, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/850,234, Response filed Jul. 18, 2023 to Non Final Office Action mailed Apr. 21, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/850,234, Supplemental Preliminary Amendment filed Jul. 7, 2022”, 6 pgs. [cited by applicant]
“Brazilian Application Serial No. 1120190031448, Office Action mailed Jan. 28, 2023”, w/ English Translation, 5 pgs. [cited by applicant]
“Brazilian Application Serial No. 1120190031448, Voluntary Amendment filed Aug. 24, 2020”, w/ Current English Claims, 68 pgs. [cited by applicant]
“Chinese Application Serial No. 201780051805.0, Office Action mailed Jul. 25, 2023”, W/English Translation, 7 pgs. [cited by applicant]
“Chinese Application Serial No. 201780051805.0, Office Action mailed Nov. 18, 2022”, w/ English Translation, 11 pgs. [cited by applicant]
“Chinese Application Serial No. 201780051805.0, Response filed Mar. 31, 2023 to Office Action imailed Nov. 18, 2022”, w/ English Claims, 15 pgs. [cited by applicant]
“Chinese Application Serial No. 201780051805.0, Response filed Oct. 7, 2023 to Office Action mailed Jul. 25, 2023”, w/ english claims, 16 pgs. [cited by applicant]
“European Application Serial No. 17761164.7, Communication Pursuant to Article 94(3) EPC mailed Jun. 4, 2021”, 8 pgs. [cited by applicant]
“European Application Serial No. 17761164.7, Response Filed Sep. 23, 2021 to Communication Pursuant to Article 94(3) EPC mailed Jun. 4, 2021”, W/ Claims, 10 pgs. [cited by applicant]
“European Application Serial No. 17761164.7, Response to Communication Pursuant to Rules 161 and 162 filed Dec. 19, 2019”, 14 pgs. [cited by applicant]
“Indian Application Serial No. 201947010445, First Examination Report mailed Aug. 3, 2021”, with English translation, 6 pages. [cited by applicant]
“Indian Application Serial No. 201947010445, Voluntary Amendment filed Aug. 26, 2020”, English claims, the agent only provided US with the amended claims (marked and clean), so l kept the e-receipt in the PDF just in ca… [cited by applicant]
“International Application Serial No. PCT/US2017/047993, International Preliminary Report on Patentability mailed Mar. 7, 2019”, 10 pgs. [cited by applicant]
“International Application Serial No. PCT/US2017/047993, International Search Report mailed Nov. 16, 2017”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2017/047993, Written Opinion mailed Nov. 16, 2017”, 8 pgs. [cited by applicant]
“Japanese Application Serial No. 2019-510405, Notification of Reasons for Refusal mailed Aug. 27, 2021”, with English translation, 4 pages. [cited by applicant]
“Japanese Application Serial No. 2019-510405, Response Filed Jan. 21, 2022 to Notification of Reasons for Refusal mailed Aug. 27, 2021”, with English claims, 12 pages. [cited by applicant]
“Japanese Application Serial No. 2019-510405, Voluntary Amendment filed Aug. 20, 2020”, w/ English claims, 11 pgs. [cited by applicant]
“Japanese Application Serial No. 2022-110246, Notification of Reasons for Refusal mailed Sep. 1, 2023”, w/ English Translation, 5 pgs. [cited by applicant]
“Japanese Application Serial No. 2022-110246, Response filed Sep. 26, 2023 to Notification of Reasons for Refusal mailed Sep. 1, 2023”. [cited by applicant]
“Korean Application Serial No. 10-2019-7005157, Notice of Preliminary Rejection mailed Feb. 25, 2022”, with English translation, 15 pages. [cited by applicant]
“Korean Application Serial No. 10-2019-7005157, Response filed Apr. 25, 2022 to Notice of Preliminary Rejection mailed Feb. 25, 2022”, w/ English Claims, 17 pgs. [cited by applicant]
“Korean Application Serial No. 10-2019-7005157, Voluntary Amendment filed Aug. 12, 2020”, w/ English claims, 16 pgs. [cited by applicant]