IP Library › Granted Patent US 12,406,366
Granted Patent B2
US 12,406,366 · App. 18/616,072 · Granted Sep 2, 2025

Real-time whole slide pathology image cell counting

Inventors: Bing Song (La Canada, CA); Liudmila A. Beziaeva (Culver City, CA); Shahrooz Rabizadeh (Los Angeles, CA)
Assignee: NantOmics, LLC
G06T7/0012G06T7/11G06T7/136G06T2207/10056G06T2207/20041G06T2207/20104G06T2207/20152G06T2207/30024G06T2207/30096G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,366
App. No.
18/616,072
Granted
Sep 2, 2025
Kind
B2
Abstract

Techniques are provided for determining a cell count within a whole slide pathology image. The image is segmented using a global threshold value to define a tissue area. A plurality of patches comprising the tissue area are selected. Stain intensity vectors are determined within the plurality of patches to generate a stain intensity image. The stain intensity image is iteratively segmented to generate a cell mask using a local threshold value that is and gradually reduced after each iteration. A chamfer distance transform is applied to the cell mask to generate a distance map. Cell seeds are determined on the distance map. Cell segments are determined using a watershed transformation, and a whole cell count is calculated for the plurality of patches based on the cell segments. A client device may be configured for real-time cell counting based on the whole cell count.

Claims (46)

1. An object-counting computing apparatus comprising:

at least one computer-readable memory storing object-counting software instructions;

at least one processor coupled with the at least one computer-readable memory and that operates as an object-counting engine upon execution of the object-counting software instructions to:

obtain, in the at least one computer-readable memory, a whole image comprising images of objects;

segment the whole image into image areas based on a global threshold;

select a plurality of patches associated with the image areas;

generate an intensity image based on an optical density of each patch of the plurality of patches;

generate at least one object mask with at least one object seed by segmenting the intensity image based on an iteratively reducing threshold;

generate a distance map based on at least one transformation of the at least one object mask;

distinguish object segments within the plurality of patches based on at least one transformation of the distance map and at least one object seed; and

configure a device to display an object count for at least one patch in the plurality of patches based on counting the object segments.

2. The apparatus of claim 1 , wherein the global threshold is based on at least one of an Otsu filter and a Yen filter.

3. The apparatus of claim 2 , wherein the global threshold is based on a minimum of the Otsu filter and the Yen filter.

4. The apparatus of claim 1 , wherein the iteratively reducing threshold is related to a known object size.

5. The apparatus of claim 4 , wherein the known object size is between about 5 microns and about 20 microns.

6. The apparatus of claim 1 , wherein the optical density comprises an RGB density.

7. The apparatus of claim 1 , wherein the plurality of patches is associated with at least one selected region of interest.

8. The apparatus of claim 7 , wherein the object count relates to the at least one selected region of interest.

9. The apparatus of claim 7 , wherein the at least one selected region of interest is based on a set of points that form a closed curve in the whole image.

10. The apparatus of claim 9 , wherein an object is determined based on a point that forms a closed curve.

11. The apparatus of claim 1 , wherein the device is configured to display the object count in real-time.

12. The apparatus of claim 1 , wherein the object count comprises a whole object count for the whole image.

13. The apparatus of claim 1 , wherein the whole image comprises a whole-slide image.

14. The apparatus of claim 1 , wherein at least some the patches of the plurality of patches are selected randomly.

15. The apparatus of claim 1 , wherein the distance map indicates a distance to a nearest background point.

16. The apparatus of claim 1 , wherein the at least one object seed is determined by gaussian smoothing the distance map.

17. The apparatus of claim 1 , wherein the at least one object seed relates to a maximum height marker in the distance map.

18. The apparatus of claim 1 , where in the object count comprises an updated object count based a change in a region of interest.

19. A non-transitory, computer-readable medium storing instructions which, when executed by at least one processor and memory, cause the at least one processor to perform operations comprising one or more steps to:

obtain, in at least one computer-readable memory, a whole image comprising images of objects;

segment the whole image into image areas based on a global threshold;

select a plurality of patches associated with the image areas;

generate an intensity image based on an optical density of each patch of the plurality of patches;

generate at least one object mask with at least one object seed by segmenting the intensity image based on an iteratively reducing threshold;

generate a distance map based on at least one transformation of the at least one object mask;

distinguish object segments within the plurality of patches based on at least one transformation of the distance map and at least one object seed; and

configure a device to display an object count for at least one patch in the plurality of patches based on counting the cell segments.

20. A computerized method comprising:

obtaining, in at least one computer-readable memory, a whole image comprising images of objects;

segmenting the whole image into image areas based on a global threshold;

selecting a plurality of patches associated with the image areas;

generating an intensity image based on an optical density of each patch of the plurality of patches;

generating at least one object mask with at least one object seed by segmenting the intensity image based on an iteratively reducing threshold;

generating a distance map based on at least one transformation of the at least one object mask;

distinguishing object segments within the plurality of patches based on at least one transformation of the distance map and at least one object seed; and

configuring a device to display an object count for at least one patch in the plurality of patches based on counting the object segments.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2025
From: BEZIAEVA, LIUDMILA A.
To: NANTHEALTH, INC.
Reel/Frame 070805/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2025
From: NANTBIO, INC.
To: NANTOMICS, LLC
Reel/Frame 070805/0634 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2025
From: SONG, BING
To: NANTOMICS, LLC
Reel/Frame 070820/0305 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2025
From: RABIZADEH, SHAHROOZ
To: NANTBIO, INC.
Reel/Frame 070820/0360 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2025
From: NANTHEALTH, INC.
To: NANTOMICS, LLC
Reel/Frame 070820/0383 →
Continuity (4)
Continuation 17881578 · Aug 4, 2022
Continuation 16957036
Provisional Application 62618979 · Jan 18, 2018
Related Publication 20240233124A1 · Jul 11, 2024
References Cited (24)
US 10755406B2 · Barnes et al. · 2020 [cited by applicant]
US 11443426B2 · Song et al. · 2022 [cited by applicant]
US 11954856B2 · Song et al. · 2024 [cited by applicant]
US 20060127880A1 · Harris · 2006 [cited by examiner]
US 20090238457A1 · Rittscher · 2009 [cited by examiner]
US 20090262993A1 · Kotsianti et al. · 2009 [cited by applicant]
US 20130188857A1 · Yoshihara et al. · 2013 [cited by applicant]
US 20130288249A1 · Gullberg · 2013 [cited by examiner]
US 20170213344A1 · Hong et al. · 2017 [cited by applicant]
US 20170337695A1 · Sarkar · 2017 [cited by examiner]
US 20180012062A1 · Zahniser · 2018 [cited by examiner]
US 20180240239A1 · Wang · 2018 [cited by examiner]
US 20190095679A1 · Aragaki · 2019 [cited by applicant]
US 20190147215A1 · Al-Kofahi · 2019 [cited by examiner]
US 20190392578A1 · Chukka · 2019 [cited by examiner]
US 20210192737A1 · Zhou · 2021 [cited by examiner]
US 20220292277A9 · Bredno · 2022 [cited by examiner]
JP 201591220A · 2015 [cited by applicant]
KR 101700887B1 · 2017 [cited by applicant]
Raimondo et al. “Automated Evaluation of Her-2/neu Status in Breast Tissue From Fluorescent In Situ Hybridization Images.” IEEE Transactions on Image Processing, vol. 14 No. 9, Sep. 2005, pp. 1288-1299 (Year: 2005). [cited by applicant]
Chourasiya et al., “Automatic Red Blood Cell Counting using Watershed Segmentation,” International Journal of Computer Science and Information Technologies, vol. 5, 2014, pp. 4834-4838. [cited by applicant]
International Search Report and Written Opinion issued in International Application No. PCT/US2019/013700 dated May 8, 2019, 11 pages. [cited by applicant]
International Preliminary Report on Patentability issued in International Application No. PCT/US2019/013700 dated Jul. 30, 2020, 7 pages. [cited by applicant]
Non-Final Office Action dated Oct. 5, 2023 for U.S. Appl. No. 17/881,578, 13 pages. [cited by applicant]