IP Library Granted Patent US 12,230,044
Granted Patent B2
US 12,230,044 · App. 17/840,895 · Granted Feb 18, 2025

Segmentation-based image processing for confluency estimation

Inventors: David Pilutti (Udine, IT); Alison Willian Gomes Dos Santos (Udine, IT); Francesco Armani (Martignacco, IT); Giacomo Cattaruzzi (Udine, IT)
Assignee: VBC HOLDINGS LLC
G06V20/695G06T5/30G06T5/40G06T5/70G06T5/94G06T7/155
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,230,044
App. No.
17/840,895
Granted
Feb 18, 2025
Kind
B2
Abstract

A method of determining a coverage of an image by an apparatus including processing circuitry includes executing, by the processing circuitry, instructions that cause the apparatus to generate a first segmentation mask by segmenting an image, generate a modified mask by applying a morphological operation to the first segmentation mask, generate a modified masked input based on the image and an inversion of the modified mask, generate a second segmentation mask by segmenting the modified masked input, and determine a coverage of the image based on the first segmentation mask and the second segmentation mask.

Claims (23)

1. A method of operating an apparatus including processing circuitry, the method comprising:

executing, by the processing circuitry, instructions that cause the apparatus to:

1) generate a first segmentation mask by segmenting an image, generate a modified mask by applying a morphological operation to the first segmentation mask, generate a modified masked input based on the image and an inversion of the modified mask, and generate a second segmentation mask by segmenting the modified masked input;

2) combine the first segmentation mask and the second segmentation mask to generate a composite mask, wherein generating the composite mask includes applying a non-cell filter to the composite mask to exclude non-cell areas of the composite mask, and wherein excluding the non-cell areas of the composite mask is based on at least one of a morphology of the non-cell areas and a size of the non-cell areas; and

3) determine a coverage of the image based on the first segmentation mask and the second segmentation mask, wherein determining the coverage of the image includes a) presenting the image masked by the composite mask as an illustration of the coverage of the image and b) estimating a coverage of the composite mask.

2. The method of claim 1 , wherein

executing the instructions further causes the apparatus to adjust a feature of the image to generate an adjusted image, and

generating the first segmentation mask includes segmenting the adjusted image.

3. The method of claim 2 , wherein adjusting the feature of the image includes normalizing an illumination level of the image.

4. The method of claim 3 , wherein normalizing the illumination level of the image includes applying a Gaussian blur to the image to produce a blurred image and subtracting the blurred image from the image.

5. The method of claim 2 , wherein adjusting the feature of the image includes increasing a local contrast level of the image.

6. The method of claim 5 , wherein increasing the local contrast level of the image includes applying a contrast-limited adaptive histogram equalization to the image.

7. The method of claim 1 , wherein generating the first segmentation mask includes segmenting the image based on an edge filter.

8. The method of claim 1 , wherein generating the first segmentation mask includes applying a Gaussian blur to the image.

9. The method of claim 1 , wherein generating the first segmentation mask includes increasing a contrast level of the image.

10. The method of claim 1 , wherein the morphological operation includes at least one of:

an open morphological operation,

a close morphological operation,

a dilation morphological operation, and

an erosion morphological operation.

11. The method of claim 1 , wherein segmenting the modified masked input includes segmenting the modified masked input based on an edge filter.

12. The method of claim 1 , wherein segmenting the modified masked input includes applying a Gaussian blur to the modified masked input.

13. The method of claim 1 , wherein segmenting the modified masked input includes increasing a contrast level of the modified masked input.

Assignments (3)
SECURITY INTEREST Recorded Jan 2, 2024
From: IMMUNITYBIO, INC.; NANTCELL, INC.; RECEPTOME, INC.; VBC HOLDINGS LLC; ALTOR BIOSCIENCE, LLC; ETUBICS CORPORATION; IGDRASOL, INC.
To: INFINITY SA LLC, AS PURCHASER AGENT
Reel/Frame 066179/0074 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2022
From: PILUTTI, DAVID; GOMES DOS SANTOS, ALISON WILLIAN; ARMANI, FRANCESCO; CATTARUZZI, GIACOMO
To: VIVABIOCELL S.P.A.
Reel/Frame 061182/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2022
From: VIVABIOCELL S.P.A.
To: VBC HOLDINGS LLC
Reel/Frame 061182/0698 →
Continuity (2)
Provisional Application 63211964 · Jun 17, 2021
Related Publication 20220406079A1 · Dec 22, 2022
References Cited (26)
US 10229342B2 · Song et al. · 2019 [cited by applicant]
US 20150324998A1 · Song · 2015 [cited by examiner]
JP 2007509314A · 2007 [cited by applicant]
JP 2014110797A · 2014 [cited by applicant]
WO 2005029413A1 · 2005 [cited by applicant]
WO 2006124651A2 · 2006 [cited by applicant]
Firuzinia et al., “An Automatic Method for Morphological Abnormality Detection in Metaphase II Human Oocyte Images”, 9th International Conference on Computer and Knowledge Engineering (ICCKE 2019), Oct. 24-25, 2019, Fer… [cited by examiner]
Farnoosh et al., “A Framework for White Blood Cell Segmentation in Microscopic Blood Images Using Digital Image Processing”, Article in Biological Procedures Online ⋅ Jul. 2009 (Year: 2009). [cited by examiner]
Wikipedia, “Mathematical morphology,” p. 1-10 (2021), retrieved from: https://en.wikipedia.org/w/index.php?title=Mathematical_morphology&oldid=1022770454. [cited by applicant]
Seiler, C., et al., “Time-lapse microscopy and classification of 2D human mesenchymal stem cells based on cell shape picks up myogenic from osteogenic and adipogenic differentiation,” Journal of Tissue Engineering and R… [cited by applicant]
Joshi, M.D., et al., “White Blood Cells Segmentation and Classification to Detect Acute Leukemia,” International Jouranl of Emerging Trends andTechnology in Computer Sciences, 2(3): 147-151 (2013). [cited by applicant]
Bradhurst, C., et al., “Segmentation of Bone Marrow Stromal Cells in Phase Contrast Microscopy Images,” Proceedings of the 2008 23rd International Conference Image and Vision Computing New Zealand, pp. 1-6 (2009). [cited by applicant]
Al-Hafiz, F., et al., “Red blood cell segmentation by thresholding and Canny detector,” Procedia Computer Sciences, 141: 327-334 (2018). [cited by applicant]
Afridi, M.J., et al., “Image Segmentation of Mesenchymal Stem Cells in Diverse Culturing Conditions,” IEEE Winter Conference on Applications of Computer Vision, p. 1-8 (2014). [cited by applicant]
Ali, R., et al., “Automatic segmentation of adherent biological cell boundaries and nuclei from brightfield microscopy images,” Machine Vision and Applications, 1-15 (2011). [cited by applicant]
Jaccard, N., et al., “Automated Method for the Rapid and Precise Estimation of Adherent Cell Culture Characteristics from Phase Contrast Microscopy Images,” Bioitechnology and Bioengineering, 111(3): 504-517 (2014). [cited by applicant]
Cepa, M., “Segmentation of Total Cell Area in Brightfield Microscopy Images,” Methods and Protoc., 1(43): 1-8 (2018). [cited by applicant]
Ronneberger, O., et al., “U-Net: Convolutional Networks for Biomedical Image Segmentation,” p. 1-8 (2015). [cited by applicant]
Topman, G., et al., “A Method for Quick, Low-Cost Automated Confluency Measurements,” Microsc. Microanal., 17: 915-922 (2011). [cited by applicant]
Suzuki, S. and Abe, K., “Topological Structural Analysis of Digitized Binary Images by Border Following,” Computer Vision, Graphics, and Image Processing, 30: 32-46 (1985). [cited by applicant]
Firuzinia, S., et al., “An Automatic Method for Morphological Abnormality Detection in Metaphase II Human Oocyte Images,” 9th International Conference on Computer and Knowledge Engineering, IEEE, p. 91-97 (2019). [cited by applicant]
Sadeghian, F., et al., “A Framework for White Blood Cell Segmentation in Microscopic Blood Images Using Digital Image Processing,” Biological Procedures Online, 11(1): p. 9011 (2009). [cited by applicant]
Sharif, J.M., et al., “Red Blood Cell Segmentation Using Masking and Watershed Algorithm: A Preliminary Study,” Biomedical Engineering (ICOBE), p. 258-262 (2012). [cited by applicant]
International Search Report from corresponding PCT Application No. PCT/IB2022/055546 dated Oct. 18, 2022. [cited by applicant]
Written Opinion from corresponding PCT Application No. PCT/IB2022/055546 dated Oct. 18, 2022. [cited by applicant]
Office Action from corresponding JP Application No. 2023-577553 dated Aug. 20, 2024. [cited by applicant]