IP Library Granted Patent US 12,579,616
Granted Patent B2
US 12,579,616 · App. 18/378,989 · Granted Mar 17, 2026

Enhanced extended depth of focusing on biological samples

Inventors: Mark Rutenberg (Monsey, NY); Richard Scott (Chestnut Ridge, NY); Robert Tjon (Nyack, NY); Paul Seltzer (Monsey, NY)
Assignee: CDx Medical IP, Inc.
G06T5/50G02B21/367G06T5/73H04N23/675H04N23/959G06T2207/10056G06T2207/20221G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,579,616
App. No.
18/378,989
Granted
Mar 17, 2026
Kind
B2
Abstract

A system and method for constructing a digital composite image of a three-dimensional biological sample. The system includes an optical system that captures images of cells and tissue presented on a specimen slide. The system systematically acquires a stack of images at different segments across the specimen slide. For each segment, the system dynamically calculates an optimal focal plane. Once an optimal focal plane is determined for each of the stacks of images, the system generates a composite image by copying the sharpest objects from each of the optimal focal planes.

Claims (14)

1 . A method for generating a composite digital image of a biological sample from a plurality of images of the biological sample, each of the plurality of images taken along a single axis, the method comprising:

(a) identifying a first focal plane, wherein the first focal plane comprises a first z distance, for a first collection of image objects at a first x-y location of the biological sample, and

(b) identifying a second focal plane, wherein the second focal plane comprises a second z distance, for a second collection of image objects at a second x-y location of the biological sample, and

(c) identifying a first optimal focal plane and a second optimal focal plane based on (a) and (b) respectively, and

(d) combining image objects from a first optimal focal plane and image objects from a second optimal focal plane and generates the composite digital image,

and using a computer apparatus to calculate a sharpness value for the image objects in the first focal plane and calculate a sharpness value for the image objects in the second focal plane and generate a two-dimensional map of the z-index of the objects having the highest sharpness values, and

identifying an optimal first focal plane and optimal second focal plane for the first and second collection of image objects by performing a number of dilations followed by an equal number of erosions on the two-dimensional map of the z-index of the image objects having highest sharpness values in the first and second focal planes wherein the number of dilations and erosions is proportional to a distance between cell boundaries in healthy tissue, so as to thereby identify a first and a second optimal focal plane, and wherein image objects located on the first optimal focal plane are presented in-focus and image objects below the first optimal focal plane are deemphasized, and wherein image objects located on the second optimal focal plane are presented in-focus and image objects below the second optimal focal plane are deemphasized, so as to generate a composite digital image of a biological sample.

2 . The method of claim 1 , wherein one or more of the images in the plurality of images are color images and the computer apparatus converts the one or more color images in the plurality of images to greyscale prior to identifying the optimal focal plane for the plurality of images.

3 . The method of claim 1 , wherein the composite image includes a honeycomb structure of the biological sample.

4 . The method of claim 3 , wherein the honeycomb structure is substantially in focus.

5 . The method of claim 1 , wherein the location of the objects having the highest sharpness value is a z-index and wherein the first optimal focal plane and second optimal focal plane for the first and second collection of image objects are identified by performing a number of dilations followed by an equal number of erosions.

6 . The method of claim 1 , wherein the image objects are cell structures.

7 . The method of claim 1 , wherein the image objects are cell nuclei.

8 . The method of claim 1 , wherein the image objects are cytoplasmic mucus pockets in goblet cells.

Assignments (2)
SECURITY INTEREST Recorded Jul 22, 2025
From: CDX MEDICAL IP, INC.
To: WHITE OAK HEALTHCARE FINANCE, LLC, AS AGENT
Reel/Frame 071794/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2023
From: RUTENBERG, MARK; SCOTT, RICHARD; TJON, ROBERT; SELTZER, PAUL
To: CDX MEDICAL IP, INC.
Reel/Frame 065187/0269 →
Continuity (5)
Continuation 17892589 · Aug 22, 2022
Continuation 17591294 · Feb 2, 2022
Continuation 17264006
Provisional Application 62713076 · Aug 1, 2018
Related Publication 20240046419A1 · Feb 8, 2024
References Cited (18)
US 11263735B2 · Rutenberg · 2022 [cited by examiner]
US 11449973B2 · Rutenberg · 2022 [cited by examiner]
US 20040076315A1 · Scoll et al. · 2004 [cited by applicant]
US 20050036702A1 · Yang et al. · 2005 [cited by applicant]
US 20090046909A1 · Rutenberg et al. · 2009 [cited by applicant]
US 20110157344A1 · Xie et al. · 2011 [cited by applicant]
US 20170111581A1 · Muenzenmayer et al. · 2017 [cited by applicant]
US 20170350805A1 · Murata et al. · 2017 [cited by applicant]
US 20180156713A1 · Berezhna et al. · 2018 [cited by applicant]
US 20180172589A1 · Gouda et al. · 2018 [cited by applicant]
US 20200041509A1 · Hermon-Taylor · 2020 [cited by examiner]
US 20210045632A1 · Pentico et al. · 2021 [cited by applicant]
US 20210073979A1 · Masutani et al. · 2021 [cited by applicant]
US 20210149170A1 · Leshem et al. · 2021 [cited by applicant]
International Search Report and Written Opinion dated Oct. 29, 2019 issued in PCT International Appln. No. PCT/US2019/044639. [cited by applicant]
Extended EP Search Report dated Mar. 25, 2022 from European Patent Application No. 19844886.2. [cited by applicant]
Heechul Han et al., “Virtual Out of Focus With Single Image to Enhance 3D Perception,” 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2011, IEEE, May 16, 2011, pp. 1-4. [cited by applicant]
Shain et al., “Extended Depth-of-Field Microscopy With a High-Speed Deformable Mirror,” Adaptive Optics and Wavefront Control for Biological Systems III, edited by Thomas G. Bifano et al., Progess in Biomedical Optics a… [cited by applicant]