IP Library Granted Patent US 11,636,627
Granted Patent B2
US 11,636,627 · App. 16/328,573 · Granted Apr 25, 2023

System for histological examination of tissue specimens

Inventors: Gabriel Siegel (Moreshet, IL); Dan Vadim Regelman (Kirtay Bialik, IL)
Assignee: Augmentiqs Medical Ltd.
G06T11/00G02B21/18G06F3/013H04N23/55H04N23/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,627
App. No.
16/328,573
Granted
Apr 25, 2023
Kind
B2
Abstract

An interactive apparatus, system and method for image capturing and projecting is integrated into an optical microscope. An image capturing and projecting unit is operatively connected to a processing unit, the processing unit configured to: (a) receive user generated data; and (b) overlay the user generated data onto an optically viewed image visible through the eyepiece.

Claims (42)

1. A method for reviewing a specimen with an optical microscope comprising the steps of:

capturing through a beam splitter and a first polarizing filter a first digital image of a first portion of the specimen with a camera at a first time;

displaying the first digital image through an ocular of the microscope;

analyzing the first digital image to identify a first region of interest;

generating a first enhanced image corresponding to the first digital image, automatically adjusting color and brightness in the identified first region of interest, by a digital image projector, and projecting the first enhanced image through a second polarizing filter, which polarizes light perpendicular to the first polarizing filter, and by the beam splitter into the ocular of the microscope;

determining a first location of the first digital image with respect to a reference point;

capturing through the beam splitter and the first polarizing filter a second digital image of a second portion of the specimen with the camera at a second time after the first time;

analyzing the second digital image to identify a second region of interest;

generating a second enhanced image corresponding to the second digital image, automatically adjusting color and brightness in the identified second region of interest, by the digital image projector, and projecting the second enhanced image through the second polarizing filter and by the beam splitter into the ocular of the microscope;

determining a second location of the second digital image with respect to the reference point;

determining from the first digital image and the second digital image whether the specimen is at rest or in motion with respect to the reference point by evaluating average image blur or contrast gradients strength between the identified first region of interest and the identified second region of interest; and

if the specimen has been in motion with respect to the reference point and is thereafter at rest for a specified time period, storing the second digital image, the second enhanced image, and the second location in a storage device.

2. The method of claim 1 , wherein a portion of the digital image is darkened to provide greater contrast between the digital image and the enhanced image.

3. The method of claim 1 , further comprising capturing an image encompassing the whole specimen and storing the image of the whole specimen with the digital image of the portion of the specimen.

4. The method of claim 3 , wherein the image of the whole specimen further comprises calibration marks or labels near the specimen.

5. A system for reviewing a specimen with an optical microscope comprising:

the optical microscope having at least one objective lens and at least one ocular;

a beam splitter for diverting at least a portion of the light from the specimen to a digital camera and for diverting at least a portion of light from a digital image projector to the at least one ocular;

the digital camera for capturing, through the beam splitter and a first polarizing filter, a first digital image of a first portion of the specimen at a first time and then for capturing, also through the beam splitter and the first polarizing filter, a second digital image of a second portion of the specimen at a second time after the first time;

an image analysis module for analyzing the first digital image to identify a first region of interest and for analyzing the second digital image to identify a second region of interest;

the digital image projector for generating a first enhanced image corresponding to the first digital image, automatically adjusting color and brightness in the identified first region of interest, and projecting the first enhanced image into the at least one ocular by the beam splitter and through a second polarizing filter which polarizes light perpendicular to the first polarizing filter, and then for generating a second enhanced image corresponding to the second digital image, automatically adjusting color and brightness in the identified second region of interest, and projecting the second enhanced image into the at least one ocular also by the beam splitter and through the second polarizing filter; and

a data processing unit for determining a first location of the first digital image with respect to a reference point, for determining a second location for the second digital image with respect to the reference point, and for determining from the first digital image and the second digital image whether the specimen is at rest or in motion with respect to the reference point by evaluating average image blur or contrast gradients strength between the identified first region of interest and the identified second region of interest; and

wherein, if the specimen has been in motion with respect to the reference point and is thereafter at rest for a specified time period, the second captured digital image, the second enhanced image, and the second location are stored in a storage device.

6. The system of claim 5 , wherein a portion of the digital image is darkened to provide greater contrast between the digital image and the enhanced image.

7. The system of claim 5 , further comprising a second camera for capturing an image encompassing the whole specimen and storing the image of the whole specimen with the digital image of the portion of the specimen.

8. The system of claim 7 wherein the image of the whole specimen further comprises calibration marks or labels near the specimen.

9. The system of claim 5 , further comprising a liquid crystal display in an optical train between the ocular and the objective lens for blocking at least a portion of the light arriving in the ocular from the objective to increase the visibility of the enhanced image from the digital image projector.

10. A computer program product for reviewing a specimen with an optical microscope comprising a processor, memory accessible from the processor for performing the steps of:

capturing through a beam splitter and a first polarizing filter a first digital image of a first portion of the specimen with a camera at a first time;

displaying the first digital image through an ocular of the microscope;

analyzing the first digital image to identify a first region of interest;

generating a first enhanced image corresponding to the first digital image, automatically adjusting color and brightness in the identified first region of interest, by a digital image projector, and projecting the first enhanced image through a second polarizing filter, which polarizes light perpendicular to the first polarizing filter, and by the beam splitter into the ocular of the microscope;

determining a first location of the first digital image with respect to a reference point;

capturing through the beam splitter and the first polarizing filter a second digital image of a second portion of the specimen with the camera at a second time after the first time;

analyzing the second digital image to identify a second region of interest;

generating a second enhanced image corresponding to the second digital image, automatically adjusting color and brightness in the identified second region of interest, by the digital image projector, and projecting the second enhanced image through the second polarizing filter and by the beam splitter into the ocular of the microscope;

determining a second location of the second digital image with respect to the reference point;

determining from the first digital image and the second digital image whether the specimen is at rest or in motion with respect to the reference point by evaluating average image blur or contrast gradients strength between the identified first region of interest and the identified second region of interest; and

if the specimen has been in motion with respect to the reference point and is thereafter at rest for a specified time period, storing the second digital image, the second enhanced image, and the second location in a storage device.

11. The computer program product of claim 10 , wherein a portion of the digital image is darkened to provide greater contrast between the digital image and the enhanced image.

12. The computer program product of claim 10 , further comprising capturing an image encompassing the whole specimen and storing the image of the whole specimen with the digital image of a portion of the specimen.

13. The computer program product of claim 12 , wherein the image of the whole specimen further comprises calibration marks or labels near the specimen.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2020
From: SIEGEL, GABRIEL; REGELMAN, DAN VADIM
To: AUGMENTIQS MEDICAL LTD.
Reel/Frame 054653/0755 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2019
From: SIEGEL, GABRIEL; REGELMAN, DAN VADIM
To: AUGMENTIQS MEDICAL LTD.
Reel/Frame 048474/0997 →
Continuity (2)
Provisional Application 62380425 · Aug 28, 2016
Related Publication 20200211233A1 · Jul 2, 2020
Cited By (5)
US 12,346,509 US 12,354,271 US 12,578,567 US 12,631,865 US 12,689,822