IP Library Granted Patent US 11,861,921
Granted Patent B2
US 11,861,921 · App. 17/357,357 · Granted Jan 2, 2024

Microscope system

Inventors: Yuta Ohara (Tokyo, JP); Toshiyuki Hattori (Tokyo, JP); Masayoshi Karasawa (Tokyo, JP)
Assignee: Evident Corporation
G06V20/693G02B21/0088G02B21/086G06T7/0012G06T2207/10056G06T2207/20081G06T2207/20084G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,861,921
App. No.
17/357,357
Granted
Jan 2, 2024
Kind
B2
Abstract

An inverted microscope system provided with a transillumination subsystem that illuminates a sample includes: an eyepiece lens; an objective; a tube lens; a projection device, disposed below the objective, that projects a projected image based on projected image data onto an image plane where an optical image is formed; a first modulation element included in the transillumination subsystem; a second modulation element disposed between the objective and the tube lens; and a processor and a memory, the processor being configured to perform the following steps: generating an analysis result that specifies a candidate cell that is a reproductive cell suitable for fertilization, based on at least the digital image data acquired by the imaging device; and generating the projected image data based on the generated analysis result, wherein the projected image includes a first assisting image that specifies the candidate cell as an assisting image that assists with micro-insemination.

Claims (62)

1. An inverted microscope system provided with a transillumination subsystem that illuminates a sample, the inverted microscope system comprising:

an eyepiece lens;

an objective that guides transmitted light transmitted through the sample to the eyepiece lens;

a tube lens, disposed between the eyepiece lens and the objective, that forms an optical image of the sample on a basis of the transmitted light;

an imaging device that acquires digital image data of the sample on a basis of the transmitted light;

a projection device, disposed below the objective, that projects a projected image on a basis of projected image data onto an image plane where the optical image is formed;

a first modulation element, included in the transillumination subsystem, that modulates illuminating light irradiating the sample;

a second modulation element, disposed between the objective and the tube lens, that modulates the transmitted light; and

a processor and a memory, the processor being configured to perform the following steps:

generating an analysis result that specifies a candidate cell, that is, a reproductive cell suitable for fertilization from among reproductive cells included in the sample, on a basis of at least the digital image data acquired by the imaging device; and

generating the projected image data on a basis of the generated analysis result, wherein

the projected image includes a first assisting image that specifies the candidate cell as an assisting image that assists with micro-insemination using the sample.

2. The inverted microscope system according to claim 1 , wherein

the projected image includes the first assisting image at a position in the projected image that does not overlap with an image of the candidate cell included in the optical image when the projected image is projected onto the image plane.

3. The inverted microscope system according to claim 1 , wherein

the first assisting image has a shape that surrounds the image of the candidate cell or a shape that points out the image of the candidate cell.

4. The inverted microscope system according to claim 1 , wherein

the first assisting image has an appearance according to a degree of recommendation of the candidate cell specified by the first assisting image.

5. The inverted microscope system according to claim 4 , wherein

the first assisting image has a color according to a degree of recommendation of the candidate cell specified by the first assisting image.

6. The inverted microscope system according to claim 1 , wherein

the processor is configured to analyze the reproductive cell on a basis of at least one of an appearance of the reproductive cell or a motility of the reproductive cell.

7. The inverted microscope system according to claim 1 , further comprising:

a switching device on which a plurality of objectives including the objective are installed, the switching device switching the objective disposed on an optical path from among the plurality of objectives, wherein

the processor is configured to

in a case where an objective having a magnification equal to or higher than a predetermined magnification in combination with the tube lens is disposed on the optical path by the switching device,

generate the analysis result that specifies the candidate cell, and

generate the projected image data corresponding to the projected image including the first assisting image as the assisting image on a basis of the analysis result, and

in a case where an objective having a magnification lower than the predetermined magnification in combination with the tube lens is disposed on the optical path by the switching device,

generate a second analysis result that specifies a candidate region, the candidate region being a region of the sample in which an amount of movement by reproductive cells inside the candidate region is greater than the amount of movement by reproductive cells inside other regions of the sample, and

generate the projected image data corresponding to the projected image including a second assisting image as the assisting image on a basis of the second analysis result, the second assisting image being an image that specifies the candidate region.

8. The inverted microscope system according to claim 1 , wherein

the processor is configured to use a trained neural network to at least analyze the digital image data, and

the trained neural network is a neural network that has been trained using image data corresponding to images of reproductive cells labeled as suitable or unsuitable for fertilization as teaching data.

9. The inverted microscope system according to claim 1 , wherein

the processor is configured to

generate pointer image data corresponding to a pointer image that points out a position according to a first input operation by a user, and

record an image of a target object included in the sample as a teaching image, the target object being specified on a basis of the position of the pointer image when a second input operation by the user is detected, and

the projection device projects the pointer image onto the image plane on a basis of the pointer image data.

10. The inverted microscope system according to claim 1 , wherein

the sample includes sperm,

the processor is configured to generate the projected image data on a basis of the digital image data and other data, and

the other data includes at least one of data about a culture fluid in which the sample is cultivated, clinical data about a mother, or an examination result regarding semen containing the sperm.

11. The inverted microscope system according to claim 1 , further comprising:

an identification device that acquires identification information attached to the sample, wherein

the processor is configured to

acquire information about a patient providing the sample on a basis of the identification information acquired by the identification device, and

generate the projected image data on a basis of at least the digital image data and the information about the patient, the projected image including a seventh assisting image that indicates the information about the patient as the assisting image.

12. The inverted microscope system according to claim 1 , wherein

the processor is configured to

acquire an elapsed time since a predetermined operation was detected, and

generate the projected image data on a basis of at least the digital image data and the elapsed time, the projected image including an eighth assisting image that indicates the elapsed time as the assisting image.

13. The inverted microscope system according to claim 1 , further comprising:

an intermediate magnification change unit, disposed between the objective and the tube lens, that changes a magnification of the optical image.

14. The inverted microscope system according to claim 1 , wherein

the first modulation element includes a first polarizing plate, a light-shielding plate having a slit formed therein, and a second polarizing plate that covers a portion of the slit, and

the second modulation element includes a modulator having three zones with different degrees of transmittance.

15. The inverted microscope system according to claim 1 , wherein

the first modulation element includes a polarizer, and

the second modulation element includes an analyzer.

16. The inverted microscope system according to claim 1 , wherein

the image plane is formed between the tube lens and the eyepiece lens.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: OLYMPUS CORPORATION
To: EVIDENT CORPORATION
Reel/Frame 061008/0214 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: OHARA, YUTA; HATTORI, TOSHIYUKI; KARASAWA, MASAYOSHI
To: OLYMPUS CORPORATION
Reel/Frame 056659/0207 →
Priority Claims (1)
JP 2018-247359 · Dec 28, 2018 · national
Continuity (2)
Continuation PCTJP2019051101 · Dec 26, 2019
Related Publication 20210319208A1 · Oct 14, 2021
Cited By (1)
US 12,245,793