IP Library Granted Patent US 10,690,902
Granted Patent B2
US 10,690,902 · App. 16/160,244 · Granted Jun 23, 2020

Image processing device and microscope system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,690,902
App. No.
16/160,244
Granted
Jun 23, 2020
Kind
B2
Abstract

Visual observation of morphological features of a cell group or individual cells acquired in 3D image data is facilitated, thus improving observation accuracy. Provided is an image processing device that generates, on the basis of a plurality of 2D images acquired by a microscope at different focus positions on a cell clump, 3D images of respective cells constituting the cell clump, that processes the generated 3D images and analyzes feature amounts on the basis of at least one measurement parameter, that displays analysis results in a graph, that allows a user to select a region of interest on the displayed graph, and that generates, from the 3D images that correspond to the plurality of cells that are included in the selected region of interest, 2D display images each in a plane with reference to an axis that is determined on the basis of a shape feature of the corresponding cell and displays the 2D display images in a list.

Claims (40)

1. An image processing device comprising at least one processor that is provided with hardware,

wherein the at least one processor is configured to:

generate, based on a plurality of 2D images acquired by a microscope at different focus positions of a cell clump, 3D images of respective cells constituting the cell clump;

process the generated 3D images and statistically analyze feature quantities based on at least one measurement parameter;

display analysis results of the statistical analysis in a graph;

allow a user to select a region of interest on the displayed graph; and

generate, from the 3D images that correspond to the plurality of cells that are included in the selected region of interest, 2D display images each in a plane with reference to an axis that is determined based on a shape feature of the corresponding cell, and display the 2D display images in a list as a gallery display.

2. The image processing device according to claim 1 , further comprising a storage unit that stores at least one computer program to be executed by the at least one processor.

3. The image processing device according to claim 1 , wherein the axis is a longitudinal axis of the cell.

4. The image processing device according to claim 3 , wherein the plane is a plane that includes a center-of-gravity position of the cell, from among planes perpendicular to the longitudinal axis or planes along the longitudinal axis.

5. The image processing device according to claim 3 , wherein the plane is a plane that includes a center position of the cell in a longitudinal-axis direction of the cell, from among planes perpendicular to the longitudinal axis.

6. The image processing device according to claim 3 , wherein the plane is a plane that includes a center-of-gravity position of the cell, from among planes along the longitudinal axis.

7. The image processing device according to claim 3 , wherein the plane is a plane perpendicular to the longitudinal axis or a plane along the longitudinal axis; and

wherein each of the display images comprises an image in which a maximum value of a brightness of pixels arrayed in the longitudinal-axis direction or in a direction perpendicular to the longitudinal-axis direction is projected on the plane.

8. An image processing device comprising at least one processor that is provided with hardware,

wherein the at least one processor is configured to:

generate, based on a plurality of 2D images acquired by a microscope at different focus positions of a plurality of cell clumps, 3D images of the respective cell clumps;

process the generated 3D images and statistically analyze feature amounts based on at least one measurement parameter;

display analysis results of the statistical analysis in a graph;

allow a user to select a region of interest on the displayed graph; and

generate, from the 3D images that correspond to the plurality of cell clumps that are included in the selected region of interest, 2D display images each in a plane with reference to an axis that is determined based on a shape feature of the corresponding cell clump, and display the 2D display images in a list as a gallery display.

9. The image processing device according to claim 8 , further comprising a storage unit that stores at least one computer program to be executed by the at least one processor.

10. The image processing device according to claim 8 , wherein the axis is a longitudinal axis of the cell clump.

11. The image processing device according to claim 10 , wherein the plane is a plane that includes a center-of-gravity position of the cell clump, from among planes perpendicular to the longitudinal axis or planes along the longitudinal axis.

12. The image processing device according to claim 10 , wherein the plane is a plane that includes a center position of the cell clump in a longitudinal-axis direction of the cell clump, from among planes perpendicular to the longitudinal axis.

13. The image processing device according to claim 10 , wherein the plane is a plane that includes a center-of-gravity position of the cell clump, from among planes along the longitudinal axis.

14. The image processing device according to claim 10 , wherein the plane is a plane perpendicular to the longitudinal axis or a plane along the longitudinal axis; and

wherein each of the display images comprises an image in which a maximum value of a brightness of pixels arrayed in the longitudinal-axis direction or in a direction perpendicular to the longitudinal-axis direction is projected on the plane.

15. A microscope system comprising:

the image processing device according to claim 1 ; and

the microscope that acquires the plurality of 2D images at the different focus positions of the cell clump.

16. A microscope system comprising:

the image processing device according to claim 8 ; and

the microscope that acquires the plurality of 2D images at the different focus positions of the cell clumps.

17. A non-transitory computer-readable medium that stores a computer-readable program for implementing a control method for controlling a microscope system, the method comprising:

generating, based on a plurality of 2D images acquired by a microscope at different focus positions of a cell clump, 3D images of respective cells constituting the cell clump;

processing the generated 3D images and statistically analyzing feature amounts based on at least one measurement parameter;

displaying analysis results of the statistical analysis in a graph;

allowing a user to select a region of interest on the displayed graph; and

generating, from the 3D images that correspond to the plurality of cells that are included in the selected region of interest, 2D display images each in a plane with reference to an axis that is determined based on a shape feature of the corresponding cell, and displaying the 2D display images in a list as a gallery display.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2023
From: OLYMPUS CORPORATION
To: EVIDENT CORPORATION
Reel/Frame 062492/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2018
From: KITAGAWA, HISAO; YAMASHITA, YUSUKE
To: OLYMPUS CORPORATION
Reel/Frame 047166/0747 →