IP Library Granted Patent US 11,817,202
Granted Patent B2
US 11,817,202 · App. 17/474,676 · Granted Nov 14, 2023

Information processing apparatus, information processing method, and program

Inventor: Takeshi Ohashi (Kanagawa, JP)
G16H30/20G02B21/365G06T3/0006G06T5/50G06T11/00A61B6/5217A61B6/5294G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,817,202
App. No.
17/474,676
Granted
Nov 14, 2023
Kind
B2
Abstract

Provided is an information processing apparatus including an image supply unit that supplies a plurality of input images showing corresponding objects to an image processing unit and obtains a plurality of object images as an image processed result from the image processing unit, and a display control unit that synchronously displays the plurality of object images that have been obtained. The object images are regions including the corresponding objects extracted from the plurality of input images, and orientations, positions, and sizes of the corresponding objects of the plurality of object images are unified.

Claims (42)

1. An information processing method comprising:

obtaining a first microscopic image and a second microscopic image,

extracting a plurality of tissue areas from the first microscopic image and the second microscopic image using a detection dictionary which is pre-generated through learning using learning cellular tissue region images,

classifying the plurality of tissue areas into groups by image pattern using an automatic clustering technique,

determining a first tissue area of the first microscopic image and a second tissue area of the second microscopic image,

wherein the first microscopic image is at least one of a dark field image, a bright field image or a phase difference image,

wherein the second microscopic image is at least one of the dark field image, the bright field image or the phase difference image,

wherein the first microscopic image and the second microscopic image are images including cell tissue obtained from the same specimen, and

adjusting at least one of shapes, orientations, positions, and sizes of the second tissue area, and causing a display device to synchronously display the first tissue area and the adjusted second tissue area.

2. The information processing method according to claim 1 , wherein the step of classifying comprises classifying the plurality of tissue areas into groups based on the cellular tissue region images.

3. The information processing method according to claim 1 , wherein the first microscopic image and the second microscopic image are medial images.

4. The information processing method according to claim 1 , wherein the first microscopic image and the second microscopic image are images obtained by imaging tissue obtained by staining cell tissues cut out from the same specimen with different reagents.

5. The information processing method according to claim 1 , wherein the step of extracting comprises extracting a plurality of tissue areas from the first microscopic image and the second microscopic image based on training data comprising an image whose center is a cellular tissue region and an image whose center is a background portion.

6. A microscopic image processing system comprising:

a scanner configured to capture a microscopic image and generate image data representing the microscopic image; and

a memory storing executable user code which, when read, causes processing circuitry to:

obtain a first microscopic image and a second microscopic image,

extract a plurality of tissue areas from the first microscopic image and the second microscopic image using a detection dictionary which is pre-generated through learning using learning cellular tissue region images,

classify the plurality of tissue areas into groups by image pattern using an automatic clustering technique,

determine a first tissue area of the first microscopic image and a second tissue area of the second microscopic image,

wherein the first microscopic image is at least one of a dark field image, a bright field image or a phase difference image,

wherein the second microscopic image is at least one of the dark field image, the bright field image or the phase difference image,

wherein the first microscopic image and the second microscopic image are images including cell tissue obtained from the same specimen, and

adjust at least one of shapes, orientations, positions, and sizes of the second tissue area, and cause a display device to synchronously display the first tissue area and the adjusted second tissue area.

7. The microscopic image processing system according to claim 6 , wherein the operation of classify the plurality of tissue areas into groups comprises classifying the plurality of tissue areas into groups based on the cellular tissue region images.

8. The microscopic image processing system according to claim 6 , wherein the first microscopic image and the second microscopic image are medial images.

9. The microscopic image processing system according to claim 6 , wherein the first microscopic image and the second microscopic image are images obtained by imaging tissue obtained by staining cell tissues cut out from the same specimen with different reagents.

10. The microscopic image processing system according to claim 6 , wherein the operation of extract a plurality of tissue areas comprises extracting a plurality of tissue areas from the first microscopic image and the second microscopic image based on training data comprising an image whose center is a cellular tissue region and an image whose center is a background portion.

11. An information processing apparatus comprising:

a processor; and

a memory device, the memory device storing instructions that cause the processor to:

obtain a first microscopic image and a second microscopic image,

extract a plurality of tissue areas from the first microscopic image and the second microscopic image using a detection dictionary which is pre-generated through learning using learning microscopic images,

determine a first tissue area of the first microscopic image and a second tissue area of the second microscopic image,

wherein the first microscopic image is at least one of a dark field image, a bright field image or a phase difference image,

wherein the second microscopic image is at least one of the dark field image, the bright field image or the phase difference image,

wherein the first microscopic image and the second microscopic image are images including cell tissue obtained from the same specimen, and

adjust at least one of shapes, orientations, positions, and sizes of the second tissue area, and cause a display device to synchronously display the first tissue area and the adjusted second tissue area.

12. The information processing apparatus according to claim 11 , wherein the memory device further stores instructions that cause the processor to classify the plurality of tissue areas into groups based on the learning microscopic images.

13. The information processing apparatus according to claim 11 , wherein the first microscopic image and the second microscopic image are medial images.

14. The information processing apparatus according to claim 11 , wherein the first microscopic image and the second microscopic image are images obtained by imaging tissue obtained by staining cell tissues cut out from the same specimen with different reagents.

15. The information processing apparatus according to claim 11 , wherein the operation of extract a plurality of tissue areas comprises extracting a plurality of tissue areas from the first microscopic image and the second microscopic image based on training data comprising an image whose center is a cellular tissue region and an image whose center is a background portion.

Assignments (2)
CHANGE OF NAME Recorded Oct 4, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057698/0125 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2021
From: OHASHI, TAKESHI
To: SONY CORPORATION; JAPANESE FOUNDATION FOR CANCER RESEARCH
Reel/Frame 057684/0775 →
Priority Claims (1)
JP 2012-196008 · Sep 6, 2012 · national
Continuity (3)
Continuation 16249280 · Jan 16, 2019
Continuation 14424222
Related Publication 20210407654A1 · Dec 30, 2021