Granted Patent B2

US 12,646,216 · App. 18/561,150 · Granted Jun 2, 2026

Inventors: Noe Kaneko (Kanagawa, JP); Hirokazu Tatsuta (Kanagawa, JP); Kazuhiro Nakagawa (Saitama, JP); Sakiko Yasukawa (Tokyo, JP); Noriyuki Kishii (Kanagawa, JP)

Assignee: Sony Group Corporation

G06T7/90G01N21/6428G01N21/6456G01N2021/6439G06T2207/10024G06T2207/10064G06T2207/20072G06T2207/30024

Abstract

Claims (52)

1 . An information processing device, comprising:

a simulated image generation unit that generates a simulated image by superimposing a non-stained image including an autofluorescence component and a dye tile image in which a reference spectrum of a first fluorescent dye and imaging noise of each of pixels of the non-stained image are associated;

a fluorescence separation unit that separates a component of the first fluorescent dye and the autofluorescence component on the basis of the simulated image and generates a separated image; and

an evaluation unit that evaluates a degree of separation of the separated image.

2 . The information processing device according to claim 1 , wherein

the dye tile image includes a reference spectrum of a second fluorescent dye in addition to the first fluorescent dye, and is an image in which the reference spectrum of each of the first fluorescent dye and the second fluorescent dye and the imaging noise of each of the pixels of the non-stained image are associated.

3 . The information processing device according to claim 1 , wherein

the imaging noise is noise that changes according to an imaging condition of the non-stained image.

4 . The information processing device according to claim 3 , wherein

the imaging condition of the non-stained image includes at least one or all of laser power, gain, and exposure time.

5 . The information processing device according to claim 1 , wherein

the dye tile image is a dye tile group having a plurality of dye tiles.

6 . The information processing device according to claim 5 , wherein

a size of each of the plurality of dye tiles is same as a size of a cell.

7 . The information processing device according to claim 5 , wherein

the plurality of dye tiles is arranged in a predetermined color arrangement pattern.

8 . The information processing device according to claim 5 , wherein

a degree of the imaging noise is quantified or visualized for each of the dye tiles.

9 . The information processing device according to claim 5 , wherein

the simulated image generation unit repeatedly arranges the dye tiles corresponding to a number of dyes designated by a user, and generates the dye tile image.

10 . The information processing device according to claim 5 , wherein

the simulated image generation unit mixes a plurality of dyes and creates the dye tile.

11 . The information processing device according to claim 1 , wherein

the simulated image generation unit determines spectral intensity of a dye to be imparted to autofluorescence intensity of the non-stained image.

12 . The information processing device according to claim 1 , wherein

the simulated image generation unit superimposes the imaging noise on a reference spectrum of the first fluorescent dye.

13 . The information processing device according to claim 12 , wherein

the imaging noise is shot noise.

14 . The information processing device according to claim 1 , wherein

the fluorescence separation unit separates the component of the first fluorescent dye and the autofluorescence component by color separation calculation including at least one of a least squares method, a weighted least squares method, or non-negative matrix factorization.

15 . The information processing device according to claim 1 , wherein

the evaluation unit

generates a histogram from the separated image,

calculates a signal separation value between a dye and a signal other than the dye from the histogram, and

evaluates the degree of separation on the basis of the signal separation value.

16 . The information processing device according to claim 1 , further comprising:

a recommendation unit that recommends an optimal reagent corresponding to a dye designated by a user on the basis of the degree of separation.

17 . The information processing device according to claim 16 , wherein

the recommendation unit generates an image indicating a combination of dyes or a combination of a dye and the reagent.

18 . The information processing device according to claim 16 , wherein

the recommendation unit generates an image indicating a combination of an antibody and a dye.

19 . A biological sample observation system, comprising:

an imaging device that acquires a non-stained image including an autofluorescence component; and

an information processing device that processes the non-stained image, wherein

the information processing device includes

a simulated image generation unit that generates a simulated image by superimposing the non-stained image and a dye tile image in which a reference spectrum of a first fluorescent dye and imaging noise of each of pixels of the non-stained image are associated,

a fluorescence separation unit that separates a component of the first fluorescent dye and the autofluorescence component on the basis of the simulated image and generates a separated image, and

an evaluation unit that evaluates a degree of separation of the separated image.

20 . An image generation method, comprising

generating a simulated image by superimposing a non-stained image including an autofluorescence component and a dye tile image in which a reference spectrum of a first fluorescent dye and imaging noise of each of pixels of the non-stained image are associated;

separating a component of the first fluorescent dye and the autofluorescence component on the basis of the simulated image and generates a separated image; and

evaluating a degree of separation of the separated image.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (33)