DETECTING ABNORMAL CELLS USING AUTOFLUORESCENCE MICROSCOPY
One example method includes receiving an image of a tissue sample stained with a stain; determining, by a first trained machine learning (“ML”) model using the image, a first set of abnormal cells in the tissue sample; receiving an autofluorescence image of the unstained tissue sample; determining, by a second trained ML model using the autofluorescence image and the first set of cells, a second set of abnormal cells, the second set of abnormal cells being a subset of the first set of abnormal cells; and identifying the abnormal cells of the second set of abnormal cells.
1 . A method comprising:
receiving an image of a tissue sample stained with a stain;
determining, by a first trained machine learning (“ML”) model using the image, a first set of abnormal cells in the tissue sample;
receiving an autofluorescence image of the unstained tissue sample;
determining, by a second trained ML model using the autofluorescence image and the first set of cells, a second set of abnormal cells, the second set of abnormal cells being a subset of the first set of abnormal cells; and
identifying the abnormal cells of the second set of abnormal cells.
2 . The method of claim 1 , wherein the autofluorescence image comprises a plurality of pixels and a vector of frequency channels per pixel, and further comprising:
for each abnormal cell in the first set of abnormal cells:
determining a set of pixels corresponding to the respective abnormal cell, and
generating an input vector from the vectors of the frequency channels for the set of pixels; and
wherein determining the second set of abnormal cells is based on the generated input vectors.
3 . The method of claim 2 , wherein generating the input vector for each abnormal cell comprises:
determining a maximum value for each frequency channel within the set of pixels, and
generating the input vector comprising, for each color channel, the maximum value of the respective color channel.
4 . The method of claim 2 , wherein generating the input vector for each abnormal cell comprises:
determining an average value for each frequency channel within the set of pixels, and
generating the input vector comprising, for each color channel, the average value of the respective frequency channel.
5 . The method of claim 1 , wherein identifying the abnormal cells comprises providing a visual indicator on the image of a tissue sample.
6 . The method of claim 1 , wherein the stain comprises a virtual stain.
7 . The method of claim 1 , wherein the stain comprises a hematoxylin and eosin (“H&E”) stain.
8 . The method of claim 1 , wherein the abnormal cells are ballooning cells associated with nonalcoholic steatohepatitis.
9 . A system comprising:
a non-transitory computer-readable medium; and
one or more processors communicatively coupled to the non-transitory computer-readable medium, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:
receive an image of a tissue sample stained with a stain;
determine, by a first trained machine learning (“ML”) model using the image, a first set of abnormal cells in the tissue sample;
receive an autofluorescence image of the unstained tissue sample;
determine, by a second trained ML model using the autofluorescence image and the first set of cells, a second set of abnormal cells, the second set of abnormal cells being a subset of the first set of abnormal cells; and
identify the abnormal cells of the second set of abnormal cells.
10 . The system of claim 9 , wherein the autofluorescence image comprises a plurality of pixels and a vector of frequency channels per pixel, and wherein the one or more processors configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to, for each abnormal cell in the first set of abnormal cells:
determine a set of pixels corresponding to the respective abnormal cell, and
generate an input vector from the vectors of the frequency channels for the set of pixels; and
determine, by the second trained ML model using the autofluorescence image and the first set of cells, including the input vectors, the second set of abnormal cells.
11 . The system of claim 10 , wherein the one or more processors configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:
determine a maximum value for each frequency channel within the set of pixels, and
generate the input vector comprising, for each color channel, the maximum value of the respective color channel.
12 . The system of claim 10 , wherein the one or more processors configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:
determine an average value for each frequency channel within the set of pixels, and
generate the input vector comprising, for each color channel, the average value of the respective frequency channel.
13 . The system of claim 9 , wherein the one or more processors configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to provide a visual indicator on the image of a tissue sample.
14 . (canceled)
15 . (canceled)
16 . The system of claim 9 , wherein the abnormal cells are ballooning cells associated with nonalcoholic steatohepatitis.
17 . A non-transitory computer-readable medium comprising processor-executable instructions configured to cause one or more processors to:
receive an image of a tissue sample stained with a stain;
determine, by a first trained machine learning (“ML”) model using the image, a first set of abnormal cells in the tissue sample;
receive an autofluorescence image of the unstained tissue sample;
determine, by a second trained ML model using the autofluorescence image and the first set of cells, a second set of abnormal cells, the second set of abnormal cells being a subset of the first set of abnormal cells; and
identify the abnormal cells of the second set of abnormal cells.
18 . The non-transitory computer-readable medium of claim 17 , wherein the autofluorescence image comprises a plurality of pixels and a vector of frequency channels per pixel, and further comprising processor-executable instructions configured to cause the one or more processors to, for each abnormal cell in the first set of abnormal cells:
determine a set of pixels corresponding to the respective abnormal cell, and
generate an input vector from the vectors of the frequency channels for the set of pixels; and
determine, by the second trained ML model using the autofluorescence image and the first set of cells, including the input vectors, the second set of abnormal cells.
19 . The non-transitory computer-readable medium of claim 18 , further comprising processor-executable instructions configured to cause the one or more processors to:
determine a maximum value for each frequency channel within the set of pixels, and
generate the input vector comprising, for each color channel, the maximum value of the respective color channel.
20 . The non-transitory computer-readable medium of claim 18 , further comprising processor-executable instructions configured to cause the one or more processors to:
determine an average value for each frequency channel within the set of pixels, and
generate the input vector comprising, for each color channel, the average value of the respective frequency channel.
21 . The non-transitory computer-readable medium of claim 17 , further comprising processor-executable instructions configured to cause the one or more processors to provide a visual indicator on the image of a tissue sample.
22 . (canceled)
23 . (canceled)
24 . The system of claim 9 , wherein the abnormal cells are ballooning cells associated with nonalcoholic steatohepatitis.