Systems and methods for delivery of digital biomarkers and genomic panels
Systems and methods are disclosed for receiving one or more digital images associated with a tissue specimen, a related case, a patient, and/or a plurality of clinical information, determining one or more of a prediction, a recommendation, and/or a plurality of data for the one or more digital images using a machine learning system, the machine learning system having been trained using a plurality of training images, to predict a biomarker and a plurality of genomic panel elements, and determining, based on the prediction, the recommendation, and/or the plurality of data, whether to log an output and at least one visualization region as part of a case history within a clinical reporting system.
1. A computer-implemented method for processing an electronic image corresponding to a specimen, the method comprising:
receiving one or more digital images associated with a tissue specimen, a related case, a patient, and/or a plurality of clinical information;
determining a prediction of a biomarker and a plurality of genomic panel elements, for the one or more digital images using a machine learning system, the machine learning system having been trained using a plurality of training images, to predict the biomarker and the plurality of genomic panel elements;
generating, based on the prediction of the predicted biomarker and genomic panel elements, a list of recommended treatment pathways;
determining, based on the prediction of the predicted biomarker and genomic panel elements, whether to log an output and at least one visualization region as part of a case history within a clinical reporting system; and
generating one or more displays of at least one recommended treatment of the list of recommended treatment pathways based on the prediction of the predicted biomarker and genomic panel elements, through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a side by side visualization of the one or more digital images with the prediction displayed and the one or more digital images without the prediction displayed.
2. The computer-implemented method of claim 1 , wherein the method further comprises generating a notification indicating that the prediction or the side by side visualization for the one or more digital images is available.
3. The computer-implemented method of claim 1 , wherein the method further comprises generating an option for a user to review the prediction or the side by side visualization.
4. The computer-implemented method of claim 1 , wherein the side by side visualization comprises digital immunohistochemistry or genomic panel results comprising a summary of digital tests run with at least one result.
5. The computer-implemented method of claim 1 , wherein determining the prediction comprises:
receiving one or more digitized images of a pathology specimen, related information, clinical information, and patient information;
developing a system that stores and archives a plurality of images and a plurality of corresponding patient data;
determining at least one predicted biomarker and at least one predicted genomic panel element, based on the plurality of images and the plurality of corresponding patient data; and
converting one or more prediction value and at least one treatment pathway recommendation to a form readable by a user.
6. The computer-implemented method of claim 5 , further comprising outputting the one or more prediction value and the at least one treatment pathway recommendation to a user interface.
7. The computer-implemented method of claim 5 , wherein the at least one treatment pathway is based on a plurality of clinical practice guidelines.
8. The computer-implemented method of claim 1 , wherein the at least one treatment pathway comprises a validated treatment pathway, a new treatment pathway, and/or a clinical treatment pathway based on the prediction.
9. A system for processing an electronic image corresponding to a specimen, the system comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to perform operations comprising:
receiving one or more digital images associated with a tissue specimen, a related case, a patient, and/or a plurality of clinical information;
determining a prediction of a biomarker and a plurality of genomic panel elements, for the one or more digital images using a machine learning system, the machine learning system having been trained using a plurality of training images, to predict the biomarker and the plurality of genomic panel elements;
generating, based on the prediction of the predicted biomarker and genomic panel elements, a list of recommended treatment pathways;
determining, using the machine learning system and based on the prediction, whether to log an output and at least one visualization region as part of a case history within a clinical reporting system; and
generating a visualization of digital immunohistochemistry or genomic panel results based on the prediction of the predicted biomarker and genomic panel elements by at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a side by side visualization of the one or more digital images with the prediction displayed and the one or more digital images without the prediction displayed.
10. The system of claim 9 , the operations further comprising:
generating a notification indicating that the prediction or the visualization for the one or more digital images is available.
11. The system of claim 9 , the operations further comprising: generating an option for a user to review the prediction or the side by side visualization.
12. The system of claim 9 , the operations further comprising: generating one or more displays of at least one recommended treatment based on the prediction.
13. The system of claim 9 , the operations further comprising:
generating one or more displays of at least one recommended treatment based on the prediction, through at least one of through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a side by side visualization of the one or more digital images with the prediction displayed and the one or more digital images without the prediction displayed.
14. The system of claim 9 , wherein the recommendation of at least one treatment pathway is based on a plurality of clinical practice guidelines.
15. The system of claim 9 , wherein determining the prediction comprises:
receiving one or more digitized images of a pathology specimen, related information, clinical information, and patient information;
developing a system that stores and archives a plurality of images and a plurality of corresponding patient data;
determining at least one predicted biomarker and at least one predicted genomic panel element, based on the plurality of images and the plurality of corresponding patient data; and
converting one or more prediction value and at least one treatment pathway recommendation to a form readable by a user.
16. The system of claim 15 , the operations further comprising outputting the one or more prediction value and the at least one treatment pathway recommendation to a user interface.
17. The system of claim 9 , wherein the at least one treatment pathway comprises a clinical trial and/or a treatment based on the prediction.
18. A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform operations for monitoring health of a population, the operations comprising:
receiving one or more digital images associated with a tissue specimen, a related case, a patient, and/or a plurality of clinical information;
determining a prediction of a biomarker and a plurality of genomic panel elements, the one or more digital images using a machine learning system, the machine learning system having been trained using a plurality of training images, to predict the biomarker and the plurality of genomic panel elements;
generating a list of recommended treatment pathways based on the prediction of the predicted biomarker and genomic panel elements;
determining, based on the prediction of the predicted biomarker and genomic panel elements, to log an output and at least one visualization region as part of a case history within a clinical reporting system; and
generating one or more displays of at least one recommended treatment, based on the prediction of the predicted biomarker and genomic panel elements, through at least one of an overlay of at least one region of interest layered on top of the one or more digital images and a side by side visualization of the one or more digital images with the prediction displayed and the one or more digital images without the prediction displayed.
19. The computer readable medium of claim 18 , wherein the operations further comprise generating a notification indicating that the prediction or the side by side visualization for the one or more digital images is available.