Methods and systems for ocular imaging, diagnosis and prognosis
A method for prognosing disease in an eye, the method including: receiving present eye image data representative of the eye at a present time; analyzing the present eye image data using a neural network to generate a prediction for future eye image data representative of the eye at a future time; and generating a prognostic parameter for the eye from the future eye image data, wherein the neural network is trained using past eye image data representative of a plurality of eyes at first and second past times to generate one or more eye image data change functions, wherein the eye image data change function is applied by the neural network to the present eye image data to generate the prediction for the future eye image data.
1 . A computer-implemented method for prognosing disease in an eye, the method comprising:
receiving present eye image data representative of the eye at a present time;
analyzing the present eye image data using a neural network to generate a prediction for future eye image data representative of the eye at a future time; and
generating a prognostic parameter for the eye from the future eye image data,
wherein the neural network is trained using past eye image data representative of a plurality of eyes at first and second past times to generate one or more eye image data change functions, wherein the eye image data change function is applied by the neural network to the present eye image data to generate the prediction for the future eye image data.
2 . A computer-implemented method as claimed in claim 1 , wherein the neural network is further trained using past eye image data representative of a plurality of eyes at a third past time to refine the eye image data change function.
3 . A computer-implemented method as claimed in claim 1 , wherein the past eye image data is first past eye image data and the present eye image data is first present eye image data, and the first past eye image data and the first present eye image data are obtained from a first imaging modality, and the method further comprises:
receiving second present eye image data representative of the eye at the present time, the second present eye image data being obtained from a second imaging modality, wherein the second imaging modality is different from the first imaging modality;
analyzing the first and second present eye image data using the neural network to generate the prediction for future eye image data representative of the eye at the future time,
wherein the neural network is further trained using second past eye image data representative of the plurality of eyes at first and second past times in the second imaging modality to generate the eye image data change function.
4 . A computer-implemented method as claimed in claim 3 , wherein the first and second imaging modalities indicate features of the eye that are selected from the group consisting of: anatomical; physiological; and functional features.
5 . A computer-implemented method as claimed in claim 3 , wherein the first and second imaging modalities are selected from the group consisting of: magnetic resonance imaging (MRI); fundus photography; optical coherence tomography (OCT); optical coherence tomography angiography (OCTA); X-ray; computer tomography (CT); biometry; ultrasound; keratometry; corneal topography imaging; retinal perfusion mapping and laser speckle flowmetry.
6 . A computer-implemented method as claimed in claim 3 , wherein the method comprises receiving the first past and/or present eye image data and the second past and/or present eye image data as a combined data set.
7 . A computer-implemented method as claimed in claim 6 , wherein the method comprises receiving the first past and/or present eye image data and the second past and/or present eye image data in the form of data representative of a model of the eye.
8 . A computer-implemented method as claimed in claim 1 , wherein the eye image data change function comprises one or more matrices of change.
9 . A computer-implemented method as claimed in claim 1 , wherein the neural network comprises a long short-term memory (LTSM) network.
10 . A computer-implemented method as claimed in claim 9 , wherein the neural network is an ensemble neural network comprising a first neural network to analyze past and/or present eye image data from the first imaging modality and a second neural network to analyze past and/or present eye image data from the second imaging modality, wherein the ensemble neural network comprises a fully connected layer receiving outputs from each of the first and second neural networks, the output of the fully connected layer being input to the long short-term memory (LTSM) network.
11 . A computer-implemented method as claimed in claim 1 , wherein the neural network is trained using past eye treatment data representative of prior treatments undergone by the plurality of eyes, and the method comprises generating a treatment prediction parameter comprising the prognostic parameter for the eye on the assumption a treatment is used on the eye.
12 . A computer-implemented method as claimed in any one of claim 1 , wherein the method further comprises outputting the prognostic parameter for the eye.