Systems and methods for determining blood vessel conditions
The disclosure relates to systems and methods for evaluating a blood vessel. The method includes receiving image data of the blood vessel acquired by an image acquisition device, and predicting, by a processor, blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel. The deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters on the blood vessel, where in the mapping the entire sequence of image patches contribute to the blood vessel condition parameters. The method further includes providing the blood vessel condition parameters of the blood vessel for evaluating the blood vessel.
1. A method for evaluating a blood vessel, comprising:
receiving image data of the blood vessel acquired by an image acquisition device;
predicting, by a processor, blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel, wherein the deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters of the blood vessel, wherein the deep learning model includes a convolutional neural network, a recursive neural network, and a conditional random field model connected in series, wherein parameters of the convolutional neural network, the recursive neural network, and the conditional random field model are jointly optimized; and
providing the blood vessel condition parameters of the blood vessel for evaluating the blood vessel.
2. The method of claim 1 , wherein the parameters include at least one of a number of network layers in the convolutional neural network or a number of nodes of each network layer.
3. The method of claim 1 , wherein the parameters include at least one of a number of hidden layers in the recursive neural network, a learning rate, or an initial value.
4. The method of claim 1 , wherein the deep learning model includes a plurality of convolutional neural networks connected in parallel, wherein each convolutional neural network receives a different sequence of image patches derived from the image data of the blood vessel, wherein the deep learning model further includes a connection layer that connects outputs of the plurality of convolutional neural networks.
5. The method of claim 4 , wherein the plurality of convolutional neural networks include a first convolutional neural network receiving a sequence of 2D image patches and a second convolutional neural network receiving a sequence of 3D image patches.
6. The method of claim 4 , wherein the plurality of convolutional neural networks include a first convolutional neural network receiving a sequence of image patches corresponding to a first projection angle on the blood vessel and a second convolutional neural network receiving a sequence of image patches corresponding to a second projection angle on the blood vessel.
7. The method of claim 1 , wherein the deep learning model comprises a forward long short-term memory network and a backward long short-term memory network connected in parallel.
8. The method of claim 1 , wherein the deep learning model is trained using training images of blood vessels and corresponding blood vessel condition parameters obtained by applying computer simulations to the training images or by performing measurements to the blood vessels.
9. The method of claim 1 , further comprising:
reconstructing a geometric model of the blood vessel using the acquired image data of the blood vessel;
extracting a center line of the blood vessel from the geometric model of the blood vessel;
intercepting a plurality of image patches along the extracted center line of the blood vessel; and
mapping the plurality of image patches to the blood vessel condition parameters using the deep learning model.
10. The method of claim 1 , wherein the blood vessel condition parameter includes at least one of fractional flow reserve, blood flow, blood flow velocity, micro vascular resistance, blood flow pressure drop and vascular stenosis.
11. The method of claim 1 , further comprising:
determining a treatment based on the blood vessel condition parameters of the blood vessel.
12. A system for evaluating a blood vessel, comprising:
a processor, configured to:
receive image data of the blood vessel acquired by an image acquisition device; and
predict blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel, wherein the deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters on the blood vessel, wherein the deep learning model includes a convolutional neural network, a recursive neural network, and a conditional random field model connected in series, wherein parameters of the convolutional neural network, the recursive neural network, and the conditional random field model are jointly optimized; and
a display configured to display the blood vessel condition parameters of the blood vessel for evaluating the blood vessel.
13. The system of claim 12 , wherein the deep learning model includes a plurality of convolutional neural networks connected in parallel, wherein each convolutional neural network receives a different sequence of image patches derived from the image data of the blood vessel, wherein the deep learning model further includes a connection layer that connects outputs of the plurality of convolutional neural networks.
14. The system of claim 13 , wherein the plurality of convolutional neural networks include a first convolutional neural network receiving a sequence of image patches corresponding to a first projection angle on the blood vessel and a second convolutional neural network receiving a sequence of image patches corresponding to a second projection angle on the blood vessel.
15. The system of claim 12 , wherein the deep learning model is trained using training images of blood vessels and corresponding blood vessel condition parameters obtained by applying computer simulations to the training images or by performing measurements to the blood vessels.
16. The system of claim 12 , wherein the processor is further configured to:
reconstruct a geometric model of the blood vessel using the acquired image data of the blood vessel;
extract a center line of the blood vessel from the geometric model of the blood vessel;
intercept a plurality of image patches along the extracted center line of the blood vessel; and
map the plurality of image patches to the blood vessel condition parameters using the deep learning model.
17. A non-transitory computer readable storage medium storing computer executable instructions thereon, which, when executed by a processor, implement a method for evaluating a blood vessel, comprising:
receiving image data of the blood vessel acquired by an image acquisition device;
predicting, by a processor, blood vessel condition parameters of the blood vessel by applying a deep learning model to the acquired image data of the blood vessel, wherein the deep learning model maps a sequence of image patches on the blood vessel to blood vessel condition parameters on the blood vessel, wherein the deep learning model includes a convolutional neural network, a recursive neural network, and a conditional random field model connected in series, wherein parameters of the convolutional neural network, the recursive neural network, and the conditional random field model are jointly optimized; and
providing the blood vessel condition parameters of the blood vessel for evaluating of the blood vessel.