Systems and methods for image reconstruction
View Patent ↗The present disclosure provides a system for image reconstruction. The system may obtain an initial image of a subject. The initial image may be generated based on scan data of the subject that is collected by an imaging device. The system may also generate a gradient image associated with the initial image. The system may further generate a target image of the subject by applying an image reconstruction model based on the initial image and the gradient image. The target image may have a higher image quality than the initial image.
1. A system for image reconstruction, comprising:
at least one storage device including a set of instructions; and
at least one processor configured to communicate with the at least one storage device, wherein when executing the set of instructions, the at least one processor is configured to direct the system to perform operations including:
obtaining an initial image of a subject, the initial image being generated based on scan data of the subject that is collected by an imaging device;
generating a gradient image associated with the initial image;
determining a model input based on the initial image and the gradient image; and
generating a target image of the subject by inputting the model input into an image reconstruction model, the target image having a higher image quality than the initial image.
2. The system of claim 1 , wherein each of the initial image and the gradient image is a 3-dimensional (3D) image, and the determining a model input based on the initial image and the gradient image includes:
extracting at least one first 2-dimensional (2D) image from the initial image;
extracting at least one second 2D image from the gradient image; and
determining, based on the at least one first 2D image and the at least one second 2D image, the model input.
3. The system of claim 2 , wherein:
the at least one first 2D image includes at least one first axial image, at least one first sagittal image, and at least one first coronary image extracted from the initial image; and
the at least one second 2D image includes at least one second axial image, at least one second sagittal image, and at least one second coronary image extracted from the gradient image.
4. The system of claim 3 , wherein the determining, based on the at least one first 2D image and the at least one second 2D image, the model input includes:
generating a first concatenated image by concatenating the at least one first axial image and the at least one second axial image;
generating a second concatenated image by concatenating the at least one first sagittal image and the at least one second sagittal image;
generating a third concatenated image by concatenating the at least one first coronary image and the at least one second coronary image; and
determining the model input based on the first concatenated image, the second concatenated image, and the third concatenated image.
5. The system of claim 4 , wherein the image reconstruction model includes:
an axial view component configured to generate a first feature map by processing the first concatenated image;
a sagittal view component configured to generate a second feature map by processing the second concatenated image;
a coronary view component configured to generate a third feature map by processing the third concatenated image; and
an integration component configured to generate an output image by processing the first feature map, the second feature map, and the third feature map, wherein the target image is generated based on the output image of the integration component.
6. The system of claim 2 , wherein the image reconstruction model is a trained cascaded neural network including a plurality of trained models that are sequentially connected, the plurality of trained models include a trained first model and one or more trained second models downstream to the trained first model, and the generating the target image by applying the image reconstruction model on the at least one first 2D image and the at least one second 2D image includes:
obtaining an output image of the trained first model by inputting the at least one first 2D image and the at least one second 2D image into the trained first model;
for each of the one or more trained second models,
extracting at least one third 2D image from an output image of a previous trained model connected to the trained second model; and
obtaining an output image of the trained second model by inputting the at least one first 2D image, the at least one second 2D image, and the at least one third 2D image into the trained second model, wherein the target image is generated based on an output image of the last trained second model of the trained cascaded neural network.
7. The system of claim 1 , wherein the scan data of the initial image corresponds to a first radiation dose associated with the subject, and the target image corresponds to a second radiation dose higher than the first radiation dose.
8. The system of claim 1 , wherein the image reconstruction model corresponds to a target image resolution, the initial image has an image resolution different from the target image resolution, and the at least one processor is further configured to direct the system to perform the operations including:
generating a resampled initial image having the target image resolution by resampling the initial image;
generating a preprocessed initial image by normalizing the resampled initial image; and
generating a preprocessed gradient image by normalizing the gradient image, and wherein the determining a model input based on the initial image and the gradient image includes:
determining, based on the preprocessed initial image and the preprocessed gradient image, the model input.
9. The system of claim 1 , wherein the image quality relates to at least one of an image resolution, a noise level, a contrast ratio, or a sharpness.
10. The system of claim 1 , wherein the image reconstruction model is further configured to reduce noise in the initial image.
11. The system of claim 1 , wherein the image reconstruction model includes a neural network model.
12. A method for image reconstruction implemented on a computing device having at least one processor and at least one storage device, the method comprising:
obtaining an initial image of a subject, the initial image being generated based on scan data of the subject that is collected by an imaging device;
generating a gradient image associated with the initial image;
determining a model input based on the initial image and the gradient image; and
generating a target image of the subject by inputting the model input into an image reconstruction model, the target image having a higher image quality than the initial image.
13. The method of claim 12 , wherein each of the initial image and the gradient image is a 3-dimensional (3D) image, and the determining a model input based on the initial image and the gradient image includes:
extracting at least one first 2-dimensional (2D) image from the initial image;
extracting at least one second 2D image from the gradient image; and
determining, based on the at least one first 2D image and the at least one second 2D image, the model input.
14. The method of claim 13 , wherein:
the at least one first 2D image includes at least one first axial image, at least one first sagittal image, and at least one first coronary image extracted from the initial image; and
the at least one second 2D image includes at least one second axial image, at least one second sagittal image, and at least one second coronary image extracted from the gradient image.
15. The method of claim 14 , wherein the determining, based on the at least one first 2D image and the at least one second 2D image, the model input includes:
generating a first concatenated image by concatenating the at least one first axial image and the at least one second axial image;
generating a second concatenated image by concatenating the at least one first sagittal image and the at least one second sagittal image;
generating a third concatenated image by concatenating the at least one first coronary image and the at least one second coronary image; and
determining the model input based on the first concatenated image, the second concatenated image, and the third concatenated image.
16. The method of claim 15 , wherein the image reconstruction model includes:
an axial view component configured to generate a first feature map by processing the first concatenated image;
a sagittal view component configured to generate a second feature map by processing the second concatenated image;
a coronary view component configured to generate a third feature map by processing the third concatenated image; and
an integration component configured to generate an output image by processing the first feature map, the second feature map, and the third feature map, wherein the target image is generated based on the output image of the integration component.
17. The method of claim 13 , wherein the image reconstruction model is a trained cascaded neural network including a plurality of trained models that are sequentially connected, the plurality of trained models include a trained first model and one or more trained second models downstream to the trained first model, and the generating the target image by applying the image reconstruction model on the at least one first 2D image and the at least one second 2D image includes:
obtaining an output image of the trained first model by inputting the at least one first 2D image and the at least one second 2D image into the trained first model;
for each of the one or more trained second models,
extracting at least one third 2D image from an output image of a previous trained model connected to the trained second model; and
obtaining an output image of the trained second model by inputting the at least one first 2D image, the at least one second 2D image, and the at least one third 2D image into the trained second model, wherein the target image is generated based on an output image of the last trained second model of the trained cascaded neural network.
18. The method of claim 12 , wherein the scan data of the initial image corresponds to a first radiation dose associated with the subject, and the target image corresponds to a second radiation dose higher than the first radiation dose.
19. The method of claim 12 , wherein the image reconstruction model corresponds to a target image resolution, the initial image has an image resolution different from the target image resolution, and the method further includes:
generating a resampled initial image having the target image resolution by resampling the initial image;
generating a preprocessed initial image by normalizing the resampled initial image; and
generating a preprocessed gradient image by normalizing the gradient image, and wherein the determining a model input based on the initial image and the gradient image includes:
determining, based on the preprocessed initial image and the preprocessed gradient image, the model input.
20. The method of claim 12 , wherein the image quality relates to at least one of an image resolution, a noise level, a contrast ratio, or a sharpness.