Apparatus and methods for synthetizing medical images
An apparatus for synthetizing medical images, wherein the apparatus includes a process and a memory containing instructions configuring the processor to receive a heart model related to a patient's heart, identify a region of interest within the heart model, wherein identifying the region of interest includes locating at least a point of view on the heart model and determining a view angle corresponding to the at least a point of view, wherein the at least a point of view and the corresponding view angle define at least one field of view that include at least a portion of the heart model, and generate at least a medical image as a function of the region of interest using an image generator, wherein the at least a medical image captures an anatomical structure of the at least a portion of the heart model.
1. An apparatus for synthetizing medical images, wherein
the apparatus comprises:
at least a processor; and
a memory communicatively connected to the at least a processor, wherein the memory contains instructions configuring the at least a processor to:
receive a heart model related to a patient's heart;
identify a region of interest within the heart model, wherein identifying the region of interest comprises:
locating at least a point of view on the heart model; and
determining a view angle corresponding to the at least a point of view, wherein the at least a point of view and the corresponding view angle define at least one field of view that includes at least a portion of the heart model; and
generate at least a medical image as a function of the region of interest using an image generator, wherein the at least a medical image captures an anatomical structure of the at least a portion of the heart model, wherein the medical image comprises a real-time visualization of cardiac anatomy, wherein the image generator comprises a generative model comprising at least a variational autoencoder configured to allow data sample generation to be applied in a training of the image generator.
2. The apparatus of claim 1 , wherein receiving the heart model comprises:
constructing the heart model based on a patient profile pertaining to the patient using a computer vision module, wherein the patient profile comprises a set of images of the patient's heart and associated metadata.
3. The apparatus of claim 2 , wherein the patient profile further comprises electrocardiogram (ECG) data.
4. The apparatus of claim 1 , wherein receiving the heart model further comprises:
transforming the heart model to a second heart model using a Statistical Shape Model as a function of a plurality of mode changers within the Statistical Shape Model, wherein each mode changer of the plurality of mode changers is associated with a model feature of the heart model.
5. The apparatus of claim 1 , wherein the heart model comprises a 3D voxel occupancy representation (VOR) of the patient's heart.
6. The apparatus of claim 1 , wherein generating the at least a medical image further comprises:
executing a camera transformation program configured to simulate at least a perspective of a probe using the image generator.
7. The apparatus of claim 6 , wherein executing the camera transformation program comprises:
generating a projection of the anatomical structure by rendering the region of interest (ROI) as a function of a set of imaging parameters using a virtual camera positioned at the at least a point of view with the corresponding view angle.
8. The apparatus of claim 1 , wherein the image generator comprises a generative adversarial network (GAN).
9. The apparatus of claim 8 , wherein generating the at least a medical image further comprises:
training the GAN using a plurality of anatomical structure projections; and
synthesizing the at least a medical image using the trained GAN at the at least a point of view with the corresponding view angle.
10. The apparatus of claim 3 , wherein the memory contains instructions further configuring the at least a processor to:
compile a plurality of medical images into a video as a function of the ECG data, wherein the video is synchronized with a cardiac cycle indicated by the ECG data.
11. A method for synthetizing medical images, wherein the method comprises:
receiving, by at least a processor, a heart model related to a patient's heart;
identifying, by the at least a processor, a region of interest which changes over time, within the heart model, wherein identifying the region of interest comprises:
locating at least a point of view on the heart model; and
determining a view angle corresponding to the at least a point of view, wherein the at least a point of view and the corresponding view angle define at least one field of view that includes at least a portion of the heart model; and
generating, by the at least a processor, at least a medical image as a function of the region of interest using an image generator, wherein the at least a medical image captures an anatomical structure of the at least a portion of the heart model, wherein the medical image comprises a real-time visualization of cardiac anatomy, wherein the image generator comprises a generative model comprising at least a variational autoencoder configured to allow data sample generation to be applied in a training of the image generator.
12. The method of claim 11 , wherein receiving the heart model further comprises:
constructing the heart model based on a patient profile pertaining to the patient using a computer vision module, wherein the patient profile comprises a set of images of the patient's heart and associated metadata.
13. The method of claim 12 , wherein the patient profile further comprises electrocardiogram (ECG) data.
14. The method of claim 11 , wherein receiving the heart model further comprises:
transforming the heart model to a second heart model using a Statistical Shape Model as a function of a plurality of mode changers within the Statistical Shape Model, wherein each mode changer of the plurality of mode changers is associated with a model feature of the heart model.
15. The method of claim 11 , wherein the heart model comprises a 3D voxel occupancy representation (VOR) of the patient's heart.
16. The method of claim 11 , wherein generating the at least a medical image further comprises:
executing a camera transformation program configured to simulate at least a perspective of a probe using the image generator.
17. The method of claim 16 , wherein executing the camera transformation program comprises:
generating a projection of the anatomical structure by rendering the region of interest (ROI) as a function of a set of imaging parameters using a virtual camera positioned at the at least a point of view with the corresponding view angle.
18. The method of claim 11 , wherein the image generator comprises a generative adversarial network (GAN).
19. The method of claim 18 , wherein generating the at least a medical image further comprises:
training the GAN using a plurality of anatomical structure projections; and
synthesizing at least a medical image using the trained GAN at the at least a point of view with the corresponding view angle.
20. The method of claim 13 , further comprising:
compiling, by the at least a processor, a plurality of medical images into a video as a function of the ECG data, wherein the video is synchronized with a cardiac cycle indicated by the ECG data.