Presentation of patient information for cardiac blood flow procedures
Novel tools and techniques are provided for presenting patient information to a user. In some embodiments, a computer system may: receive device data associated with one or more devices configured to perform a cardiac blood flow procedure to provide effective blood flow through a heart and to or from blood vessels of a patient; receive one or more imaging data associated with one or more imaging devices configured to generate images of one or more internal portions of the patient; analyze the device data and the imaging data; map the device data and the imaging data to a multi-dimensional representation of the one or more internal portions of the patient; generate one or more image-based outputs based at least in part on the mapping; and present, using a user experience (“UX”) device, the generated one or more image-based outputs.
1 . A method for presenting patient information to a user, the method comprising:
receiving, with a computing system, one or more device data associated with each of one or more devices configured to perform a cardiac blood flow procedure to provide effective blood flow through a heart and to or from blood vessels of a patient;
receiving, with the computing system, one or more imaging data associated with each of one or more imaging devices configured to generate images of one or more internal portions of the patient;
analyzing, with the computing system, the received one or more device data and the received one or more imaging data;
mapping, with the computing system, the received one or more device data and the received one or more imaging data to a multi-dimensional representation of the one or more internal portions of the patient, based at least in part on the analysis, wherein the multi-dimensional representation comprises data corresponding to three dimensions, four dimensions, or more than four dimensions;
generating, with the computing system, one or more extended reality (“XR”) experiences based at least in part on the mapping, wherein the one or more XR experiences include at least one visual XR experience and at least one non-visual XR experience; and
presenting, with the computing system and using a user experience (“UX”) device, the generated one or more XR experiences.
2 . The method of claim 1 , wherein the computing system comprises at least one of a medical procedure computing system, a hub computing system, a three-dimensional (“3D”) graphical processing unit, a cluster computing system, a four-dimensional (“4D”) graphics computing system, a server computer, a cloud computing system, or a distributed computing system.
3 . The method of claim 1 , wherein the one or more devices comprise at least one of one or more catheters, one or more catheter interconnect cables, one or more valves, one or more balloons, one or more rigid robotic devices, one or more soft robotic devices, one or more stents, one or more needles, one or more occluders, one or more diagnostic catheters, one or more surgical tools, one or more monitoring devices, one or more cameras, one or more imaging tools, one or more fiducials, one or more staples, one or more anchors, one or more meshes, one or more vascular cannulae, one or more circulatory pumps, one or more valve repair devices, one or more embolic protection devices, one or more vascular closure tools, one or more septal closure tools, one or more ventricular closure tools, one or more lasers, one or more plaque removal tools, one or more guide wires, one or more introducers, one or more sheaths, one or more pillcams, one or more clips, one or more capsules, or one or more energy delivery tools.
4 . The method of claim 3 , wherein the one or more devices comprise at least one of one or more valves, one or more soft robotic devices, one or more stents, one or more surgical tools, one or more imaging tools, or one or more valve repair devices.
5 . The method of claim 1 , wherein the one or more imaging devices comprise at least one of a magnetic resonance imaging (“MRI”) system, a diffusion-tensor imaging (“DTI”) system, a computed tomography (“CT”) system, an ultrasound (“US”) system, a transesophageal echocardiography (“TEE”) system, an intra-cardiac echocardiography (“ICE”) system, a transthoracic echocardiography (“TTE”) system, an intravascular ultrasound (“IVUS”) system, an electromechanical wave imaging (“EWI”) system, a neuro-endoscopy system, a single photon emission computed tomography (“SPECT”) system, a magnetic resonance angiography (“MRA”) system, a computed tomography angiography (“CTA”) system, a blood oxygen-level dependent signal (“BOLD”) system, an arterial spin labeling (“ASL”) system, a magnetoencephalography (“MEG”) system, a positron emission tomography (“PET”) system, an electroencephalography (“EEG”) system, an optical coherence tomography (“OCT”) system, an optical imaging spectroscopy (“OIS”) system, a magnetic resonance spectroscopy (“MRS”) system, a dynamic susceptibility contrast (“DSC”) MRI system, a fluid-attenuated inversion recovery (“FLAIR”) system, a fluoroscopy system, an X-ray system, a 3D scanning system, an infrared (“IR”) system, an ultraviolet (“UV”) system, a bioluminescent system, an endoscopy system, a triboluminescence system, an image fusion system, or a microscope.
6 . The method of claim 5 , wherein the one or more imaging devices comprise at least one of a magnetic resonance imaging (“MRI”) system, a computed tomography (“CT”) system, an ultrasound (“US”) system, a transesophageal echocardiography (“TEE”) system, an intra-cardiac echocardiography (“ICE”) system, a transthoracic echocardiography (“TTE”) system, an intravascular ultrasound (“IVUS”) system, an electromechanical wave imaging (“EWI”) system, a fluoroscopy system, or a 3D scanning system.
7 . The method of claim 1 , wherein the cardiac blood flow procedure comprises at least one of a surgical procedure, a left atrial appendage (“LAA”) procedure, a transcatheter aortic valve repair (“TAVr”) procedure, a transcatheter aortic valve replacement (“TAVR”) procedure, a transcatheter mitral valve repair (“TMVr”) procedure, a transcatheter mitral valve replacement (“TMVR”) procedure, a transcatheter pulmonic valve repair (“TPVr”) procedure, a transcatheter pulmonic valve replacement (“TPVR”) procedure, a transcatheter tricuspid valve repair (“TTVr”) procedure, a transcatheter tricuspid valve replacement (“TTVR”) procedure, a coronary angioplasty procedure, a stenting procedure, a heart bypass procedure, a cardiac mapping procedure, an endovascular repair procedure, a minimally invasive endovascular repair procedure, a surgical heart valve repair and replacement procedure, a transcatheter pulmonary valve (“TPV”) therapy, a ventricular assist device (“VAD”) installation procedure, an intra-aortic balloon pump (“IABP”) implantation procedure, or a heart transplant operation.
8 . The method of claim 7 , wherein the cardiac blood flow procedure comprises at least one of a surgical procedure, a transcatheter aortic valve repair (“TAVr”) procedure, a transcatheter aortic valve replacement (“TAVR”) procedure, a transcatheter mitral valve repair (“TMVr”) procedure, a transcatheter mitral valve replacement (“TMVR”) procedure, a transcatheter pulmonic valve repair (“TPVr”) procedure, a transcatheter pulmonic valve replacement (“TPVR”) procedure, a transcatheter tricuspid valve repair (“TTVr”) procedure, a transcatheter tricuspid valve replacement (“TTVR”) procedure, a stenting procedure, a cardiac mapping procedure, an endovascular repair procedure, a minimally invasive endovascular repair procedure, a surgical heart valve repair and replacement procedure, a transcatheter pulmonary valve (“TPV”) therapy, or a ventricular assist device (“VAD”) installation procedure.
9 . The method of claim 1 , wherein the one or more XR experiences comprise at least one of one or more augmented reality (“AR”) images, one or more AR videos, one or more virtual reality (“VR”) images, one or more VR videos, one or more mixed reality (“MR”) images, or one or more MR videos.
10 . The method of claim 1 , wherein generating the one or more XR experiences comprises generating, with the computing system, the one or more XR experiences comprising at least three or more of one or more images, one or more sounds, one or more tactile responses, one or more simulated smells, or one or more simulated tastes, based at least in part on the mapping of the received one or more device data and the received one or more imaging data to the multi-dimensional representation of the one or more internal portions of the patient.
11 . The method of any of claim 1 , wherein the UX device comprises at least one of a headset, UX glasses, a viewing window, a microscope, a supplement to existing glasses, headphones, UX contact lenses, a heads-up display (“HUD”) device, a 3D spatial sound system, an olfactory simulation system, a taste simulation system, a telemonitoring system, a rigid robotic device control and sensory feedback system, a soft robotic device control and sensory feedback system, a control system for nanostructures, a control system for cells, a control system for genes, an eye control system, a voice control system, a remote control system, a gesture-based control system, a sign language-based control system, a body-part-based control system, a joystick, a mouse, a two-dimensional (“2D”) screen display, a 3D refractive display, a parallel reality system, a projection system, a nanoparticle reconstruction system, a fan-based display, a water-based display, an ionized air-based display, an ionized laser-based display, a smoke-based display, a sand-based display, a particulate-based display, a 3D printed reconstruction system, a sensory neuro-perception system, a sensory conversion system, a blow-based control system, a neuro-interface system, a peripheral nerve-computer interface system, a customized view generation system, a ghosting and prediction system, a master-slave control system, an annotation system, or a haptic feedback system.
12 . The method of claim 11 , wherein the UX device comprises at least one of a headset, UX glasses, a soft robotic device control and sensory feedback system, a two-dimensional (“2D”) screen display, a 3D refractive display, an annotation system, or a haptic feedback system.
13 . The method of claim 1 , further comprising:
receiving, with the computing system, one or more sensor data associated with one or more sensors configured to monitor at least one of biometric data, biological data, genetic data, cellular data, or procedure-related data of the patient; and
analyzing, with the computing system, the received one or more sensor data;
wherein mapping, with the computing system, the received one or more device data and the received one or more imaging data to the multi-dimensional representation of the one or more internal portions of the patient comprises mapping, with the computing system, two or more of the received one or more device data, the received one or more sensor data, or the received one or more imaging data to the multi-dimensional representation of the one or more internal portions of the patient, based at least in part on the analysis.
14 . The method of claim 13 , wherein generating the one or more XR experiences comprises:
combining, with the computing system, the received one or more device data, the received one or more sensor data, and the received one or more imaging data into the multi-dimensional representation, based at least in part on the analysis and mapping; and
generating, with the computing system, the one or more XR experiences based on the multi-dimensional representation.
15 . The method of claim 13 , wherein the one or more sensors comprise at least one of one or more chronically implanted sensors, one or more diagnostic sensors, one or more surgical sensors, one or more wearable sensors, one or more gas sensors, one or more optical sensors, one or more contactless optical sensors, one or more fiducial alignment sensors, one or more tool recognition sensors, one or more collision detection sensors, one or more room traffic flow sensors, one or more ultrasound sensors, one or more flow sensors, one or more blood velocity sensors, one or more blood volume sensors, one or more electrical sensors, one or more voltage sensors, one or more amperage sensors, one or more wattage sensors, one or more impedance sensors, one or more chemical sensors, one or more pH sensors, one or more motion sensors, one or more proximity sensors, one or more light sensors, one or more sound sensors, one or more laser sensors, one or more blood pressure sensors, one or more heart rate sensors, one or more pulse sensors, one or more respiratory rate sensors, one or more oxygen sensors, one or more carbon dioxide (“CO 2 ”) sensors, one or more hormonal sensors, one or more fluid levels, one or more doppler sensors, one or more biomarker sensors, one or more genetic sensors, one or more blood chemistry sensors, one or more tissue matrix sensors, one or more bacteria sensors, one or more respiration sensors, one or more mechanical sensors, one or more infrared (“IR”) sensors, one or more IR-based temperature sensors, one or more ultraviolet (“UV”) sensors, one or more digital image correlation (“DIC”) sensors, one or more cameras, one or more surgeon fatigue sensors, one or more IR-based temperature sensors, one or more moisture sensors, one or more perfusion sensors, one or more electromyography (“EMG”) sensors, one or more emotional stress sensors, one or more sleep sensors, one or more humidity sensors, one or more cardiac hemodynamics sensors, one or more ischemia sensors, one or more hematocrit (“HCT”) level sensors, one or more temperature sensors, one or more pressure sensors, one or more force sensors, one or more strain sensors, one or more stress sensors, one or more olfactory sensors, one or more tissue contractility sensors, one or more compliance sensors, one or more immobilized biocatalyst sensors, one or more enzyme sensors, one or more immunoglobulin sensors, one or more bacterial sensors, one or more mammalian tissue sensors, one or more plant tissue sensors, one or more cell sensors, one or more subcellular sensors, one or more specific peptide sensors, one or more specific protein sensors, one or more specific enzyme sensors, one or more specific gas sensors, one or more specific ion sensors, one or more metabolic process sensors, one or more viscosity sensors, one or more electromagnetic interference (“EMI”) sensors, one or more photographic plate sensors, one or more polymer-metal sensors, one or more charge coupled devices (“CCDs”), one or more photo diode arrays, one or more electrochemical sensors, one or more vibration sensors, one or more sound wave sensors, one or more magnetic sensors, one or more visible light sensors, one or more radiation sensors, one or more biometric sensors, one or more electroencephalographic (“EEG”) sensors, one or more brainwave sensors, or one or more pain sensors.
16 . The method of claim 15 , wherein the one or more sensors comprise at least one of one or more diagnostic sensors, one or more optical sensors, one or more contactless optical sensors, one or more ultrasound sensors, one or more motion sensors, one or more proximity sensors, one or more blood pressure sensors, one or more heart rate sensors, one or more respiratory rate sensors, one or more impedance sensors, one or more infrared (“IR”) sensors, one or more IR-based temperature sensors, one or more fiducial alignment sensors, one or more tool recognition sensors, one or more collision detection sensors, one or more room traffic flow sensors, one or more surgeon fatigue sensors, or one or more cognitive overload sensors.
17 . The method of claim 13 , wherein the generated one or more XR experiences are presented to provide one or more of: a guide for a medical professional, a navigation tool during the cardiac blood flow procedure, a proximity detection tool during the cardiac blood flow procedure, a three-dimensional (“3D”) or four-dimensional (“4D”) visualization view of the one or more internal portions of the patient, a heads-up display of the one or more device data, a heads-up display of biological data of the patient, a heads-up display of chemical data of the patient, a heads-up display of physiological data of the patient, or a heads-up display of procedure-related data of the patient.
18 . The method of claim 1 , further comprising:
tracking, with the computing system, the one or more devices, using at least one of an electropotential-based tracking system, an impedance-based tracking system, an electromagnetic-based tracking system, a magnetic anomaly detection-based tracking system, a radio frequency identification (“RFID”)-based tracking system, a Bluetooth-based tracking system, a wireless-based tracking system, an optical-based tracking system, a laser-based tracking system, an ultrasound (“US”) imaging-based tracking system, a computer vision-based tracking system, a fluoroscopy-based tracking system, an MRI-based tracking system, an accelerometer-based tracking system, a global positioning system (“GPS”)-based tracking system, an infrared (“IR”)-based tracking system, an ultrasonic sound-based tracking system, a piezoelectric-based tracking system, a simultaneous localization and mapping (“SLAM”)-based tracking system, an acoustic-based tracking system, a radar-based tracking system, a feature identification-based tracking system, a machine learning-based tracking system, a predictive tracking system, a prescriptive tracking system, or a near-field communications-based tracking system.
19 . The method of claim 18 , further comprising:
tracking, with the computing system, the one or more devices, using at least one of an impedance-based tracking system, an electromagnetic-based tracking system, a radio frequency identification (“RFID”)-based tracking system, an optical-based tracking system, an ultrasound (“US”) imaging-based tracking system, a computer vision-based tracking system, a fluoroscopy-based tracking system, an MRI-based tracking system, an accelerometer-based tracking system, a machine learning-based tracking system, a predictive tracking system, or a prescriptive tracking system.
20 . The method of claim 1 , wherein the one or more device data, associated with each of the one or more devices configured to perform the cardiac blood flow procedure, is received with the computer system while the one or more devices are positioned within a body of the patient.
21 . The method of claim 20 , wherein the one or more device data, associated with each of the one or more devices configured to perform the cardiac blood flow procedure, is received with the computer system while the one or more devices are positioned within the heart or a blood vessel of the patient.
22 . The method of claim 1 , wherein the one or more internal portions of the patient comprises one or more luminal portions of the patient.
23 . The method of claim 22 , wherein the one or more luminal portions of the patient are within the heart or a blood vessel of the patient.
24 . An apparatus operable to present patient information to a user, the apparatus comprising:
at least one processor; and
a non-transitory computer readable medium communicatively coupled to the at least one processor, the non-transitory computer readable medium having stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the apparatus to:
receive one or more device data associated with each of one or more devices configured to perform a cardiac blood flow procedure to provide effective blood flow through a heart and to or from blood vessels of a patient;
receive one or more imaging data associated with each of one or more imaging devices configured to generate images of one or more internal portions of the patient;
analyze the received one or more device data, the received one or more sensor data, and the received one or more imaging data;
map the received one or more device data and the received one or more imaging data to a multi-dimensional representation of the one or more internal portions of the patient, based at least in part on the analysis, wherein the multi-dimensional representation comprises data corresponding to three dimensions, four dimensions, or more than four dimensions;
generate one or more XR experiences, based at least in part on the mapping, wherein the one or more XR experiences include at least one visual XR experience and at least one non-visual XR experience; and
present, using a user experience (“UX”) device, the generated XR experiences.
25 . A system operable to present patient information to a user, the system comprising:
one or more devices configured to perform a cardiac blood flow procedure to provide effective blood flow through a heart and to or from blood vessels of a patient;
one or more imaging devices configured to generate images of one or more internal portions of the patient;
a computing system, comprising:
at least one first processor; and
a first non-transitory computer readable medium communicatively coupled to the at least one first processor, the first non-transitory computer readable medium having stored thereon computer software comprising a first set of instructions that, when executed by the at least one first processor, causes the computing system to:
receive one or more device data associated with each of the one or more devices;
receive one or more imaging data associated with each of the one or more imaging devices;
analyze the received one or more device data and the received one or more imaging data;
map the received one or more device data and the received one or more imaging data to a multi-dimensional representation of the one or more internal portions of the patient, based at least in part on the analysis, wherein the multi-dimensional representation comprises data corresponding to three dimensions, four dimensions, or more than four dimensions;
generate one or more XR experiences, based at least in part on the mapping, wherein the one or more XR experiences include at least one visual XR experience and at least one non-visual XR experience; and
send the generated one or more XR experiences to a user experience (“UX”) device; and
the UX device, comprising:
at least one second processor; and
a second non-transitory computer readable medium communicatively coupled to the at least one second processor, the second non-transitory computer readable medium having stored thereon computer software comprising a second set of instructions that, when executed by the at least one second processor, causes the UX device to:
receive the generated one or more XR experiences; and
present the received one or more XR experiences to the user.