IP Library › Granted Patent US 12,493,962
Granted Patent B2
US 12,493,962 · App. 18/950,549 · Granted Dec 9, 2025

Systems and methods for detecting cardiovascular anomalies using spatiotemporal neural networks

Inventors: Christophe Gardella (Paris, FR); Valentin Thorey (Paris, FR); Eric Askinazi (Paris, FR); Cécile Dupont (Paris, FR)
Assignee: BrightHeart SAS
G06T7/0016G06T7/174G06T2207/10132G06T2207/20081G06T2207/20084G06T2207/30044G06T2207/30048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,493,962
App. No.
18/950,549
Granted
Dec 9, 2025
Kind
B2
Abstract

Systems and methods are provided for processing image data generated by a medical imaging device such as an ultrasound or echocardiogram device and processing the image data using artificial intelligence and machine learning to determine a presence of one or more congenital heart defects (CHDs) and/or other cardiovascular anomalies in the image data, to identify anatomy, detect and/or identify motion, and/or to determine key-point and/or contour detection. The image processing system may be used to detect CHDs and/or other cardiovascular anomalies in a fetus. The image data may be processed using a spatiotemporal convolutional neural network (CNN). The spatiotemporal CNN may include a spatial CNN for image recognition and a temporal CNN for processing optical flow data and/or image data. The outputs of the spatial CNN and the temporal CNN may be fused (e.g., using late fusion) and/or may be processed by a spatiotemporal CNN.

Claims (46)

1 . A method for analyzing medical images corresponding to a fetus during pregnancy, the method comprising:

determining image data that is representative of a portion of the fetus's cardiovascular system, the image data comprising a series of image frames;

preprocessing at least one image frame of the series of image frames to remove a portion of the image frame from such at least one image frame;

determining a neural network system comprising a spatial model trained to identify fetal cardiovascular anatomy and a temporal model trained to identify motion corresponding to fetal cardiovascular anatomy, and a spatiotemporal model;

determining a spatial output using the spatial model and based on the first portion of the image data, the spatial output corresponding to predetermined anatomy of the fetus in the image data;

determining a temporal output using the temporal model and based on a second portion of the image data, the temporal output corresponding to the predetermined anatomy over a time period;

determining a spatiotemporal output using the spatiotemporal model and based on the spatial output, the temporal output, and the image data, the spatiotemporal output indicative of a presence of a predetermined condition of a plurality of predetermined conditions; and

causing a device to display a user interface including the predetermined condition corresponding to the spatiotemporal output.

2 . The method of claim 1 , wherein the predetermined anatomy is a ventricle, atria, or heart valve.

3 . The method of claim 1 , wherein the temporal output is indicative of one of systole, diastole, contraction, or ejection.

4 . The method of claim 1 , further comprising:

determining a request from the device to generate a report corresponding to one or more of the spatial output, temporal output, or spatiotemporal output; and

causing the device to generate the report corresponding to the one or more of the spatial output, temporal output, or spatiotemporal output.

5 . The method of claim 1 , further comprising training the spatial model and the temporal model using a plurality of second image data different from the image data.

6 . The method of claim 1 , further comprising receiving the image data from an imaging system.

7 . The method of claim 6 , wherein the imaging system comprises an ultrasound or echocardiogram device.

8 . The method of claim 7 , wherein the image data comprises a first series of image frames corresponding to a first orientation of the ultrasound device or echocardiogram device and a second series of image frame corresponding to a second orientation of the ultrasound device or echocardiogram device.

9 . The method of claim 1 , further comprising sampling the image data such that only non-adjacent image frames in the series of image frames are processed by the spatial model.

10 . The method of claim 1 , wherein one or more of the spatial output is indicative of one or more of key-point data or contour data.

11 . The method of claim 1 , wherein one or more of the temporal output is indicative of one or more of key-point data or contour data corresponding to the predetermined anatomy over a time period.

12 . The method of claim 1 , further comprising determining one or more of key-point data or contour data based on the spatial output and the temporal output.

13 . The method of claim 12 , further comprising causing the device to further display the one or more of key-point data or contour data.

14 . The method of claim 1 , wherein the spatial output corresponds to segmentation of the fetus's heart, stomach, and thorax and the spatiotemporal output is indicative of a presence of heterotaxy.

15 . The method of claim 1 , wherein the spatial output corresponds to segmentation of at least one ventricle and at least one atria of the fetus, the temporal output corresponds to one or more of contraction of a ventricle or contraction of an atria, and the spatiotemporal output is indicative of presence of an arrhythmia.

16 . The method of claim 1 , wherein the spatial output corresponds to segmentation of ventricles of the fetus and the spatiotemporal output is indicative of a presence of ventricular akinesia.

17 . The method of claim 1 , wherein the temporal output corresponds to a presence of a valve at a given time and the spatiotemporal output corresponds to whether the valve is open, the spatiotemporal output indicative of a presence of valve atresia.

18 . The method of claim 1 , wherein the spatial output corresponds to segmentation of a left ventricular outflow tract and an aorta of the fetus, the temporal output corresponds to a presence of blood flow between the right ventricle and the aorta at a certain time in the time period, and the spatiotemporal output is indicative of a presence of an overriding aorta.

19 . The method of claim 1 , wherein the spatial output corresponds to segmentation of ventricles, an aorta, and a pulmonary artery of the fetus and the spatiotemporal output is indicative of whether a connection between arteries and the ventricles of the fetus is normal.

20 . The method of claim 1 , wherein the spatial output corresponds to contours of ventricles of the fetus, the temporal output corresponds to an end of diastole for a heart of the fetus, and the spatiotemporal output corresponds to at least one measurement of at least one ventricle at the end of diastole.

21 . A system for determining a presence of one or more congenital heart defects (CHDs) in a fetus during pregnancy, the system comprising:

memory configured to store computer-executable instructions; and

at least one computer processor configured to access memory and execute the computer-executable instructions to:

determine image data that is representative of a portion of the fetus's cardiovascular system, the image data comprising a series of image frames;

preprocess at least one image frame of the series of image frames to remove a portion of the image frame from such at least one image frame;

determine a neural network system comprising a spatial model trained to identify fetal cardiovascular anatomy and a temporal model trained to identify motion corresponding to the fetal cardiovascular anatomy, and a spatiotemporal model;

determine a spatial output using the spatial model and based on the first portion of the image data, the spatial output corresponding to predetermined anatomy of the fetus in the image data;

determine a temporal output using the temporal model and based on a second portion of the image data, the temporal output corresponding to the predetermined anatomy over a time period;

determine a spatiotemporal output using the spatiotemporal model and based on the spatial output, the temporal output, and the image data, the spatiotemporal output indicative of a presence of predetermined condition of a plurality of predetermined conditions; and

cause a device to display a user interface including the predetermined condition corresponding to the spatiotemporal output.

22 . The system of claim 21 , wherein the predetermined anatomy is a ventricle, atria, or heart valve.

23 . The system of claim 21 , wherein the temporal output is indicative of one of systole, diastole, contraction, or ejection.

24 . The system of claim 21 , wherein the computer processor is further configured to execute the computer-executable instructions to train the spatial model and the temporal model using a plurality of second image data different from the image data.

25 . The system of claim 21 , wherein the computer processor is further configured to execute the computer-executable instructions to receive the image data from an imaging system.

26 . The system of claim 25 , wherein the imaging system comprises an ultrasound or echocardiogram device.

27 . The system of claim 26 , wherein the image data comprises a first series of image frames corresponding to a first orientation of the ultrasound device or echocardiogram device and a second series of image frames corresponding to a second orientation of the ultrasound device or echocardiogram device.

28 . The system of claim 21 , wherein the computer processor is further configured to execute the computer-executable instructions to sample the image data such that only non-adjacent image frames in the series of image frames are processed by the spatial model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2025
From: GARDELLA, CHRISTOPHE; THOREY, VALENTIN; ASKINAZI, ERIC; DUPONT, CÉCILE
To: BRIGHTHEART SAS
Reel/Frame 073464/0861 →
Priority Claims (1)
EP 23305236 · Feb 22, 2023 · regional
Continuity (3)
Continuation In Part 18412325 · Jan 12, 2024
Continuation In Part 18183942 · Mar 14, 2023
Related Publication 20250078278A1 · Mar 6, 2025
References Cited (155)
US 7672491B2 · Krishnan et al. · 2010 [cited by applicant]
US 11375926B2 · Ray · 2022 [cited by examiner]
US 11478222B2 · Shiran et al. · 2022 [cited by applicant]
US 11488298B2 · Annangi et al. · 2022 [cited by applicant]
US 11517290B2 · Aase et al. · 2022 [cited by applicant]
US 11861838B1 · Gardella · 2024 [cited by applicant]
US 11869188B1 · Levy et al. · 2024 [cited by applicant]
US 11875507B1 · Gardella et al. · 2024 [cited by applicant]
US 12082969B1 · Gardella et al. · 2024 [cited by applicant]
US 12148162B2 · Gardella et al. · 2024 [cited by applicant]
US 12343197B2 · Gardella et al. · 2025 [cited by applicant]
US 20050004465A1 · Abuhamad · 2005 [cited by applicant]
US 20050245825A1 · Krantz et al. · 2005 [cited by applicant]
US 20050251013A1 · Krishnan et al. · 2005 [cited by applicant]
US 20050251036A1 · Abuhamad · 2005 [cited by applicant]
US 20050267376A1 · Marossero et al. · 2005 [cited by applicant]
US 20140050384A1 · Schmidt et al. · 2014 [cited by applicant]
US 20170337731A1 · Jago et al. · 2017 [cited by applicant]
US 20180206819A1 · Saarinen et al. · 2018 [cited by applicant]
US 20200155114A1 · Park et al. · 2020 [cited by applicant]
US 20200202502A1 · Tsymbalenko · 2020 [cited by applicant]
US 20200202551A1 · Ciofolo-Veit et al. · 2020 [cited by applicant]
US 20200214618A1 · Vullings · 2020 [cited by applicant]
US 20200219274A1 · Afridi et al. · 2020 [cited by applicant]
US 20200345261A1 · Haeusser et al. · 2020 [cited by applicant]
US 20210034587A1 · Arye et al. · 2021 [cited by applicant]
US 20210150693A1 · Fornwalt et al. · 2021 [cited by applicant]
US 20210202069A1 · Van Der Veen et al. · 2021 [cited by applicant]
US 20210280298A1 · Samset et al. · 2021 [cited by applicant]
US 20210319558A1 · Min et al. · 2021 [cited by applicant]
US 20210345987A1 · Ciofolo-Veit et al. · 2021 [cited by applicant]
US 20220012875A1 · Arnaout · 2022 [cited by applicant]
US 20220142609A1 · Yeo et al. · 2022 [cited by applicant]
US 20220361799A1 · Hong et al. · 2022 [cited by applicant]
US 20230064623A1 · Krishnan et al. · 2023 [cited by applicant]
US 20230135046A1 · Liu et al. · 2023 [cited by applicant]
US 20230394655A1 · Ben Bashat et al. · 2023 [cited by applicant]
US 20240423583A1 · Gardella · 2024 [cited by applicant]
CN 114469176A · 2022 [cited by applicant]
CN 114677754A · 2022 [cited by applicant]
CN 115424335A · 2022 [cited by applicant]
EP 3964136A1 · 2022 [cited by applicant]
EP 4144301A1 · 2023 [cited by applicant]
WO WO2012168371A1 · 2012 [cited by applicant]
WO WO2022265345A1 · 2022 [cited by applicant]
U.S. Appl. No. 18/183,937 / U.S. Pat. No. 11,869,188, filed Mar. 14, 2023 / Jan. 9, 2024. [cited by applicant]
U.S. Appl. No. 18/183,942 / U.S. Pat. No. 11,875,507, filed Mar. 14, 2023 / Jan. 16, 2024. [cited by applicant]
U.S. Appl. No. 18/330,819 / U.S. Pat. No. 11,861,838, filed Jun. 7, 2023 / Jan. 2, 2024. [cited by applicant]
U.S. Appl. No. 18/406,446 / U.S. Pat. No. 12,082,969, filed Jan. 8, 2024 / Sep. 10, 2024. [cited by applicant]
U.S. Appl. No. 18/412,325 / U.S. Pat. No. 12,148,162, filed Jan. 12, 2024 / Nov. 19, 2024. [cited by applicant]
U.S. Appl. No. 18/828,923, filed Sep. 9, 2024. [cited by applicant]
Abuhamad A., et al., “Obstetric and Gynecologic Ultrasound Curriculum and Competency Assessment in Residency Training Programs: Consensus Report: Obstetric and Gynecologic Ultrasound Training,” Journal of Ultrasound in … [cited by applicant]
Activity recognition, Wikipedia The Free Encyclopedia, retrieved from the internet URL: https://en.wikipedia.org/wiki/Activity_recognition, 12 pages (2018). [cited by applicant]
“AIUM Practice Guideline for the Performance of Fetal Echocardiography,” Fetal Echocardiography Task Force; American Institute of Ultrasound in Medicine Clinical Standards Committee; American College of Obstetricians an… [cited by applicant]
AIUM-ACR-ACOG-SMFM-SRU Practice Parameter for the Performance of Standard Diagnostic Obstetric Ultrasound Examination, J. Ultrasound Med., 37:E13-E24 (2018). [cited by applicant]
Alom, et al., The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches, retrieved from the internet URL: https://arxiv.org/abs/1803.01164, 39 pages (2018). [cited by applicant]
Arnaout, et al., An Ensemble of Neural Networks Provides Expert-Level Prenatal Detection of Complex Congenital Heart Disease, [cited by applicant]
Arnaout, et al., An ensemble of neural networks provides expert-level prenatal detection of complex congenital heart disease, Nature Medicine, 27(5):882-91 (May 2021). [cited by applicant]
Arth et al., “Inpatient Hospitalization Costs Associated with Birth Defects Among Persons of All Ages-United States, 2013,” MMWR Morbidity and Mortality Weekly Report, vol. 66(2):41-46, DOI:10.15585/mmwr.mm6602a1. (Jan.… [cited by applicant]
Berghella V., et al., “Accuracy of Prenatal Diagnosis of Congenital Heart Defects,” Fetal Diagnosis and Therapy, vol. 16(6):407-412, DOI:10.1159/000053949. (Mar. 2001). [cited by applicant]
Bjornard K., et al., “Patterns in the Prevalence of Congenital Heart Defects, Metropolitan Atlanta, 1978 to 2005,” Birth Defects Research. (Part A): Clinical and Molecular Teratology, vol. 97(2):87-94, doi:10.1002/bdra.… [cited by applicant]
Bonnet D., et al., “Detection of Transposition of the Great Arteries in Fetuses Reduces Neonatal Morbidity and Mortality,” Circulation, vol. 99(7):916-918, DOI:10.1161/01.cir.99.7.916. (Feb. 1999). [cited by applicant]
Cardinal M., et al., “Incremental Detection of Severe Congenital Heart Disease by Fetal Echocardiography Following a Normal Second Trimester Ultrasound Scan in Québec, Canada,” Circulation. Cardiovascular Imaging, vol. … [cited by applicant]
Carreira, et al., Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset, retrieved from the internet URL: https://arxiv.org/abs/1705.07750, 10 pages (2018). [cited by applicant]
Carvalho, et al., ISUOG Practice Guidelines (updated): sonorgraphic screening examination of the fetal heart, Ultrasound Obstet. Gynecol., 41:348-359 (2013). [cited by applicant]
Carvalho J.S., et al., “ISUOG Practice Guidelines (updated): fetal cardiac screening,” Ultrasound Obstet Gynecol, vol. 61(6):788-803, DOI:10.1002/uog.26224. (Jun. 2023). [cited by applicant]
Centers for Disease Control and Prevention (CDC), “Racial Differences by Gestational Age in Neonatal Deaths Attributable to Congenital Heart Defects—United States, 2003-2006,” Morbidity and Mortality Weekly Report (MMWR… [cited by applicant]
Cluster, Construct Clusters from Gaussian Mixture Distribution, retrieved from the internet URL: https://www.mathworks.com/help/stats/gmdistribution.cluster.html, 6 pages, retrieved on Apr. 13, 2023. [cited by applicant]
Cluster Gaussian Mixture Data Using Hard Clustering, retrieved from the internet URL: https://www.mathworks.com/help/stats/cluster-data-from-mixture-of-gaussian-distributions.html, retrieved on Apr. 13, 2023, 6 pages. [cited by applicant]
Cluster Gaussian Mixture Data Using Soft Clustering, retrieved from the internet URL: https://www.mathworks.com/help/stats/cluster-gaussian-mixture-data-using-soft-clustering.html, retrieved on Apr. 13, 2023, 5 pages. [cited by applicant]
Create Gaussian Mixture Model, retrieved from the internet URL: https://www.mathworks.com/help/stats/gmdistribution.html#mw_132ef7d2-0aa5-498f-bd6e-824f3edc8567, retrieved on Apr. 13, 2023, 8 pages. [cited by applicant]
Data Sets, UCF101—Action Recognition Data Set, UCF Center for Research in Computer Vision, 6 pages (2012). [cited by applicant]
Day, et al., Artificial Intelligence, Fetal Echocardiograhy, and Congenital Heart Disease, Prenatal Diagnosis, 41(6):733-42 (May 2021). [cited by applicant]
Donofrio, et al., Diagnosis and Treatment of Fetal Cardiac Disease, A Scientific Statement From the American Heart Association, [cited by applicant]
Eckersley L., et al., “Timing of Diagnosis Affects Mortality in Critical Congenital Heart Disease,” Archives of Disease in Childhood, vol. 101(6):516-520, doi:10.1136/archdischild-2014-307691 (Jun. 2016). [cited by applicant]
Espinoza J., et al., “The Role of the Sagittal View of the Ductal Arch in Identification of Fetuses With Conotruncal Anomalies Using 4-Dimensional Ultrasonography,” J Ultrasound Med., vol. 26(9):1181-1188, doi:10.7863/j… [cited by applicant]
Feichtenhofer, et al., Convolutional Two-Stream Network Fusion for Video Action Recognition, retrieved from the internet URL: https://arxiv.org/abs/1604.06573, 9 pages (2016). [cited by applicant]
Feichtenhofer, et al., Slow Fast Networks for Video Recognition, retrieved from the internet URL: hhttps://arxiv.org/abs/1812.03982, 10 pages (2019). [cited by applicant]
Feichtenhofer, et al., Spatiotemporal Residual Networks for Video Action Recognition, retrieved from the internet URL: https://arxiv.org/abs/1611.02155, 9 pages (2016). [cited by applicant]
Feng, et al., Two-Stream Attention Spatio-Temporal Network For Classification of Echocardiography Videos, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 1461-1465 (Apr. 2021). [cited by applicant]
Fiorentino, et al., A Review on Deep-Learning Algorithms for Fetal Ultrasound-Image Analysis, Medical Image Analysis, 1:83 102629 (Jan. 2023). [cited by applicant]
Fitgmdist, Fit Gaussian Mixture Model to Data, MATLAB fitgmdist, retrieved from the internet URL: https://www.mathworks.com/help/stats/fitgmdist.html, retrieved on Apr. 13, 2023, 17 pages. [cited by applicant]
Friedberg M.K., et al., “Prenatal Detection of Congenital Heart Disease,” The Journal of Pediatrics, vol. 155(1):26-31, doi:10.1016/j.jpeds.2009.01.050 (Jul. 2009). [cited by applicant]
Gao, et al., A fused deep learning architecture for viewpoint classification of echocardiography, 36:103-13 (Jul. 2017). [cited by applicant]
Gao, et al., Detection and Characterization of the Fetal Heartbeat in Free-hand Ultrasound Sweeps with Weakly-Supervised Two-Streams Convolutional Networks, [cited by applicant]
Gao, et al., Fast Video Multi-Style Transfer, IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 3222-3230 (2020). [cited by applicant]
Gatys, et al., A Neural Algorithm of Artistic Style, retrieved from the internet URL: https://arxiv.org/abs/1508.06576, 16 pages (2015). [cited by applicant]
Gkioxari, et al., Finding Action Tubes, retrieved from internet URL: https://arxiv.org/abs/1411.6031, 10 pages (Nov. 2014). [cited by applicant]
Goodale, et al., Separate Visual Pathways for Perception and Action, Trends in Neurosciences, 15(1):20-25 (Jan. 1992). [cited by applicant]
Grandjean, et al., The performance of routine ultrasonographic screening of pregnancies in the Eurofetus Study, [cited by applicant]
He, et al., Deep Residual Learning for Image Recognition, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778 (2016). [cited by applicant]
He R., et al., “Examining Contributing Factors to Accuracy of Fetal Echocardiography in Prenatal Diagnosis of Congenital Heart Disease,” Journal of the American College of Cardiology, vol. 77(18):502, DOI:10.1016/S0735-… [cited by applicant]
HMDB: A Large Human Motion Database, Serre Lab, retrieved from the internet URL: https://serre-lab.clps.brown.edu/resource/hmdb-a-large-human-motion-database/, accessed on Mar. 23, 2023, 6 pages. [cited by applicant]
Hoffman J.I.E., et al., “The Incidence of Congenital Heart Disease,” Journal of the American College of Cardiology, vol. 39(12):1890-1900, doi:10.1016/S0735-1097(02)01886-7 (Jun. 19, 2002). [cited by applicant]
Holland B.J., et al., “Prenatal diagnosis of critical congenital heart disease reduces risk of death from cardiovascular compromise prior to planned neonatal cardiac surgery: a meta-analysis,” Ultrasound Obstet Gynecol,… [cited by applicant]
Howard, et al., Improving Ultrasound Video Classification: an Evaluation of Novel Deep Learning Methods in Echocardiography, Journal of Medical Artificial Intelligence, 14 pages (Mar. 2020). [cited by applicant]
Huang, Real-Time Neural Style Transfer for Videos, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 9 pages (2017). [cited by applicant]
Image Gradient, Wikipedia The Free Encyclopedia, retrieved from the internet URL: https://en.wikipedia.org/wiki/Image_gradient, accessed on Mar. 23, 2023, 3 pages. [cited by applicant]
International Search Report & Written Opinion dated Apr. 29, 2024 in Int'l PCT Patent Appl. Serial No. PCT/IB2024-051622 (0110). [cited by applicant]
International Search Report & Written Opinion dated May 29, 2024 in Int'l PCT Patent Appl. Serial No. PCT/IB2024/051624 (0210). [cited by applicant]
International Search Report & Written Opinion dated Sep. 18, 2024 in Int'l PCT Patent Appl. Serial No. PCT/IB2024/054937 (031001). [cited by applicant]
Ioffe, et al., Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, retrieved from internet URL: https://arxiv.org/abs/1502.03167, 11 pages (2015). [cited by applicant]
Israel S.W., et al., “Improvement in Antenatal Diagnosis of Critical Congenital Heart Disease Implications for Postnatal Care and Screening,” Fetal Diagnosis and Therapy, vol. 30(3):180-183, DOI:10.1159/000327148. (Apr.… [cited by applicant]
Ji, et al., 3D Convolutional Neural Networks for Human Action Recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(1), 8 pages (Jan. 2013). [cited by applicant]
Krizhevsky, et al., ImageNet Classification with Deep Convolutional Neural Networks, Communications of the ACM, 60(6):84-90 (Jun. 2017). [cited by applicant]
Kuehl, et al., Failure to Diagnose Congenital Heart Disease in Infancy, Pediatrics, 103(4):743-747 (Apr. 1999). [cited by applicant]
Landis B.J., et al., “Prenatal Diagnosis of Congenital Heart Disease and Birth Outcomes,” Pediatric Cardiology, vol. 34(3):597-605, doi: 10.1007/s00246-012-0504-4. (Mar. 2013). [cited by applicant]
Levy, et al., Fetal Echocardiography: 5-4-3-2-1, The Levy-Stos Method, Gynecologie Obstetrique Pratique, No. 309 (Nov. 2018) (w-English Translation). [cited by applicant]
Levy, et al., Improved Prenatal Detection of Congenital Heart Disease in an Integrated Health Care System, Pediatr. Cardiol., 34:670-679 (Mar. 2013). [cited by applicant]
Liu, et al., Generalize Ultrasound Image Segmentation via Instant and Plug & Play Style Transfer, retrieved from internet URL: https://arxiv.org/abs/2101.03711, 5 pages (2021). [cited by applicant]
Liu, et al., Remove Appearance Shift for Ultrasound Image Segmentation via Fast and Universal Style Transfer, retrieved from internet URL: https://arxiv.org/abs/2002.05844, 6 pages (2020). [cited by applicant]
Mai C.T., et al., “National Population-based Estimates for Major Birth Defects, 2010-2014,” Birth Defects Research, vol. 111(18):420-1435, doi:10.1002/bdr2.1589 (Nov. 2019). [cited by applicant]
Mamasoula C., et al., “Maternal age and the prevalence of congenital heart defects in Europe, 1995-2015: A register-based study,” Birth Defects Research, vol. 115(6):583-594, Doi:10.1002/bdr2.2152. (Apr. 2023). [cited by applicant]
McMahon C.J., et al., “Paediatric and adult congenital cardiology education and training in Europe,” Cardiol Young, vol. 32(12):1966-1983, DOI:10.1017/S104795112100528X. (Dec. 2022). [cited by applicant]
Moon-Grady A., et al., “Can a Complete Fetal Echocardiogram be Performed at 12 to 16 weeks' Gestation?” Journal of the American Society of Echocardiography: official publication of the American Society of Echocardiograp… [cited by applicant]
Mozumdar N., et al., “Diagnostic Accuracy of Fetal Echocardiography in Congenital Heart Disease,” Journal of the American Society of Echocardiography, vol. 33(11):1384-1390, DOI:10.1016/j.echo.2020.06.017. (Nov. 2020). [cited by applicant]
Nayak K., et al., “Evaluation of Fetal Echocardiography as a Routine Antenatal Screening Tool for Detection of Congenital Heart Disease,” Cardiovascular Diagnosis and Therapy, vol. 6(1):44-49, doi:10.3978/j.issn.2223-36… [cited by applicant]
Olney R.S., et al., “Detection of Critical Congenital Heart Defects: Review of Contributions from Prenatal and Newborn Screening,” Seminars in Perinatology, vol. 39(3):230-237, doi:10.1053/j.semperi.2015.03.007 (Apr. 20… [cited by applicant]
Optical flow, Wikipedia The Free Encyclopedia, retrieved from the internet URL: https://en.wikipedia.org/wiki/Optical_flow, accessed on Mar. 23, 2023, 6 pages. [cited by applicant]
Oster M.E., et al., “Temporal Trends in Survival Among Infants With Critical Congenital Heart Defects,” Pediatrics, vol. 131(5): e1502-e1508, doi:10.1542/peds.2012-3435 (May 2013). [cited by applicant]
Ouyang, et al., Interpretable AI for Beat-to-Beat Cardiac Function Assessment, Stanford University, 23 pages (2019). [cited by applicant]
Pan, et al., An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection, Intelligent Automation and Soft Computing, 29(3):673-688 (Jan. 2021). [cited by applicant]
Patra, et al., Multi-anatomy localization in fetal echocardiography videos, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), pp. 1761-1764 (Apr. 2019). [cited by applicant]
Peiris V., et al., “Association of Socioeconomic Position and Medical Insurance With Fetal Diagnosis of Critical Congenital Heart Disease,” Circulation. Cardiovascular quality and outcomes, vol. 2(4):354-360, DOI:10.116… [cited by applicant]
Pinto N.M., et al., “Barriers to Prenatal Detection of Congenital Heart Disease: a Population-based Study,” Ultrasound in Obstetrics & Gynecology, vol. 40(4):418-425, doi:10.1002/uog.10116 (Oct. 2012). [cited by applicant]
Pradat P., et al., “The Epidemiology of Cardiovascular Defects, Part I: A Study Based on Data from Three Large Registries of Congenital Malformations,” Pediatr Cardiol, vol. 24(3):195-221, DOI:10.1007/s00246-002-9401-6.… [cited by applicant]
Qiu, et al., Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks, retrieved from the internet URL: https://arxiv.org/abs/1711.10305, 9 pages (2017). [cited by applicant]
Quartermain M.D., et al., “Variation in Prenatal Diagnosis of Congenital Heart Disease in Infants,” Pediatrics, vol. 136(2):e378-e385, doi:10.1542/peds.2014-3783 (Aug. 2015). [cited by applicant]
Ruder, et al., Artistic Style Transfer for Videos and Spherical Images, International Journal of Computer Vision, 19 pages (2018). [cited by applicant]
Salomon L.J., et al., “Practice guidelines for performance of the routine mid-trimester fetal ultrasound scan,” Ultrasound Obstet Gynecol, vol. 37(1):116-126, DOI:10.1002/uog.8831. (Jan. 2011). [cited by applicant]
Schneider C., et al., “Development of Z-scores for fetal cardiac dimensions from echocardiography,” Ultrasound Obstet Gynecol, vol. 26(6):599-605, DOI:10.1002/uog.2597. (Nov. 2005). [cited by applicant]
Simonyan, Two-Stream Convolutional Network for Action Recognition in Videos, Visual Geometry Group, University of Oxford, 9 pages (2014). [cited by applicant]
Simonyan, Very Deep Convolutional Networks for Large-Scale Image Recognition, Visual Geometry Group, University of Oxford, 14 pages (2015). [cited by applicant]
Sonio Detect, FDA 510(k), K230365, Jul. 25, 2023, available at https://www.accessdata.fda.gov/cdrh_docs/pdf23/K230365.pdf. [cited by applicant]
Sonio Detect, User Manual, Nov. 2022, available at: https://sonio.ai/old/pt-br/sonioapp/dt-user-manual-pt-br/. [cited by applicant]
Stümpflen, Effect of detailed fetal echocardiography as part of routine prenatal ultrasonographic screening on detection of congenital heart disease, The Lancet, 348(9031):854-857 (Sep. 1996). [cited by applicant]
Suard C., et al., “Accuracy of prenatal screening for congenital heart disease in population: A retrospective study in Southern France,” PLOS ONE, vol. 15(10):e0239476, 13 pages, DOI:10.1371/journal.pone.0239476. (Oct. … [cited by applicant]
Sun, et al., Human Action Recognition using Factorized Spatio-Temporal Convolutional Networks, retrieved from the internet URL: https://arxiv.org/abs/1510.00562, 9 pages (2015). [cited by applicant]
Sun H.Y., “Prenatal Diagnosis of Congenital Heart Defects: Echocardiography,” Translational Pediatrics, vol. 10(8):2210-2224, doi: 10.21037/tp-20-164. (Aug. 2021). [cited by applicant]
Szegedy, et al., Going Deeper with Convolutions, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 9 pages (Jun. 2015). [cited by applicant]
Szegedy, Going Deeper with Convolutions, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 12 pages (2014). [cited by applicant]
Thomas, et al., Light-weight Spatio-Temporal Graphs for Segmentation and Ejection Fraction Prediction in Cardiac Ultrasound, [cited by applicant]
Tran, et al., A Closer Look at Spatiotemporal Convolutions for Action Recognition, retrieved from the internet URL: https://arxiv.org/abs/1711.11248, 10 pages (2018). [cited by applicant]
Tran, et al., Learning Spatiotemporal Features with 3D Convolutional Networks, IEEE International Conference on Computer Vision (ICCV), 16 pages (2015). [cited by applicant]
Tune Gaussian Mixture Models, retrieved from the internet URL: https://www.mathworks.com/help/stats/tune-gaussian-mixture-models.html, retrieved on Apr. 13, 2023, 7 pages. [cited by applicant]
Tworetzky W., et al., “Improved Surgical Outcome After Fetal Diagnosis of Hypoplastic Left Heart Syndrome,” Circulation, vol. 103(9):1269-1273, DOI:10.1161/01.CIR.103.9.1269. (Mar. 6, 2001). [cited by applicant]
Ultrasound in Pregnancy. Practice Bulletin No. 175. American College of Obstetricians and Gynecologists, [cited by applicant]
Van Nisselrooij A.E.L., “Why Are Congenital Heart Defects Being Missed?” Ultrasound in Obstetrics & Gynecology, vol. 55(6):747-757, doi:10.1002/uog.20358 (Jun. 2020). [cited by applicant]
Varol, et al., Long-term Temporal Convolutions for Action Recognition, retrieved from the internet URL: https://arxiv.org/abs/1604.04494, 8 pages (2017). [cited by applicant]
Vivaaindrean, Detection of Robbery-Related Concepts Using Deep Learning, Final Year Project, UTAR, 56 pages (Jan. 2020). [cited by applicant]
Wang, et al., Actions ˜ Transformations, retrieved from the internet URL: https://arxiv.org/abs/1512.00795, 10 pages (2016). [cited by applicant]
Wang, et al., Towards Good Practices for Very Deep Two-Stream ConvNets, retrieved from the internet URL: https://arxiv.org/abs/1507.02159, 5 pages (2015). [cited by applicant]
“WHO Recommendations on Antenatal Care for a Positive Pregnancy Experience,” World Health Organization; 2016, Retrieved from internet URL:https://www.ncbi.nlm.nih.gov/books/NBK409108/ (Dec. 2022). [cited by applicant]
Wolfe, Deep Learning on Video (Part One): The Early Days, retrieved from the internet URL: https://towardsdatascience.com/deep-learning-on-video-part-one-the-early-days-8a3632ed47d4, 13 pages (2021). [cited by applicant]
Xie, et al., Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification, retrieved from the internet URL: https://arxiv.org/abs/1712.04851, 17 pages (2018). [cited by applicant]