Abstract
Research in artificial intelligence (AI) has progressed over the past decade. The
field of cardiac imaging has seen significant developments using newly developed deep
learning methods for automated image analysis and AI tools for disease detection and
prognostication. This review is aimed at those without special background in AI. We
review AI concepts and survey the growing contemporary applications of AI for image
analysis in echocardiography, nuclear cardiology, cardiac computed tomography, cardiac
magnetic resonance, and invasive angiography.
Résumé
La recherche en intelligence artificielle (IA) a progressé au cours de la dernière
décennie. Le domaine de l’imagerie cardiaque a connu des avancées significatives.
Ainsi, de nouvelles méthodes d’apprentissage profond permettent maintenant l’analyse
automatisée d’images, et des outils d’IA sont utilisés pour la détection et le pronostic
des maladies. Le présent article de synthèse s’adresse à des lecteurs sans connaissances
particulières en IA. Nous passons en revue les concepts de l’IA et nous offrons une
vue d’ensemble des applications contemporaines toujours plus nombreuses de l’IA en
matière d’analyse d’images dans les domaines de l’échocardiographie, de la cardiologie
nucléaire, de la tomodensitométrie cardiaque, de l’imagerie par résonance magnétique
cardiaque et de l’angiographie invasive.
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Canadian Journal of CardiologyAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Artificial Intelligence: A Modern Approach.3rd ed. Prentice Hall, Upper Saddle River, NJ2010
- Generative adversarial networks in cardiology.Can J Cardiol. 2022; 38: 196-203
- Automatic apical view classification of echocardiograms using a discriminative learning dictionary.Med Image Anal. 2017; 36: 15-21
- Fully automated echocardiogram interpretation in clinical practice: feasibility and diagnostic accuracy.Circulation. 2018; 138: 1623-1635
- Fast and accurate view classification of echocardiograms using deep learning.NPJ Digit Med. 2018; 1: 6
- A machine learning algorithm supports ultrasound-naïve novices in the acquisition of diagnostic echocardiography loops and provides accurate estimation of LVEF.Int J Cardiovasc Imaging. 2021; 37: 577-586
- Video-based AI for beat-to-beat assessment of cardiac function.Nature. 2020; 580: 252-256
- Automated echocardiographic quantification of left ventricular ejection fraction without volume measurements using a machine learning algorithm mimicking a human expert.Circ Cardiovasc Imaging. 2019; 12e009303
- Deep learning interpretation of echocardiograms.NPJ Digit Med. 2020; 3: 10
- Variability in ejection fraction measured by echocardiography, gated single-photon emission computed tomography, and cardiac magnetic resonance in patients with coronary artery disease and left ventricular dysfunction.JAMA Netw Open. 2018; 1e181456
- A deep learning approach for assessment of regional wall motion abnormality from echocardiographic images.JACC Cardiovasc Imaging. 2020; 13: 374-381
- Machine-learning algorithms to automate morphological and functional assessments in 2D echocardiography.J Am Coll Cardiol. 2016; 68: 2287-2295
- Cognitive machine-learning algorithm for cardiac imaging: a pilot study for differentiating constrictive pericarditis from restrictive cardiomyopathy.Circ Cardiovasc Imaging. 2016; 9e004330
- Machine learning analysis of left ventricular function to characterize heart failure with preserved ejection fraction.Circ Cardiovasc Imaging. 2018; 11e007138
- Diagnosis of heart failure with preserved ejection fraction: machine learning of spatiotemporal variations in left ventricular deformation.J Am Soc Echocardiogr. 2018; 31: 1272-1284.e9
- Using anatomic intelligence to localize mitral valve prolapse on three-dimensional echocardiography.J Am Soc Echocardiogr. 2016; 29: 938-945
- Mitral annulus segmentation using deep learning in 3-D transesophageal echocardiography.IEEE J Biomed Health Inform. 2020; 24: 994-1003
- A deep learning approach for the automatic recognition of prosthetic mitral valve in echocardiographic images.Comput Biol Med. 2021; 133104388
- Three-dimensional echocardiography vs computed tomography for transcatheter aortic valve replacement sizing.Eur Heart J Cardiovasc Imaging. 2016; : 15-23
- Feasibility, accuracy, and reproducibility of aortic annular and root sizing for transcatheter aortic valve replacement using novel automated three-dimensional echocardiographic software: comparison with multi–detector row computed tomography.J Am Soc Echocardiogr. 2018; 31: 505-514.e3
- Artificial intelligence for the measurement of the aortic valve annulus.J Cardiothorac Vasc Anesth. 2020; 34: 65-71
- Leveraging latest computer science tools to advance nuclear cardiology.J Nucl Cardiol. 2019; 26: 1501-1504
- Automated quantification of myocardial perfusion SPECT using simplified normal limits.J Nucl Cardiol. 2005; 12: 66-77
- Comparison of fully automated computer analysis and visual scoring for detection of coronary artery disease from myocardial perfusion SPECT in a large population.J Nucl Med. 2013; 54: 221-228
- Improved accuracy of myocardial perfusion SPECT for the detection of coronary artery disease using a support vector machine algorithm.J Nucl Med. 2013; 54: 549-555
- Improved accuracy of myocardial perfusion SPECT for detection of coronary artery disease by machine learning in a large population.J Nucl Cardiol. 2013; 20: 553-562
- Deep learning for prediction of obstructive disease from fast myocardial perfusion SPECT.JACC Cardiovasc Imaging. 2018; 11: 1654-1663
- Prediction of revascularization after myocardial perfusion SPECT by machine learning in a large population.J Nucl Cardiol. 2015; 22: 877-884
- Deep learning analysis of upright-supine high-efficiency SPECT myocardial perfusion imaging for prediction of obstructive coronary artery disease: a multicenter study.J Nucl Med. 2019; 60: 664-670
- Prognostic value of combined clinical and myocardial perfusion imaging data using machine learning.JACC Cardiovasc Imaging. 2018; 11: 1000-1009
- Rationale and design of the Registry of Fast Myocardial Perfusion Imaging with Next Generation SPECT (REFINE SPECT).J Nucl Cardiol. 2020; 27: 1010-1021
- Machine learning predicts per-vessel early coronary revascularization after fast myocardial perfusion SPECT: results from multicentre REFINE SPECT registry.Eur Heart J Cardiovasc Imaging. 2020; 21: 549-559
- Diagnostic performance of an artificial intelligence-driven cardiac-structured reporting system for myocardial perfusion SPECT imaging.J Nucl Cardiol. 2020; 27: 1652-1664
- Deep learning in quantitative PET myocardial perfusion imaging.JACC Cardiovasc Imaging. 2020; 13: 180-182
- Cardiac sarcoidosis classification with deep convolutional neural network–based features using polar maps.Comput Biol Med. 2019; 104: 81-86
- Quantification of coronary artery calcium using ultrafast computed tomography.J Am Coll Cardiol. 1990; 15: 827-832
- 2021 Canadian Cardiovascular Society guidelines for the management of dyslipidemia for the prevention of cardiovascular disease in adults.Can J Cardiol. 2021; 37: 1129-1150
- Detection of coronary calcifications from computed tomography scans for automated risk assessment of coronary artery disease: detection of coronary calcifications.Med Phys. 2007; 34: 1450-1461
- A supervised classification-based method for coronary calcium detection in noncontrast CT.Int J Cardiovasc Imaging. 2010; 26: 817-828
- Toward the automatic detection of coronary artery calcification in noncontrast computed tomography data.Int J Cardiovasc Imaging. 2010; 26: 829-838
- Vessel specific coronary artery calcium scoring.Acad Radiol. 2013; 20: 1-9
- Automatic coronary calcium scoring in non–contrast-enhanced ECG-triggered cardiac CT with ambiguity detection.IEEE Trans Med Imaging. 2015; 34: 1867-1878
- Direct automatic coronary calcium scoring in cardiac and chest CT.IEEE Trans Med Imaging. 2019; 38: 2127-2138
- Deep learning for automatic calcium scoring in CT: validation using multiple cardiac CT and chest CT protocols.Radiology. 2020; 295: 66-79
- Evaluation of a deep learning–based automated CT coronary artery calcium scoring algorithm.JACC Cardiovasc Imaging. 2020; 13: 524-526
- Machine learning and coronary artery calcium scoring.Curr Cardiol Rep. 2020; 22: 90
- Quantifying coronary artery calcification from a contrast-enhanced cardiac computed tomography angiography study.Eur Heart J Cardiovasc Imaging. 2014; 15: 210-215
- Coronary calcium scoring from contrast coronary CT angiography using a semiautomated standardized method.J Cardiovasc Comput Tomogr. 2015; 9: 446-453
- Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks.Med Image Anal. 2016; 34: 123-136
- Deep-learning model to predict coronary artery calcium scores in humans from electrocardiogram data.Appl Sci. 2020; 10: 8746
- Machine learning of clinical variables and coronary artery calcium scoring for the prediction of obstructive coronary artery disease on coronary computed tomography angiography: analysis from the CONFIRM registry.Eur Heart J. 2020; 41: 359-367
- Structured learning algorithm for detection of nonobstructive and obstructive coronary plaque lesions from computed tomography angiography.J Med Imaging. 2015; 2014003
- A recurrent CNN for automatic detection and classification of coronary artery plaque and stenosis in coronary CT angiography.IEEE Trans Med Imaging. 2019; 38: 1588-1598
- Optimal medical therapy with or without PCI for stable coronary disease.N Engl J Med. 2007; 356: 1503-1516
- Initial invasive or conservative strategy for stable coronary disease.N Engl J Med. 2020; 382: 1395-1407
- Fractional flow reserve versus angiography for guiding percutaneous coronary intervention.N Engl J Med. 2009; 360: 213-224
- SCCT 2021 expert consensus document on coronary computed tomographic angiography: a report of the Society of Cardiovascular Computed Tomography.J Cardiovasc Comput Tomogr. 2021; 15: 192-217
- Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms.J Am Coll Cardiol. 2011; 58: 1989-1997
- A machine-learning approach for computation of fractional flow reserve from coronary computed tomography.J Appl Physiol. 2016; 121: 42-52
- Use of high-risk coronary atherosclerotic plaque detection for risk stratification of patients with stable chest pain: a secondary analysis of the PROMISE randomized clinical trial.JAMA Cardiol. 2018; 3: 144-152
- Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis.Eur Heart J. 2016; 38: 500-507
- Maximization of the usage of coronary CTA derived plaque information using a machine learning based algorithm to improve risk stratification; insights from the CONFIRM registry.J Cardiovasc Comput Tomogr. 2018; 12: 204-209
- Integrated prediction of lesion-specific ischaemia from quantitative coronary CT angiography using machine learning: a multicentre study.Eur Radiol. 2018; 28: 2655-2664
- Automated plaque analysis for the prognostication of major adverse cardiac events.Eur J Radiol. 2019; 116: 76-83
- Prediction of revascularization by coronary CT angiography using a machine learning ischemia risk score.Eur Radiol. 2021; 31: 1227-1235
- Improved long-term prognostic value of coronary CT angiography–derived plaque measures and clinical parameters on adverse cardiac outcome using machine learning.Eur Radiol. 2021; 31: 486-493
- Coronary CT angiography–derived plaque quantification with artificial intelligence CT fractional flow reserve for the identification of lesion-specific ischemia.Eur Radiol. 2019; 29: 2378-2387
Pugliese F. MBF from dynamic CT perfusion imaging. American College of Cardiology, April 26, 2019. Available at: https://www.acc.org/latest-in-cardiology/articles/2019/04/26/09/46/mbf-from-dynamic-ct-perfusion-imaging. Accessed December 20, 2021.
- Myocardial perfusion analysis in cardiac computed tomography angiographic images at rest.Med Image Anal. 2015; 24: 77-89
- Incremental role of resting myocardial computed tomography perfusion for predicting physiologically significant coronary artery disease: A machine learning approach.J Nucl Cardiol. 2018; 25: 223-233
- Texture analysis and machine learning for detecting myocardial infarction in noncontrast low-dose computed tomography: unveiling the invisible.Invest Radiol. 2018; 53: 338-343
- Pericardial fat burden on ECG-gated noncontrast CT in asymptomatic patients who subsequently experience adverse cardiovascular events.JACC Cardiovasc Imaging. 2010; 3: 352-360
- Epicardial adipose tissue density and volume are related to subclinical atherosclerosis, inflammation and major adverse cardiac events in asymptomatic subjects.J Cardiovasc Comput Tomogr. 2018; 12: 67-73
- Automated quantitation of pericardiac fat from noncontrast CT.Invest Radiol. 2008; 43: 145-153
- Automated quantification of epicardial adipose tissue (EAT) in coronary CT angiography; comparison with manual assessment and correlation with coronary artery disease.J Cardiovasc Comput Tomogr. 2014; 8: 215-221
- Deep learning for quantification of epicardial and thoracic adipose tissue from non-contrast CT.IEEE Trans Med Imaging. 2018; 37: 1835-1846
- Fully automated CT quantification of epicardial adipose tissue by deep learning: a multicenter study.Radiol Artif Intell. 2019; 1e190045
- Relationship of epicardial fat volume from noncontrast CT with impaired myocardial flow reserve by positron emission tomography.J Cardiovasc Comput Tomogr. 2015; 9: 303-309
- deep learning–based quantification of epicardial adipose tissue volume and attenuation predicts major adverse cardiovascular events in asymptomatic subjects.Circ Cardiovasc Imaging. 2020; 13e009829
- A novel machine learning-derived radiotranscriptomic signature of perivascular fat improves cardiac risk prediction using coronary CT angiography.Eur Heart J. 2019; 40: 3529-3543
- Computed tomography imaging in the context of transcatheter aortic valve implantation (TAVI)/transcatheter aortic valve replacement (TAVR): an expert consensus document of the Society of Cardiovascular Computed Tomography.J Cardiovasc Comput Tomogr. 2019; 13: 1-20
- Recursive multiresolution convolutional neural networks for 3D aortic valve annulus planimetry.Int J Comput Assist Radiol Surg. 2020; 15: 577-588
- Enabling automated device size selection for transcatheter aortic valve implantation.J Intervent Cardiol. 2019; 20193591314
Wang ZH, Lahoti G, Wang K, et al. Prediction of paravalvular leak post transcatheter aortic valve replacement using a convolutional neural network. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 2018:1088-91.
- Machine-learning phenotypic classification of bicuspid aortopathy.J Thorac Cardiovasc Surg. 2018; 155: 461-469.e4
- Deep learning for quantitative cardiac MRI.AJR Am J Roentgenol. 2020; 214: 529-535
- Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: is the problem solved?.IEEE Trans Med Imaging. 2018; 37: 2514-2525
Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation [preprint]. arXiv1505.04597. Posted online May 18, 2015.
- 3-D consistent and robust segmentation of cardiac images by deep learning with spatial propagation.IEEE Trans Med Imaging. 2018; 37: 2137-2148
- Left ventricle segmentation via optical-flow-net from short-axis cine MRI: preserving the temporal coherence of cardiac motion.in: Frangi A.F. Schnabel J.A. Davatzikos C. Alberola-López C. Fichtinger G. Medical Image Computing and Computer Assisted Intervention—MICCAI 2018. Vol 11073. Lecture Notes in Computer Science. Springer International Publishing, 2018: 613-621
- The prognostic value of late gadolinium-enhanced cardiac magnetic resonance imaging in nonischemic dilated cardiomyopathy.JACC Cardiovasc Imaging. 2018; 11: 1274-1284
- Convolutional neural network-based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images.Med Phys. 2019; 46: 1740-1751
- Automated cardiac MR scar quantification in hypertrophic cardiomyopathy using deep convolutional neural networks.JACC Cardiovasc Imaging. 2018; 11: 1917-1918
- Automated analysis of cardiovascular magnetic resonance myocardial native T1 mapping images using fully convolutional neural networks.J Cardiovasc Magn Reson. 2019; 21: 7
- Evaluation of fully automated myocardial segmentation techniques in native and contrast-enhanced T1-mapping cardiovascular magnetic resonance images using fully convolutional neural networks.Med Phys. 2021; 48: 215-226
- Deep learning for diagnosis of chronic myocardial infarction on nonenhanced cardiac cine MRI.Radiology. 2019; 291: 606-617
- Cardiac magnetic resonance image-based classification of the risk of arrhythmias in post-myocardial infarction patients.Artif Intell Med. 2015; 64: 205-215
- A framework for combining a motion atlas with nonmotion information to learn clinically useful biomarkers: application to cardiac resynchronisation therapy response prediction.Med Image Anal. 2017; 35: 669-684
- Deep-learning cardiac motion analysis for human survival prediction.Nat Mach Intell. 2019; 1: 95-104
- Recognition of coronary arterial stenosis using neural network on DSA system.Syst Comput Jpn. 1995; 26: 66-74
Avram R, Olgin JE, Wan A, et al. CathAI: fully automated interpretation of coronary angiograms using neural networks [preprint]. arXiv:2106.07708. Posted online June 14, 2021.
- Artificial intelligence in intracoronary imaging.Curr Cardiol Rep. 2020; 22: 46
- Machine learning, predictive analytics, and the emperor’s new clothes: why artificial intelligence has not yet replaced conventional approaches.Can J Cardiol. 2021; 37: 1156-1158
- Addressing bias in artificial intelligence in health care.JAMA. 2019; 322: 2377-2378
- AI can be sexist and racist—it’s time to make it fair.Nat Lond. 2018; 559: 324-326
- The need for a system view to regulate artificial intelligence/machine learning-based software as medical device.NPJ Digit Med. 2020; 3: 53
- The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database.NPJ Digit Med. 2020; 3: 118
- Artificial intelligence to diagnose heart failure based on chest x-rays and potential clinical implications.Can J Cardiol. 2021; 37: 1153-1155
- ECG AI–Guided Screening for Low Ejection Fraction (EAGLE): rationale and design of a pragmatic cluster randomized trial.Am Heart J. 2020; 219: 31-36
Article info
Publication history
Published online: October 03, 2021
Accepted:
September 28,
2021
Received:
August 20,
2021
Footnotes
See page 221 for disclosure information.
Identification
Copyright
© 2021 Canadian Cardiovascular Society. Published by Elsevier Inc. All rights reserved.
