A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases
Abstract
Objectives
Diagnostic imaging decision support (DI-DS) system has emerged as an innovative evidence-based solution to decrease inappropriate diagnostic imaging. The aim of the present study was to design and evaluate a DI-DS system for cerebrovascular diseases.
Methods
The present study was an applied piece of research. First, the conceptual model of the DI-DS system was designed based on its functional and non-functional requirements. Afterwards, to create the system’s knowledge base, cerebrovascular diseases diagnostic imaging algorithms were extracted from the American College of Radiology Appropriateness Criteria (ACR-AC). Subsequently, the system was developed based on the obtained conceptual model and the extracted algorithms. The software was programmed by means of the C#. After debugging the system, it was evaluated regarding its performance and also the users’ satisfaction with it.
Results
Assessing the users’ satisfaction with the system demonstrated that all the evaluation criteria met the acceptable threshold (85 %). The retrospective evaluation of the system’s performance indicated that from among 76 imaging examinations, which had previously been performed for 30 patients, 12 (15.78 %) were deemed inappropriate. And, the system accurately identified all the inappropriate physicians’ decisions. The concurrent evaluation of the system’s performance indicated that the system’s recommendations helped the physicians remove 100 % (4 out of 4) of the inappropriate and 40 % (2 out of 5) of the inconclusive imaging examinations from their initial choices.
Conclusions
A DI-DS system could increase the compliance of the physicians’ decisions with diagnostic imaging guidelines, and also improve treatment outcomes through correct diagnosis and providing timely care.
-
Research ethics: An ethics code (IR.SBMU.RETECH.REC.1402.012) was obtained from the research deputy of Shahid Beheshti University of Medical Sciences (SBMU).
-
Informed consent: Not applicable.
-
Author contributions: The authors have accepted responsibility for the entire content of this manuscript and approved its submission.
-
Use of Large Language Models, AI and Machine Learning Tools: None declared.
-
Conflict of interest: The authors state no conflict of interest.
-
Research funding: None declared.
-
Data availability: Not applicable.
References
1. Zargar Balaye Jame, S, Majdzadeh, R, Akbari Sari, A, Rashidian, A, Arab, M, Rahmani, H. Indications and overuse of computed tomography in minor head trauma. Iran Red Crescent Med J 2014;16:e13067. https://doi.org/10.5812/ircmj.13067.Search in Google Scholar PubMed PubMed Central
2. Callaghan, BC, Pace, RJ, Skolarus, L, Cooper, W, Burke, JF. Headache neuroimaging: routine testing when guidelines recommend against them. Cephalalgia 2015;35:1114–52. https://doi.org/10.1177/0333102415572918.Search in Google Scholar PubMed PubMed Central
3. Pérez, MR. Referral criteria and clinical decision support: radiological protection aspects for justification. Ann ICRP 2015;44:276–87. https://doi.org/10.1177/0146645314551673.Search in Google Scholar PubMed
4. Remedios, D, Brkljacic, B, Ebdon-Jackson, S, Hierath, M, Sinitsyn, V, Vassileva, J. Collaboration, campaigns and champions for appropriate imaging: feedback from the Zagreb workshop. Insights Imaging 2018;9:211–14. https://doi.org/10.1007/s13244-018-0602-9.Search in Google Scholar PubMed PubMed Central
5. Broder, JS, Halabi, SS. Improving the application of imaging clinical decision support tools: making the complex simple. J Am Coll Radiol 2014;11:257–61. https://doi.org/10.1016/j.jacr.2013.10.007.Search in Google Scholar PubMed
6. Solberg, LI, Wei, F, Butler, JC, Palattao, KJ, Vinz, CA, Marshall, MA. Effects of electronic decision support on high-tech diagnostic imaging orders and patients. Am J Manag Care 2010;16:102–6.Search in Google Scholar
7. Min, A, Chan, VW, Aristizabal, R, Peramaki, ER, Agulnik, DB, Strydom, N, et al.. Clinical decision support decreases volume of imaging for Low back pain in an urban emergency department. J Am Coll Radiol 2017;14:889–99. https://doi.org/10.1016/j.jacr.2017.03.005.Search in Google Scholar PubMed
8. Ip, IK, Gershanik, EF, Schneider, LI, Raja, AS, Mar, W, Seltzer, S, et al.. Impact of IT-enabled intervention on MRI use for back pain. Am J Med 2014;127:512–8.e1. https://doi.org/10.1016/j.amjmed.2014.01.024.Search in Google Scholar PubMed PubMed Central
9. Rezaii, PG, Fredericks, N, Lincoln, CM, Hom, J, Willis, M, Burleson, J, et al.. Assessment of the radiology suppor communication and alignment network to reduce medical imaging overutilization: a multipractice cohort study. J Am Coll Radiol 2020;17:597–605. https://doi.org/10.1016/j.jacr.2020.02.011.Search in Google Scholar PubMed
10. Calcaterra, D, Di Modica, G, Tomarchio, O, Romeo, P. A clinical decision support system to increase appropriateness of diagnostic imaging prescriptions. J Netw Comput Appl 2018;117:17–29. https://doi.org/10.1016/j.jnca.2018.05.011.Search in Google Scholar
11. Appari, A, Johnson, ME, Anthony, DL. Health IT and inappropriate utilization of outpatient imaging: a cross-sectional study of U.S. hospitals. Int J Med Inf 2018;109:87–95. https://doi.org/10.1016/j.ijmedinf.2017.10.020.Search in Google Scholar PubMed
12. Ip, IK, Schneider, L, Seltzer, S, Smith, A, Dudley, J, Menard, A, et al.. Impact of provider-led, technology-enabled radiology management program on imaging. Am J Med 2013;126:687–92. https://doi.org/10.1016/j.amjmed.2012.11.034.Search in Google Scholar PubMed
13. Blackmore, CC, Mecklenburg, RS, Kaplan, GS. Effectiveness of clinical decision support in controlling inappropriate imaging. J Am Coll Radiol 2011;8:19–25. https://doi.org/10.1016/j.jacr.2010.07.009.Search in Google Scholar PubMed
14. Vartanians, VM, Sistrom, CL, Weilburg, JB, Rosenthal, DI, Thrall, JH. Increasing the appropriateness of outpatient imaging: effects of a barrier to ordering low-yield examinations. Radiology 2010;255:842–9. https://doi.org/10.1148/radiol.10091228.Search in Google Scholar PubMed
15. Rosenthal, DI, Weilburg, JB, Schultz, T, Miller, JC, Nixon, V, Dreyer, KJ, et al.. Radiology order entry with decision support: initial clinical experience. J Am Coll Radiol 2006;3:799–806. https://doi.org/10.1016/j.jacr.2006.05.006.Search in Google Scholar PubMed
16. Friedman, DP, Smith, NS, Bree, RL, Rao, VM. Experience of an academic neuroradiology division participating in a utilization management program. J Am Coll Radiol 2009;6:119–24. https://doi.org/10.1016/j.jacr.2008.08.006.Search in Google Scholar PubMed
17. Kharbanda, AB, Vazquez-Benitez, G, Ballard, DW, Vinson, DR, Chettipally, UK, Dehmer, SP, et al.. Effect of clinical decision support on diagnostic imaging for pediatric appendicitis: a cluster randomized trial. JAMA Netw Open 2021;4:e2036344. https://doi.org/10.1001/jamanetworkopen.2020.36344.Search in Google Scholar PubMed PubMed Central
18. Poeran, J, Mao, LJ, Zubizarreta, N, Mazumdar, M, Darrow, B, Genes, N, et al.. Effect of clinical decision support on appropriateness of advanced imaging use among physicians-in training. Am J Roentgenol 2019;212:1–8. https://doi.org/10.2214/ajr.18.19931.Search in Google Scholar
19. Huber, TC, Krishnaraj, A, Patrie, J, Gaskin, CM. Impact of a commercially available clinical decision support program on provider ordering habits. J Am Coll Radiol 2018;15:951–7. https://doi.org/10.1016/j.jacr.2018.03.045.Search in Google Scholar PubMed
20. Diekhoff, T, Kainberger, F, Oleaga, L, Dewey, M, Zimmermann. Effectiveness of the clinical decision support tool ESR eGUIDE for teaching medical students the appropriate selection of imaging tests: randomized cross-over evaluation. Eur Radiol 2020;30:5684–9. https://doi.org/10.1007/s00330-020-06942-2.Search in Google Scholar PubMed PubMed Central
21. Lacson, R, Ip, I, Hentel, KD, Malhotra, S, Balthazar, P, Langlotz, CP, et al.. Medicare imaging demonstration: assessing attributes of appropriate use criteria and their influence on ordering behavior. AJR Am J Roentgenol 2017;208:1051–7. https://doi.org/10.2214/ajr.16.17169.Search in Google Scholar PubMed
22. Bookma, K, West, D, Ginde, A, Wiler, J, McIntyre, R, Hammes, A, et al.. Embedded clinical decision support in Electronic Health Record decreases use of high-cost imaging in the emergency department. Acad Emerg Med 2017;24:839–45. https://doi.org/10.1111/acem.13195.Search in Google Scholar PubMed PubMed Central
23. Chepelev, LL, Wang, X, Gold, B, Bonzel, CL, Rybicki Jr, F, Uyeda, JW, et al.. Improved appropriateness of advanced diagnostic imaging after implementation of clinical decision support mechanism. J Digit Imag 2021;34:397–403. https://doi.org/10.1007/s10278-021-00433-6.Search in Google Scholar PubMed PubMed Central
24. Hynes, JP, Hunter, K, Rochford, M. Utilization and appropriateness in cervical spine trauma imaging: implementation of clinical decision support criteria. Ir J Med Sci 2020;189:333–6. https://doi.org/10.1007/s11845-019-02059-8.Search in Google Scholar PubMed
25. The European Society of Radiology. Summary of the proceedings of the international forum 2016: imaging referral guidelines and clinical decision support - how can radiologists implement imaging referral guidelines in clinical routine? Insights into Imaging 2017;8:1–9. https://doi.org/10.1007/s13244-016-0523-4.Search in Google Scholar PubMed PubMed Central
26. The European Society of Radiology. Methodology for ESR iGuide content. Insights Imaging 2019;10:1–5. https://doi.org/10.1186/s13244-019-0720-z.Search in Google Scholar PubMed PubMed Central
27. Making the best use of clinical radiology. The royal college of radiologists. https://www.irefer.org.uk/ [Accessed 13 Jan 2022].Search in Google Scholar
28. Rahimi, F, Rabiei, R, Seddighi, AS, Roshanpoor, A, Seddighi, A, Moghaddasi, H. Features and functions of decision support systems for appropriate diagnostic imaging: a scoping review. Diagnosis 2023;11:4–16. https://doi.org/10.1515/dx-2023-0083.Search in Google Scholar PubMed
29. Gupta, A, Ip, IK, Raja, AS, Andruchow, JE, Sodickson, A, Khorasani, R. Effect of clinical decision support on documented guideline adherence for head CT in emergency department patients with mild traumatic brain injury. J Am Med Inf Assoc 2014;21:e347–51. https://doi.org/10.1136/amiajnl-2013-002536.Search in Google Scholar PubMed PubMed Central
30. Bowen, JK, Reed, MH, Zhang, L, Curry, L. The effect of incorporating guidelines into a computerized order entry system for diagnostic imaging. J Am Coll Radiol 2011;8:251–8. https://doi.org/10.1016/j.jacr.2010.11.020.Search in Google Scholar PubMed
31. Meunier, PY, Raynaud, C, Guimaraes, E, Gueyffier, F, Letrilliart, L. Barriers and facilitators to the use of clinical decision support systems in primary care: a mixed-methods systematic review. Ann Fam Med 2023;21:57–69. https://doi.org/10.1370/afm.2908.Search in Google Scholar PubMed PubMed Central
32. Bruno, MA, Fotos, JS, Pitot, M, Franceschi, AM, Neutze, JA, Willis, MH, et al.. Factors driving resistance to clinical decision support: finding inspiration in radiology 3.0. J Am Coll Radiol 2022 19:366–76, https://doi.org/10.1016/j.jacr.2021.08.017.Search in Google Scholar PubMed
33. Liberati, EG, Ruggiero, F, Galuppo, L, Gorli, M, González-Lorenzo, M, Maraldi, M, et al.. What hinders the uptake of computerized decision support systems in hospitals? A qualitative study and framework for implementation. Implement Sci 2017;12:113. https://doi.org/10.1186/s13012-017-0644-2.Search in Google Scholar PubMed PubMed Central
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Articles in the same Issue
- Frontmatter
- Review
- Systematic review and meta-analysis of observational studies evaluating glial fibrillary acidic protein (GFAP) and ubiquitin C-terminal hydrolase L1 (UCHL1) as blood biomarkers of mild acute traumatic brain injury (mTBI) or sport-related concussion (SRC) in adult subjects
- Opinion Papers
- From stable teamwork to dynamic teaming in the ambulatory care diagnostic process
- Bringing team science to the ambulatory diagnostic process: how do patients and clinicians develop shared mental models?
- Vitamin D assay and supplementation: still debatable issues
- Original Articles
- Developing a framework for understanding diagnostic reconciliation based on evidence review, stakeholder engagement, and practice evaluation
- Validity and reliability of Brier scoring for assessment of probabilistic diagnostic reasoning
- Impact of disclosing a working diagnosis during simulated patient handoff presentation in the emergency department: correctness matters
- Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned
- Time pressure in diagnosing written clinical cases: an experimental study on time constraints and perceived time pressure
- A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases
- Bridging the divide: addressing discrepancies between clinical guidelines, policy guidelines, and biomarker utilization
- Unnecessary repetitions of C-reactive protein and leukocyte count at the emergency department observation unit contribute to higher hospital admission rates
- Quality control of ultrasonography markers for Down’s syndrome screening: a retrospective study by the laboratory
- Short Communications
- Unclassified green dots on nucleated red blood cells (nRBC) plot in DxH900 from a patient with hyperviscosity syndrome
- Bayesian intelligence for medical diagnosis: a pilot study on patient disposition for emergency medicine chest pain
- Case Report – Lessons in Clinical Reasoning
- A delayed diagnosis of hyperthyroidism in a patient with persistent vomiting in the presence of Chiari type 1 malformation
- Letters to the Editor
- Mpox (monkeypox) diagnostic kits – September 2024
- Barriers to diagnostic error reduction in Japan
- Superwarfarin poisoning: a challenging diagnosis
- Reviewer Acknowledgment
- Reviewer Acknowledgment
Articles in the same Issue
- Frontmatter
- Review
- Systematic review and meta-analysis of observational studies evaluating glial fibrillary acidic protein (GFAP) and ubiquitin C-terminal hydrolase L1 (UCHL1) as blood biomarkers of mild acute traumatic brain injury (mTBI) or sport-related concussion (SRC) in adult subjects
- Opinion Papers
- From stable teamwork to dynamic teaming in the ambulatory care diagnostic process
- Bringing team science to the ambulatory diagnostic process: how do patients and clinicians develop shared mental models?
- Vitamin D assay and supplementation: still debatable issues
- Original Articles
- Developing a framework for understanding diagnostic reconciliation based on evidence review, stakeholder engagement, and practice evaluation
- Validity and reliability of Brier scoring for assessment of probabilistic diagnostic reasoning
- Impact of disclosing a working diagnosis during simulated patient handoff presentation in the emergency department: correctness matters
- Implementation of a bundle to improve diagnosis in hospitalized patients: lessons learned
- Time pressure in diagnosing written clinical cases: an experimental study on time constraints and perceived time pressure
- A decision support system to increase the compliance of diagnostic imaging examinations with imaging guidelines: focused on cerebrovascular diseases
- Bridging the divide: addressing discrepancies between clinical guidelines, policy guidelines, and biomarker utilization
- Unnecessary repetitions of C-reactive protein and leukocyte count at the emergency department observation unit contribute to higher hospital admission rates
- Quality control of ultrasonography markers for Down’s syndrome screening: a retrospective study by the laboratory
- Short Communications
- Unclassified green dots on nucleated red blood cells (nRBC) plot in DxH900 from a patient with hyperviscosity syndrome
- Bayesian intelligence for medical diagnosis: a pilot study on patient disposition for emergency medicine chest pain
- Case Report – Lessons in Clinical Reasoning
- A delayed diagnosis of hyperthyroidism in a patient with persistent vomiting in the presence of Chiari type 1 malformation
- Letters to the Editor
- Mpox (monkeypox) diagnostic kits – September 2024
- Barriers to diagnostic error reduction in Japan
- Superwarfarin poisoning: a challenging diagnosis
- Reviewer Acknowledgment
- Reviewer Acknowledgment