research-article

Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens

Authors:

Melanie F. Pradier,

Thomas H. McCoy,

Finale Doshi-Velez,

Krzysztof Z. GajosAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 659, Pages 1 - 14

https://doi.org/10.1145/3411764.3445385

Published: 07 May 2021 Publication History

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens

Pages 1 - 14

Abstract
References

Abstract

Major depressive disorder is a debilitating disease affecting 264 million people worldwide. While many antidepressant medications are available, few clinical guidelines support choosing among them. Decision support tools (DSTs) embodying machine learning models may help improve the treatment selection process, but often fail in clinical practice due to poor system integration.

We use an iterative, co-design process to investigate clinicians’ perceptions of using DSTs in antidepressant treatment decisions. We identify ways in which DSTs need to engage with the healthcare sociotechnical system, including clinical processes, patient preferences, resource constraints, and domain knowledge. Our results suggest that clinical DSTs should be designed as multi-user systems that support patient-provider collaboration and offer on-demand explanations that address discrepancies between predictions and current standards of care. Through this work, we demonstrate how current trends in explainable AI may be inappropriate for clinical environments and consider paths towards designing these tools for real-world medical systems.

References

[1]

Bryant AD, Fletcher GS, and TH Payne. 2014. Drug interaction alert override rates in the Meaningful Use era. Appl Clin Inf 5(2014), 802–813.

[2]

Alex Albright. 2019. If You Give a Judge a Risk Score: Evidence from Kentucky Bail Decisions. The John M. Olin Center for Law, Economics, and Business Fellows’ Discussion Paper Series (2019), 1–44.

[3]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[4]

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, and Eric Horvitz. 2019. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 7, 1(2019), 2–11.

[5]

Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Dr. Paisan Raumviboonsuk, and Laura Vardoulakis. 2020. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. In CHI Conference on Human Factors in Computing Systems (CHI ’20). 1–12.

Digital Library

[6]

Marc Berg. 1999. Patient care information systems and health care work: a sociotechnical approach. International Journal of Medical Informatics (1999), 87–101. https://doi.org/10.1016/S1386-5056(99)00011-8

[7]

Marc Berg, J. Aarts, and J. Van der Lei. 2003. ICT in Health Care: Sociotechnical Approaches. Methods of Information in Medicine 42, 4 (2003), 297–301. https://doi.org/10.1267/METH03040297

[8]

Zana Buçinca, Phoebe Lin, Krzysztof Z. Gajos, and Elena L. Glassman. 2020. Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems. In ACM Proceedings ofthe 25th Conference on Intelligent User Interfaces. 454–464. https://doi.org/10.1145/3377325.3377498 arxiv:2001.08298

Digital Library

[9]

Adrian Bussone, Simone Stumpf, and Dympna O’Sullivan. 2015. The role of explanations on trust and reliance in clinical decision support systems. Proceedings - 2015 IEEE International Conference on Healthcare Informatics, ICHI 2015 (2015), 160–169. https://doi.org/10.1109/ICHI.2015.26

Digital Library

[10]

Carrie J Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S Corrado, Martin C Stumpe, Michael Terry, Carri J Cai, and Nara yan Heg. 2019. Tools for Coping with Imperfect Algorithms During Medical Decision-Making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300234

Digital Library

[11]

Delesha M. Carpenter, Lorie L. Geryk, Annie T. Chen, Rebekah H. Nagler, Nathan F. Dieckmann, and Paul K.J. Han. 2016. Conflicting health information: a critical research need. Health Expectations 19, 6 (2016), 1173–1182. https://doi.org/10.1111/hex.12438

[12]

Cathy Charles, Amiram Gafni, and Tim Whelan. 1997. Shared decision-making in the medical encounter: What does it mean? (Or it takes, at least two to tango). Social Science and Medicine 44, 5 (1997), 681–692. https://doi.org/10.1016/S0277-9536(96)00221-3

[13]

Kathy Charmaz and Linda Liska Belgrave. 2012. Qualitative interviewing and grounded theory analysis. The SAGE Handbook of Interview Research: The Complexity of the Craft (2012), 347–366. https://doi.org/10.4135/9781452218403.n25

[14]

Srikant Devaraj, Sushil K. Sharma, Dyan J. Fausto, Sara Viernes, and Hadi Kharrazi. 2014. Barriers and Facilitators to Clinical Decision Support Systems Adoption: A Systematic Review. Journal of Business Administration Research 3, 2 (2014). https://doi.org/10.5430/jbar.v3n2p36

[15]

Jonathan Dodge, Q. Vera Liao, Yunfeng Zhang, Rachel K.E. Bellamy, and Casey Dugan. 2019. Explaining models: An empirical study of how explanations impact fairness judgment. In International Conference on Intelligent User Interfaces. 275–285. https://doi.org/10.1145/3301275.3302310

Digital Library

[16]

Upol Ehsan and Mark O. Riedl. 2020. Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach. arXiv preprint arXiv:2002.01092.(2020). arxiv:2002.01092http://arxiv.org/abs/2002.01092

[17]

Satu Elo and Helvi Kyngäs. 2008. The qualitative content analysis process. Journal of Advanced Nursing 62, 1 (2008), 107–115. https://doi.org/10.1111/j.1365-2648.2007.04569.x

[18]

Maurizio Fava and Kenneth S. Kendler. 2000. Major Depressive Disorder. Neuron 28(2000), 335–341. https://doi.org/10.1016/B978-012373947-6.00245-2

[19]

Paolo Fusar-Poli, Ziad Hijazi, Daniel Stahl, and Ewout W. Steyerberg. 2018. The Science of Prognosis in Psychiatry: A Review. JAMA Psychiatry 75, 12 (2018), 1280–1288. https://doi.org/10.1001/jamapsychiatry.2018.2530

[20]

Ben Green and Yiling Chen. 2019. The principles and limits of algorithm-in-the-loop decision making. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019). https://doi.org/10.1145/3359152

Digital Library

[21]

Riccardo Guidotti, Anna Monreale, and Salvatore Ruggieri. 2018. A Survey of Methods for Explaining Black Box Models. Comput. Surveys 51, 5 (2018).

Digital Library

[22]

Jianxing He, Sally L. Baxter, Jie Xu, Jiming Xu, Xingtao Zhou, and Kang Zhang. 2019. The practical implementation of artificial intelligence technologies in medicine. Nature Medicine 25, 1 (2019), 30–36. https://doi.org/10.1038/s41591-018-0307-0

[23]

Judith H. Hibbard and Jessica Greene. 2013. What the evidence shows about patient activation: Better health outcomes and care experiences; fewer data on costs. Health Affairs 32, 2 (2013), 207–214. https://doi.org/10.1377/hlthaff.2012.1061

[24]

Fred Hohman, Andrew Head, Rich Caruana, Robert DeLine, and Steven M. Drucker. 2019. Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19 (2019), 1–13. https://doi.org/10.1145/3290605.3300809

Digital Library

[25]

Michael C Hughes, Gabriel Hope, Leah Weiner, Thomas H Mccoy, Roy H Perlis, Erik Sudderth, and Finale Doshi-velez. 2018. Semi-Supervised Prediction-Constrained Topic Models. In Proceedings of the 21st International Conference on Artificial Intelligence and Statistics (AISTATS), Vol. 84.

[26]

Michael C. Hughes, Melanie F. Pradier, Andrew Slavin Ross, Thomas H. McCoy, Roy H. Perlis, and Finale Doshi-Velez. 2020. Assessment of a Prediction Model for Antidepressant Treatment Stability Using Supervised Topic Models. JAMA Network Open 3, 5 (2020), e205308. https://doi.org/10.1001/jamanetworkopen.2020.5308

[27]

Catherine Hutton and Jane Gunn. 2007. Do longer consultations improve the management of psychological problems in general practice? A systematic literature review. BMC Health Services Research 7 (2007). https://doi.org/10.1186/1472-6963-7-71

[28]

Greg Irving, Ana Luisa Neves, Hajira Dambha-Miller, Ai Oishi, Hiroko Tagashira, Anistasiya Verho, and John Holden. 2017. International variations in primary care physician consultation time: A systematic review of 67 countries. BMJ Open 7, 10 (2017), 1–15. https://doi.org/10.1136/bmjopen-2017-017902

[29]

Maia Jacobs, Melanie F. Pradier, Thomas H. McCoy Jr, Roy H. Perlis, Finale Doshi-Velez, and Krzysztof Z. Gajos. 2021. How machine learning recommendations influence clinician treatment selections: the example of antidepressant selection. Translational Psychiatry(2021), (in press).

[30]

Aditya V. Karhade, Paul T. Ogink, Quirina C.B.S. Thio, Thomas D. Cha, William B. Gormley, Stuart H. Hershman, Timothy R. Smith, Jianren Mao, Andrew J. Schoenfeld, Christopher M. Bono, and Joseph H. Schwab. 2019. Development of machine learning algorithms for prediction of prolonged opioid prescription after surgery for lumbar disc herniation. Spine Journal 19, 11 (2019), 1764–1771. https://doi.org/10.1016/j.spinee.2019.06.002

[31]

Sidney H. Kennedy, Raymond W. Lam, Roger S. McIntyre, S. Valérie Tourjman, Venkat Bhat, Pierre Blier, Mehrul Hasnain, Fabrice Jollant, Anthony J. Levitt, Glenda M. MacQueen, Shane J. McInerney, Diane McIntosh, Roumen V. Milev, Daniel J. Müller, Sagar V. Parikh, Norma L. Pearson, Arun V. Ravindran, and Rudolf Uher. 2016. Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 clinical guidelines for the management of adults with major depressive disorder: Section 3. Pharmacological Treatments. Canadian Journal of Psychiatry 61, 9 (2016), 540–560. https://doi.org/10.1177/0706743716659417

[32]

Ronald C. Kessler, P. Berglund, O. Demler, R. Jin, D. Koretz, K. R. Merikangas, A. J. Rush, E. E. Walters, A. Wang, Barry Rovner, and Robin Casten. 2003. The epidemiology of major depressive disorder. Evidence-Based Eye Care 4, 4 (2003), 186–187. https://doi.org/10.1097/00132578-200310000-00002

[33]

Saif Khairat, David Marc, William Crosby, and Ali Al Sanousi. 2018. Reasons for physicians not adopting clinical decision support systems: Critical analysis. Journal of Medical Internet Research 20, 4 (2018). https://doi.org/10.2196/medinform.8912

[34]

Israa Khaleel, Barbara C. Wimmer, Gregory M. Peterson, Syed Tabish Razi Zaidi, Erin Roehrer, Elizabeth Cummings, and Kenneth Lee. 2020. Health information overload among health consumers: A scoping review. Patient Education and Counseling 103, 1 (2020), 15–32. https://doi.org/10.1016/j.pec.2019.08.008

[35]

Gilad J. Kuperman, Anne Bobb, Thomas H. Payne, Anthony J. Avery, Tejal K. Gandhi, Gerard Burns, David C. Classen, and David W. Bates. 2007. Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review. Journal of the American Medical Informatics Association 14, 1(2007), 29–40. https://doi.org/10.1197/jamia.M2170

[36]

Yuhan Luo, Peiyi Liu, and Eun Kyoung Choe. 2019. Co-Designing Food Trackers with Dietitians. (2019), 1–13. https://doi.org/10.1145/3290605.3300822

Digital Library

[37]

Haley MacLeod, Ben Jelen, Annu Prabhakar, Lora Oehlberg, Katie Siek, and Kay Connelly. 2017. A Guide to Using Asynchronous Remote Communities (ARC) for Researching Distributed Populations. EAI Endorsed Transactions on Pervasive Health and Technology 3, 11(2017), 152898. https://doi.org/10.4108/eai.18-7-2017.152898

[38]

Glenda MacQueen, Pasqualina Santaguida, Homa Keshavarz, Natalia Jaworska, Mitchell Levine, Joseph Beyene, and Parminder Raina. 2017. Systematic review of clinical practice guidelines for failed antidepressant treatment response in major depressive disorder, dysthymia, and subthreshold depression in adults. The Canadian Journal of Psychiatry 62, 1 (2017), 11–23.

[39]

Gregory Makoul and Marla L. Clayman. 2006. An integrative model of shared decision making in medical encounters. Patient Education and Counseling 60, 3 (2006), 301–312. https://doi.org/10.1016/j.pec.2005.06.010

[40]

Andreas Menke. 2018. Precision pharmacotherapy: psychiatry’s future direction in preventing, diagnosing, and treating mental disorders. Pharmacogenomics and Personalized Medicine(2018), 11–211. https://doi.org/10.2147/PGPM.S146110

[41]

B Middleton, D F Sittig, and A Wright. 2016. Clinical Decision Support: a 25 Year Retrospective and a 25 Year Vision. IMIA Yearbook of medical informatics(2016), 103–116. https://doi.org/10.15265/IYS-2016-s034

[42]

Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence 267 (2019), 1–38. https://doi.org/10.1016/j.artint.2018.07.007 arxiv:1706.07269

[43]

Karen C. Nanji, Sarah P. Slight, Diane L. Seger, Insook Cho, Julie M. Fiskio, Lisa M. Redden, Lynn A. Volk, and David W. Bates. 2014. Overrides of medication-related clinical decision support alerts in outpatients. Journal of the American Medical Informatics Association 21, 3(2014), 487–491. https://doi.org/10.1136/amiajnl-2013-001813

[44]

Renee Noortman, Britta F. Schulte, Paul Marshall, Saskia Bakker, and Anna L. Cox. 2019. Hawkeye – Deploying a design fiction probe. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–14. https://doi.org/10.1145/3290605.3300652

Digital Library

[45]

Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447–453. https://doi.org/10.1126/science.aax2342

[46]

Changhoon Oh, Jungwoo Song, Jinhan Choi, Seonghyeon Kim, Sungwoo Lee, and Bongwon Suh. 2018. I Lead, You Help but Only with Enough Details: Understanding User Experience of Co-Creation with Artificial Intelligence. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (2018), 649:1—-649:13. https://doi.org/10.1145/3173574.3174223

Digital Library

[47]

Jerome A. Osheroff, Jonathan M. Teich, Blackford Middleton, Elaine B. Steen, Adam Wright, and Don E. Detmer. 2007. A Roadmap for National Action on Clinical Decision Support. Journal of the American Medical Informatics Association 14, 2(2007), 141–145. https://doi.org/10.1197/jamia.M2334

[48]

Roy H Perlis. 2016. Abandoning personalization to get to precision in the pharmacotherapy of depression. World Psychiatry 15, October (2016), 228–235.

[49]

Melanie F. Pradier, Thomas H. McCoy, Michael Hughes, Roy H. Perlis, and Finale Doshi-Velez. 2020. Predicting treatment dropout after antidepressant initiation. Translational Psychiatry 10, 1 (2020). https://doi.org/10.1038/s41398-020-0716-y

[50]

Melanie F. Pradier, Javier Zazo, Sonali Parbhoo, Roy H. Perlis, Maurizio Zazzi, and Finale Doshi-Velez. 2021. Preferential Mixture-of-Experts: Interpretable Models that Rely on Human Expertise As Much As Possible. In AMIA 2021 Virtual Informatics Summit.

[51]

Wanda Pratt, Madhu C Reddy, David W McDonald, Peter Tarczy-Hornoch, and John H Gennari. 2004. Incorporating ideas from computer-supported cooperative work.Journal of biomedical informatics 37, 2 (apr 2004), 128–37. https://doi.org/10.1016/j.jbi.2004.04.001

Digital Library

[52]

Cynthia Rudin. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence 1, 5 (2019), 206–215. https://doi.org/10.1038/s42256-019-0048-x arxiv:1811.10154

[53]

A. Rush. 2006. Acute and Longer-Term Outcomes in Depressed Outpatients Requiring One or Several Treatment Steps: A STAR*D Report. American Journal of Psychiatry 163, 11 (2006), 1905. https://doi.org/10.1176/appi.ajp.163.11.1905

[54]

Devansh Saxena, Karla Badillo-Urquiola, Pamela J. Wisniewski, and Shion Guha. 2020. A Human-Centered Review of the Algorithms used within the U.S. Child Welfare System. In CHI ’20. arxiv:arXiv:2003.03541v1

[55]

Kumiko O. Schnock, Julia E. Snyder, Theresa E. Fuller, Megan Duckworth, Maxwell Grant, Catherine Yoon, Stuart Lipsitz, Anuj K. Dalal, David W. Bates, and Patricia C. Dykes. 2019. Acute care patient portal intervention: Portal use and patient activation. Journal of Medical Internet Research 21, 7 (2019), 1–11. https://doi.org/10.2196/13336

[56]

Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019. Fairness and abstraction in sociotechnical systems. Proceedings of the 2019 Conference on Fairness, Accountability, and Transparency (2019), 59–68. https://doi.org/10.1145/3287560.3287598

Digital Library

[57]

Adrian B.R. Shatte, Delyse M. Hutchinson, and Samantha J. Teague. 2019. Machine learning in mental health: A scoping review of methods and applications. Psychological Medicine 49, 9 (2019), 1426–1448. https://doi.org/10.1017/S0033291719000151

[58]

Gregory E. Simon and Roy H. Perlis. 2010. Personalized medicine for depression: Can we match patients with treatments?American Journal of Psychiatry 167, 12 (2010), 1445–1455. https://doi.org/10.1176/appi.ajp.2010.09111680

[59]

Amy Sitapi, Hyeoneui Kim, Barbara Berkovich, Rebecca Marmor, Siddharth Singh, Robert El-Kareh, Brian Clay, and Lucila Ohno-Machado. 2016. Integrated Precision Medicine: The Role of Electronic Health Records in Delivering Personalized Treatment. Physiology & behavior 176, 1 (2016), 100–106. https://doi.org/10.1016/j.gde.2016.03.011

[60]

Dean F. Sittig, Adam Wright, Jerome A. Osheroff, Blackford Middleton, Jonathan M. Teich, Joan S. Ash, Emily Campbell, and David W. Bates. 2008. Grand challenges in clinical decision support. Journal of Biomedical Informatics 41, 2 (2008), 387–392. https://doi.org/10.1016/j.jbi.2007.09.003

Digital Library

[61]

Michael Solomon, Stephen L. Wagner, and James Goes. 2012. Effects of a Web-based intervention for adults with chronic conditions on patient activation: online randomized controlled trial.Journal of medical Internet research 14, 1 (2012), 1–13. https://doi.org/10.2196/jmir.1924

[62]

Megan Stevenson. 2018. Assessing risk assessment in action. Minnesota Law Review 103, 1 (2018), 303–384. https://doi.org/10.2139/ssrn.3016088

[63]

Stephen Thielke, Steven Vannoy, and Jürgen Unützer. 2007. Integrating Mental Health and Primary Care. Prim Care Clin Office Pract(2007), 571–592.

[64]

Sana Tonekaboni, Shalmali Joshi, Melissa D McCradden, and Anna Goldenberg. 2019. What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use. Ml (2019), 1–19. arxiv:1905.05134http://arxiv.org/abs/1905.05134

[65]

Madhukar H. Trivedi and Ella J. Daly. 2008. Treatment strategies to improve and sustain remission in major depressive disorder. Dialogues in Clinical Neuroscience 10, 4 (2008), 377–384.

[66]

Stijn Van de Velde, Annemie Heselmans, Nicolas Delvaux, Linn Brandt, Luis Marco-Ruiz, David Spitaels, Hanne Cloetens, Tiina Kortteisto, Pavel Roshanov, Ilkka Kunnamo, Bert Aertgeerts, Per Olav Vandvik, and Signe Flottorp. 2018. A systematic review of trials evaluating success factors of interventions with computerised clinical decision support. Implementation Science 13, 1 (2018), 1–11. https://doi.org/10.1186/s13012-018-0790-1

[67]

Danding Wang, Qian Yang, Ashraf Abdul, Brian Y Lim, and United States. 2019. Designing Theory-Driven User-Centric Explainable AI. In CHI Conference on Human Factors in Computing Systems (CHI ’19). 1–15.

[68]

Jenna Wiens, Suchi Saria, Mark Sendak, Marzyeh Ghassemi, Vincent X. Liu, Finale Doshi-Velez, Kenneth Jung, Katherine Heller, David Kale, Mohammed Saeed, Pilar N. Ossorio, Sonoo Thadaney-Israni, and Anna Goldenberg. 2019. Do no harm: a roadmap for responsible machine learning for health care. Nature Medicine 25, September (2019). https://doi.org/10.1038/s41591-019-0548-6

[69]

Nicole J. Wolf and Derek R. Hopko. 2008. Psychosocial and pharmacological interventions for depressed adults in primary care: A critical review. Clinical Psychology Review 28, 1 (2008), 131–161. https://doi.org/10.1016/j.cpr.2007.04.004

[70]

Yao Xie, Melody Chen, David Kao, Ge Gao, and Xiang ’Anthony’ Chen. 2020. CheXplain: Enabling Physicians to Explore and Understand Data-Driven, AI-Enabled Medical Imaging Analysis. In CHI 2020. 1–13. https://doi.org/10.1145/3313831.3376807 arxiv:2001.05149

Digital Library

[71]

Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fiting intelligent decision support into critical, clinical decision-making processes. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–11. https://doi.org/10.1145/3290605.3300468 arxiv:1904.09612

Digital Library

[72]

Q Yang, J Zimmerman, and A Steinfeld. 2015. Review of Medical Decision Support Tools: Emerging Opportunity for Interaction Design. IASDR 2015 InterplaySeptember (2015), 1–16. https://doi.org/10.13140/RG.2.1.1441.3284

[73]

Ming Yin, Jennifer Wortman Vaughan, and Hanna Wallach. 2019. Understanding the Effect of Accuracy on Trust in Machine Learning Models. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019), 1–12. https://doi.org/10.1145/3290605.3300509

Digital Library

Cited By

Auf HSvedberg PNygren JNair MLundgren L(2025)The Use of AI in Mental Health Services to Support Decision-Making: Scoping ReviewJournal of Medical Internet Research10.2196/6354827(e63548)Online publication date: 24-Jan-2025
https://doi.org/10.2196/63548
Zellner KSarcevic ABarnouw MKrentsa MSullivan TKim MBurd R(2025)Addressing Teamwork Delays during Life-Saving Interventions through an Activity Theory-Informed AnalysisProceedings of the ACM on Human-Computer Interaction10.1145/37011959:1(1-23)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701195
McCradden MThai KAssadi ATonekaboni SStedman IJoshi SZhang MChevalier FGoldenberg A(2025)What makes a ‘good’ decision with artificial intelligence? A grounded theory study in paediatric careBMJ Evidence-Based Medicine10.1136/bmjebm-2024-112919(bmjebm-2024-112919)Online publication date: 12-Feb-2025
https://doi.org/10.1136/bmjebm-2024-112919
Show More Cited By

Index Terms

Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens

Index terms have been assigned to the content through auto-classification.

Recommendations

Meaningful Use of Electronic Health Records for Physician Collaboration: A Patient Centered Health Care Perspective
HICSS '14: Proceedings of the 2014 47th Hawaii International Conference on System Sciences

EHRs (Electronic Health Records), can contribute greatly to improving care and managing the rising costs of healthcare. The use and the integration of EHRs (Electronic Health Records) in supporting collaboration to increase the efficiency and ...
Measuring the awareness of health care providers at Benghazi Medical Center for Health Informatics
ICEMIS'20: Proceedings of the 6th International Conference on Engineering & MIS 2020

Health informatics has led to many changes in the health service delivery system. Awareness of health informatics is important and crucial to modern physicians. In general today there is a lack of awareness and understanding of health informatics among ...
Designing inpatient technology to meet the medication information needs of cardiology patients
IHI '12: Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium

As patients are encouraged to become active participants in their own care, recent research has begun to explore the direct sharing of electronic health information with patients during hospital visits. The design of patient-facing views of clinical ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

87
Total Citations
View Citations
2,043
Total Downloads

Downloads (Last 12 months)615
Downloads (Last 6 weeks)65

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Auf HSvedberg PNygren JNair MLundgren L(2025)The Use of AI in Mental Health Services to Support Decision-Making: Scoping ReviewJournal of Medical Internet Research10.2196/6354827(e63548)Online publication date: 24-Jan-2025
https://doi.org/10.2196/63548
Zellner KSarcevic ABarnouw MKrentsa MSullivan TKim MBurd R(2025)Addressing Teamwork Delays during Life-Saving Interventions through an Activity Theory-Informed AnalysisProceedings of the ACM on Human-Computer Interaction10.1145/37011959:1(1-23)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701195
McCradden MThai KAssadi ATonekaboni SStedman IJoshi SZhang MChevalier FGoldenberg A(2025)What makes a ‘good’ decision with artificial intelligence? A grounded theory study in paediatric careBMJ Evidence-Based Medicine10.1136/bmjebm-2024-112919(bmjebm-2024-112919)Online publication date: 12-Feb-2025
https://doi.org/10.1136/bmjebm-2024-112919
Fu JYang BGuo YZhou YWang X(2025)Automated Clinical Summary Generation via Integrating Structured and Unstructured DataBig Data10.1007/978-981-96-1024-2_21(290-304)Online publication date: 24-Jan-2025
https://doi.org/10.1007/978-981-96-1024-2_21
Shojaei FShojaei FOsorio Torres JShih P(2024)Insights From Art Therapists on Using AI-Generated Art in Art Therapy: Mixed Methods StudyJMIR Formative Research10.2196/630388(e63038-e63038)Online publication date: 4-Dec-2024
https://doi.org/10.2196/63038
Nair MLundgren LSoliman ADryselius PFogelberg EPetersson MHamed OTriantafyllou MNygren J(2024)Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact AssessmentJMIR Research Protocols10.2196/5274413(e52744)Online publication date: 11-Mar-2024
https://doi.org/10.2196/52744
Fakhari HScherr CMoe SHoell CSmith MRasmussen-Torvik LChisholm RMcNally E(2024)From Calculation to Communication: Using Risk Score Calculators to Inform Clinical Decision Making and Facilitate Patient EngagementMedical Decision Making10.1177/0272989X241285036Online publication date: 8-Oct-2024
https://doi.org/10.1177/0272989X241285036
Zhang ZFeger SDullenkopf LLiao RSüsslin LLiu YButz A(2024)Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making ProcessProceedings of the ACM on Human-Computer Interaction10.1145/36870248:CSCW2(1-32)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687024
Zając HRibeiro JIngala SGentile SWanjohi RGitau SCarlsen JNielsen MAndersen T(2024)"It depends": Configuring AI to Improve Clinical Usefulness Across ContextsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660707(874-889)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660707
Evans HRyu MHsieh TZhou JXu KAkers KSherrill AArriaga R(2024)Using Sensor-Captured Patient-Generated Data to Support Clinical Decision-making in PTSD TherapyProceedings of the ACM on Human-Computer Interaction10.1145/36374268:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637426
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten