AMIA Annual Symposium 2014 Year in Review

William Hersh, MD, FACP, FACMI
Joan Ash, PhD, MLS, MBA, FACMI
Department of Medical Informatics & Clinical Epidemiology
Oregon Health & Science University
Portland, OR, USA


This page presents the continuation of the Year in Review series of the AMIA Annual Symposium. The initial eight years of the series were presented by Daniel Masys, MD. Starting with the 2014 symposium, William Hersh, MD and Joan Ash, PhD assumed leadership of the series, and are continuing the tradition of maintaining a Web page for each year's review. The review consists of the most important papers published during the previous year (October 1, 2013 to September 30, 2014) as well as the top 10 events for the field.

We made some modifications to the methods employed by Dr. Masys. Each of us, through our teaching and research activities, spend a great deal of time monitoring the scientific literature of the field. Dr. Ash also reviewed papers nominated for the AMIA Diana Forsythe Award. As in the past, the members of the American College of Medical Informatics were still surveyed for nominations. The ultimate decision for inclusion of papers and events was made by Drs. Hersh and Ash. Clearly picking the "most important" papers from a vibrant and productive field is challenging and a subjective endeavor.

We have provided a mechanism for others to provide additional input. Our session at the AMIA symposium will provide 15-20 minutes for suggestions. Also, as noted below, additional nominations can be sent by email to Bill as described below.

Papers Referenced

This section organizes all papers cited in the order they are presented in the Powerpoint file from the session. More details about each paper are presented in the slides.

Electronic Health Record


Hsiao, CJ, Marsteller, JA, et al. (2014). Electronic medical record features and seven quality of care measures in physician offices. American Journal of Medical Quality. 29: 44-52.

Charles, D, Gabriel, M, et al. (2014). Adoption of Electronic Health Record Systems among U.S. Non-federal Acute Care Hospitals: 2008-2013. Washington, DC, Department of Health and Human Services.

King, J, Patel, V, et al. (2014). Clinical benefits of electronic health record use: national findings. Health Services Research. 49: 392-404.

McDonald, CJ, Callaghan, RM, et al. (2014). Use of internist's free time by ambulatory care electronic medical record systems. JAMA Internal Medicine. Epub ahead of print.

Meaningful Use

Jones, SS, Rudin, RS, et al. (2014). Health information technology: an updated systematic review with a focus on meaningful use. Annals of Internal Medicine. 160: 48-54.

Encinosa, WE and Bae, J (2014). Meaningful Use IT reduces hospital-caused adverse drug events even at challenged hospitals. Healthcare. Epub ahead of print.

Wright, A, Feblowitz, J, et al. (2014). The Medicare Electronic Health Record Incentive Program: provider performance on core and menu measures. Health Services Research. 49: 325-346.

Gabriel, MH, Jones, EB, et al. (2014). Progress and challenges: implementation and use of health information technology among critical-access hospitals. Health Affairs. 33: 1262-1270.

Samal, L, Wright, A, et al. (2014). Meaningful use and quality of care. JAMA Internal Medicine. 174: 997-998.

Heisey-Grove, D, Danehy, LN, et al. (2014). A national study of challenges to electronic health record adoption and meaningful use. Medical Care. 52: 144-148.

Clinical Decision Support

Zhi, M, Ding, EL, et al. (2013). The landscape of inappropriate laboratory testing: a 15-year meta-analysis. PLoS ONE. 8: e78962.

Wolfson, D, Santa, J, et al. (2014). Engaging physicians and consumers in conversations about treatment overuse and waste: a short history of the choosing wisely campaign. Academic Medicine. 89: 990-995.

Litvin, CB, Ornstein, SM, et al. (2013). Use of an electronic health record clinical decision support tool to improve antibiotic prescribing for acute respiratory infections: the ABX-TRIP study. Journal of General Internal Medicine. 28: 810-816.

Scheepers-Hoeks, AM, Grouls, RJ, et al. (2013). Physicians' responses to clinical decision support on an intensive care unit--comparison of four different alerting methods. Artificial Intelligence in Medicine. 59: 33-38.

Galanter, WL, Bryson, ML, et al. (2014). Indication alerts intercept drug name confusion errors during computerized entry of medication orders. PLoS ONE. 9: e101977.

Murphy, DR, Laxmisan, A, et al. (2014). Electronic health record-based triggers to detect potential delays in cancer diagnosis. BMJ Quality & Safety. 23: 8-16.

Dalal, AK, Roy, CL, et al. (2014). Impact of an automated email notification system for results of tests pending at discharge: a cluster-randomized controlled trial. Journal of the American Medical Informatics Association. 21: 473-480.

Pageler, NM, Longhurst, CA, et al. (2014). Use of electronic medical record-enhanced checklist and electronic dashboard to decrease CLABSIs. Pediatrics. 133: e738-e746.

Procop, GW, Yerian, LM, et al. (2014). Duplicate laboratory test reduction using a clinical decision support tool. American Journal of Clinical Pathology. 141: 718-723.


Gerber, JS, Prasad, PA, et al. (2014). Durability of benefits of an outpatient antimicrobial stewardship intervention after discontinuation of audit and feedback. Journal of the American Medical Association. Epub ahead of print.

Barnett, GO, Winickoff, R, et al. (1978). Quality assurance through automated monitoring and concurrent feedback using a computer-based medical information system. Medical Care. 16: 962-970.

Nanji, KC, Slight, SP, et al. (2014). Overrides of medication-related clinical decision support alerts in outpatients. Journal of the American Medical Informatics Association. 21: 487-491.

Spetz, J, Burgess, JF, et al. (2014). The effect of health information technology implementation in Veterans Health Administration hospitals on patient outcomes. Healthcare. 2: 40-47.

Hsiao, CJ, Marsteller, JA, et al. (2014). Electronic medical record features and seven quality of care measures in physician offices. American Journal of Medical Quality. 29: 44-52.

Barkhuysen, P, deGrauw, W, et al. (2014). Is the quality of data in an electronic medical record sufficient for assessing the quality of primary care? Journal of the American Medical Informatics Association. 21: 692-698.


McBride, M (2014). Measuring EHR pain points: High cost, poor functionality outweigh benefits, ease of access. Medical Economics, February 10, 2014.

Verdon, DR (2014). Physician outcry on EHR functionality, cost will shake the health information technology sector. Medical Economics, February 10, 2014.


Epstein, RH, StJacques, P, et al. (2013). Automated identification of drug and food allergies entered using non-standard terminology. Journal of the American Medical Informatics Association. 20: 962-968.

D'Amore, JD, Mandel, JC, et al. (2014). Are Meaningful Use Stage 2 certified EHRs ready for interoperability? Findings from the SMART C-CDA Collaborative. Journal of the American Medical Informatics Association. 21: 1060-1068.

Qualitative and Mixed Methods

O'Cathain, A., Goode, J., Drabble, S. J., Thomas, K. J., Rudolph, A., & Hewison, J. (2014). Getting added value from using qualitative research with randomized controlled trials: A qualitative interview study. Trials, 15, 215-6215-15-215.

Talmon et al. STARE-HI Statement on reporting of evaluation studies in Health Informatics. International Journal of Medical Informatics. 78: 1-9.

Vosbergen, S., Janzen, J., Stappers, P. J., van Zwieten, M. C., Lacroix, J., Idema, K., et al. (2013). A qualitative participatory study to identify experiences of coronary heart disease patients to support the development of online self-management services. International Journal of Medical Informatics, 82(12), 1183-1194.

Greenhalgh, T., Wherton, J., Sugarhood, P., Hinder, S., Procter, R., & Stones, R. (2013). What matters to older people with assisted living needs? A phenomenological analysis of the use and non-use of telehealth and telecare. Social Science & Medicine (1982), 93, 86-94.

Mahmud, A. J., Olander, E., Eriksen, S., & Haglund, B. J. (2013). Health communication in primary health care -a case study of ICT development for health promotion. BMC Medical Informatics and Decision Making, 13, 17-6947-13-17.

Morgan, A. J., & Trauth, E. M. (2013). Socio-economic influences on health information searching in the USA: The case of diabetes. Information Technology and People, 26(4), 324-346.

Walji, M.F., Kalenderian E., Piotrowski M., Tran D., Kookal K.K., Tokede O., et al. (2014). Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR. International Journal of Medical Informatics, 83(5), 361-367.

Devine, M.F., Lee, C.J., et al. (2014). Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach. International Journal of Medical Informatics, 83(7), 473-483.

Turner, A. M., Reeder, B., & Ramey, J. (2013). Scenarios, personas and user stories: User-centered evidence-based design representations of communicable disease investigations. Journal of Biomedical Informatics, 46(4), 575-584.

Grisot, M., & Vassilakopoulou, P. (2013). Infrastructures in healthcare: The interplay between generativity and standardization. International Journal of Medical Informatics, 82(5), e170-9.

Ramanathan, N., Swendeman, D., Comulada, W. S., Estrin, D., & Rotheram-Borus, M. J. (2013). Identifying preferences for mobile health applications for self-monitoring and self-management: Focus group findings from HIV-positive persons and young mothers. International Journal of Medical Informatics, 82(4), e38-46.

Veinot, T. C., Campbell, T. R., Kruger, D. J., & Grodzinski, A. (2013). A question of trust: User-centered design requirements for an informatics intervention to promote the sexual health of African-American youth. Journal of the American Medical Informatics Association, 20(4), 758-765.

Wyatt S, Harris A, Adams S, Kelly SE. (2013). Illness online: Self-reported data and questions of trust in medical and social research. Theory Culture & Society, 30(4), 131-150.

Wentzer, H. S., & Bygholm, A. (2013). Narratives of empowerment and compliance: Studies of communication in online patient support groups. International Journal of Medical Informatics, 82(12), e386-94.

Mort, M., Roberts, C., & Callen, B. (2013). Ageing with telecare: Care or coercion in austerity? Sociology of Health & Illness, 35(6), 799-812.

Das, A., & Svanaes, D. (2013). Human-centred methods in the design of an e-health solution for patients undergoing weight loss treatment. International Journal of Medical Informatics, 82(11), 1075-1091.

Huh, J., Le, T., Reeder, B., Thompson, H. J., & Demiris, G. (2013). Perspectives on wellness self-monitoring tools for older adults. International Journal of Medical Informatics, 82(11), 1092-1103.

Rogers, M. L., Sockolow, P. S., Bowles, K. H., Hand, K. E., & George, J. (2013). Use of a human factors approach to uncover informatics needs of nurses in documentation of care. International Journal of Medical Informatics, 82(11), 1068-1074.

Cresswell, K. M., Slee, A., Coleman, J., Williams, R., Bates, D. W., & Sheikh, A. (2013). Qualitative analysis of round-table discussions on the business case and procurement challenges for hospital electronic prescribing systems. PLoS ONE, 8(11), e79394.

Simon, S. R., Keohane, C. A., Amato, M., Coffey, M., Cadet, B., Zimlichman, E., et al. (2013). Lessons learned from implementation of computerized provider order entry in 5 community hospitals: A qualitative study. BMC Medical Informatics and Decision Making, 13, 67-6947-13-67.

McAlearney, A. S., Sieck, C., Hefner, J., Robbins, J., & Huerta, T. R. (2013). Facilitating ambulatory electronic health record system implementation: Evidence from a qualitative study. BioMed Research International, 2013, 629574.

Novak, L. L., Holden, R. J., Anders, S. H., Hong, J. Y., & Karsh, B. T. (2013). Using a sociotechnical framework to understand adaptations in health IT implementation. International Journal of Medical Informatics, 82(12), e331-44.

Wright, A., Ash, J. S., Erickson, J. L., Wasserman, J., Bunce, A., Stanescu, A., et al. (2014). A qualitative study of the activities performed by people involved in clinical decision support: Recommended practices for success. Journal of the American Medical Informatics Association, 21(3), 464-472.

Meeks, D. W., Takian, A., Sittig, D. F., Singh, H., & Barber, N. (2014). Exploring the sociotechnical intersection of patient safety and electronic health record implementation. Journal of the American Medical Informatics Association, 21(e1), e28-34.

Menon S, Singh H, Meyer AN, Belmont E, Sittig DF. Electronic health record-related safety concerns: A cross-sectional survey. J Healthc Risk Manag. 2014 Jul;34(1):14-26. doi: 10.1002/jhrm.21146

Unertl, K. M., Johnson, K. B., Gadd, C. S., & Lorenzi, N. M. (2013). Bridging organizational divides in health care: An ecological view of health information exchange. Journal of Medical Internet Research, 15(10)

Yu, P., Zhang, Y., Gong, Y., & Zhang, J. (2013). Unintended adverse consequences of introducing electronic health records in residential aged care homes. International Journal of Medical Informatics, 82(9), 772-788.

Alexander, G.L. (2014). Nurse assistant communication strategies about pressure ulcers in nursing homes. Western Journal of Nursing Research, online first 20 October 2014. DOI:10.1177/0193945914555201.

Davis Giardina, T., Menon, S., Parrish, D. E., Sittig, D. F., & Singh, H. (2014). Patient access to medical records and healthcare outcomes: A systematic review. Journal of the American Medical Informatics Association, 21(4), 737-741.

Coiera, E. (2014). Communication spaces. Journal of the American Medical Informatics Association, 21(3), 414-422.

Kane, B., & Luz, S. (2013). "Do no harm": Fortifying MDT collaboration in changing technological times. International Journal of Medical Informatics, 82(7), 613-625.

Petersen, L. S., Bertelsen, P., & Bjornes, C. (2013). Cooperation and communication challenges in small-scale eHealth development projects. International Journal of Medical Informatics, 82(12), e375-85.

Mattarelli, E., Bertolotti, F., & MacRì, D. M. (2013). The use of ethnography and grounded theory in the development of a management information system. European Journal of Information Systems, 22(1), 26-44.

Keenan, G., Yakel, E., Dunn Lopez, K., Tschannen, D., & Ford, Y. B. (2013). Challenges to nurses' efforts of retrieving, documenting, and communicating patient care information. Journal of the American Medical Informatics Association, 20(2), 245-251.

Mentis, H. M., Reddy, M., & Rosson, M. B. (2013). Concealment of emotion in an emergency room: Expanding design for emotion awareness. Computer Supported Cooperative Work, 22(1), 33-63.

Sheehan, B., Nigrovic, L. E., Dayan, P. S., Kuppermann, N., Ballard, D. W., Alessandrini, E., et al. (2013). Informing the design of clinical decision support services for evaluation of children with minor blunt head trauma in the emergency department: A sociotechnical analysis. Journal of Biomedical Informatics, 46(5), 905-913.

Informatics Beyond the EHR

Personal Health Records

Vodicka, E, Mejilla, R, et al. (2013). Online access to doctors' notes: patient concerns about privacy. Journal of Medical Internet Research. 15(9): e208.

Turvey, C, Klein, D, et al. (2014). Blue Button use by patients to access and share health record information using the Department of Veterans Affairs' online patient portal. Journal of the American Medical Informatics Association. 21: 657-663.

Chrischilles, EA, Hourcade, JP, et al. (2013). Personal health records: a randomized trial of effects on elder medication safety. Journal of the American Medical Informatics Association. 21: 679-686.

Nundy, S, Dick, JJ, et al. (2014). Mobile phone diabetes project led to improved glycemic control and net savings for Chicago plan participants. Health Affairs. 33: 265-272.

Tom, JO, Chen, C, et al. (2014). Personal health record use and association with immunizations and well-child care visits recommendations. Journal of Pediatrics. 164: 112-117.

Prey, JE, Woollen, J, et al. (2014). Patient engagement in the inpatient setting: a systematic review. Journal of the American Medical Informatics Association. 21: 742-750.

Sarkar, U, Lyles, CR, et al. (2014). Use of the refill function through an online patient portal is associated with improved adherence to statins in an integrated health system. Medical Care. 52: 194-201.

Big Data and Analytics

Tran, T, Luo, W, et al. (2014). Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry. 14: 76.

Ferry, Q, Steinberg, J, et al. (2014). Diagnostically relevant facial gestalt information from ordinary photos. eLife. 3: e02020.

Olson, CH, Dierich, M, et al. (2014). Automation of a high risk medication regime algorithm in a home health care population. Journal of Biomedical Informatics. 51: 60-71.

Amarasingham, R, Patel, PC, et al. (2013). Allocating scarce resources in real-time to reduce heart failure readmissions: a prospective, controlled study. BMJ Quality & Safety. 22: 998-1005.

Lazer, D, Kennedy, R, et al. (2014). Big data. The parable of Google Flu: traps in big data analysis. Science. 343: 1203-1205.

Weng, C, Li, Y, et al. (2014). A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records. Applied Clinical Informatics. 5: 463-479.

Walsh, C and Hripcsak, G (2014). The effects of data sources, cohort selection, and outcome definition on a predictive model of risk of thirty-day hospital readmissions. Journal of Biomedical Informatics: Epub ahead of print.


Agaku, IT, Adisa, AO, et al. (2014). Concern about security and privacy, and perceived control over collection and use of health information are related to withholding of health information from healthcare providers. Journal of the American Medical Informatics Association. 21: 374-378.

Rogith, D, Yusuf, RA, et al. (2014). Attitudes regarding privacy of genomic information in personalized cancer therapy. Journal of the American Medical Informatics Association. 21(e2): e320-e325.

Bobicev, V, Sokolova, M, et al. (2013). Can anonymous posters on medical forums be reidentified? Journal of Medical Internet Research. 15(10): e215.

Information Retrieval

Del Fiol, G, Workman, TE, et al. (2014). Clinical questions raised by clinicians at the point of care: a systematic review. JAMA Internal Medicine. 174: 710-718.

Kim, S, Noveck, H, et al. (2014). Searching for answers to clinical questions using Google versus evidence-based summary resources: a randomized controlled crossover study. Academic Medicine. 89: 940-943.

Becker, JE, Krumholz, HM, et al. (2014). Reporting of results in and high-impact journals. Journal of the American Medical Association. 311: 1063-1065.

Hasty, RT, Garbalosa, RC, et al. (2014). Wikipedia vs peer-reviewed medical literature for information about the 10 most costly medical conditions. Journal of the American Osteopathic Association. 114: 368-373.

Spasić, I, Livsey, J, et al. (2014). Text mining of cancer-related information: review of current status and future directions. International Journal of Medical Informatics. 83: 605-623.

Spangler, S, Wilkins, AD, et al. (2014). Automated hypothesis generation based on mining scientific literature. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM Press. 1877-1886.

He, Z, Ochs, C, et al. (2013). A family-based framework for supporting quality assurance of biomedical ontologies in BioPortal. AMIA Annual Symposium Proceedings, Washington, DC. 581-590.

Health Information Exchange

Adler-Milstein, J and Jha, AK (2014). Health information exchange among U.S. hospitals: who's in, who's out, and why? Healthcare. 2: 26-32.

Furukawa, MF, King, J, et al. (2014). Despite substantial progress in EHR adoption, health information exchange and patient engagement remain low in office settings. Health Affairs. 33: 1672-1679.

Ross, SE, Radcliff, TA, et al. (2013). Effects of health information exchange adoption on ambulatory testing rates. Journal of the American Medical Informatics Association. 20: 1137-1142.

Vest, JR, Kern, LM, et al. (2014). Association between use of a health information exchange system and hospital admissions. Applied Clinical Informatics. 5: 219-231.

Winden, TJ, Boland, LL, et al. (2014). Care Everywhere, a point-to-point HIE tool: utilization and impact on patient care in the ED. Applied Clinical Informatics. 5: 388-401.


Bernocchi, P, Scalvini, S, et al. (2014). Home based telemedicine intervention for patients with uncontrolled hypertension--a real life non-randomized study. BMC Medical Informatics & Decision Making. 14: 52.

Bashshur, RL, Shannon, GW, et al. (2014). The empirical foundations of telemedicine interventions for chronic disease management. Telemedicine and e-Health. 20: 769-800.

Health IT Implementation

Low, AF, Phillips, AB, et al. (2013). Financial effects of health information technology: a systematic review. American Journal of Managed Care. 19(10 Spec No): SP369-SP376.

Ingebrigtsen, T, Georgiou, A, et al. (2014). The impact of clinical leadership on health information technology adoption: systematic review. International Journal of Medical Informatics. 83: 393-405.

Health IT Workforce

Schwartz, A, Magoulas, R, et al. (2013). Tracking labor demand with online job postings: the case of health IT workers and the HITECH Act. Industrial Relations: A Journal of Economy and Society. 52: 941–968.

Anonymous (2014). 2014 Salary Report.


Detmer, DE and Shortliffe, EH (2014). Clinical informatics: prospects for a new medical subspecialty. Journal of the American Medical Association. 311: 2067-2068.

Freeman, S, Eddy, SL, et al. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences. 111: 8410-8415.

Hollands, FM and Tirthali, D (2014). MOOCs: Expectations and Reality. New York, NY, Columbia University Teacher's College.

Hersh, WR, Gorman, PN, et al. (2014). Beyond information retrieval and EHR use: competencies in clinical informatics for medical education. Advances in Medical Education and Practice. 5: 205-212.

Röhrig, R, Stausberg, J, et al. (2013). Development of national competency-based learning objectives "Medical Informatics" for undergraduate medical education. Methods of Information in Medicine. 52: 184-188.

Top 10 Events

10. Federation of State Medical Boards telemedicine licensing template

9. ICD-10 delay – third time in four years

8. Reproducibility of research

7. SAFER Guides – for safer EHR implementation

6. Big Data/Data Analytics – Health Affairs issue, NIH Big Data to Knowledge (BD2K) funding

5. Fast Health Interoperability Standard (FHIR) – achieving the goals for interoperability?

4. ONC meaningful use – delays and difficulties with Stage 2

3. PCORI Clinical Data Research Network (CDRN)/Patient-Powered Research Network (PPRN) funding – JAMIA issue

2. ONC interoperability roadmap and JASON Report and Task Force Report

1. Clinical informatics certification – board exam, ACGME accreditation rules, AMIA AIIC task force

What Did We Miss?

Email for possible inclusion on this page.

Last updated - November 15, 2014