Prevalence of Behavioral Flags in the Electronic Health Record Among Black and White Patients Visiting the Emergency Department

Importance: Behavioral flags in the electronic health record (EHR) are designed to alert clinicians of potentially unsafe or aggressive patients. These flags may introduce bias, and understanding how they are used is important to ensure equitable care.

Objective: To investigate the incidence of behavioral flags and assess whether there were differences between Black and White patients and whether the flags were associated with differences in emergency department (ED) clinical care.

Design, setting, and participants: This was a retrospective cohort study of EHR data of adult patients (aged ≥18 years) from 3 Philadelphia, Pennsylvania, EDs within a single health system between January 1, 2017, and December 31, 2019. Secondary analyses excluded patients with sickle cell disease and high ED care utilization. Data were analyzed from February 1 to April 4, 2022.

Main outcomes and measures: The primary outcome of interest was the presence of an EHR behavioral flag. Secondary measures included variation of flags across sex, race, age, insurance status, triage status, ED clinical care metrics (eg, laboratory, medication, and radiology orders), ED disposition (discharge, admission, or observation), and length of key intervals during ED care.

Results: Participating EDs had 195 601 eligible patients (110 890 [56.7%] female patients; 113 638 Black patients [58.1%]; 81 963 White patients [41.9%]; median [IQR] age, 42 [28-60] years), with 426 858 ED visits. Among these, 683 patients (0.3%) had a behavioral flag notification in the EHR (3.5 flags per 1000 patients), and it was present for 6851 ED visits (16 flagged visits per 1000 visits). Patient differences between those with a flag and those without included male sex (56.1% vs 43.3%), Black race (71.2% vs 56.7%), and insurance status, particularly Medicaid insurance (74.5% vs 36.3%). Flag use varied across sites. Black patients received flags at a rate of 4.0 per 1000 patients, and White patients received flags at a rate of 2.4 per 1000 patients (P < .001). Among patients with a flag, Black patients, compared with White patients, had longer waiting times to be placed in a room (median [IQR] time, 28.0 [10.5-89.4] minutes vs 18.2 [7.2-75.1] minutes; P < .001), longer waiting times to see a clinician (median [IQR] time, 42.1 [18.8-105.5] minutes vs 33.3 [15.3-84.5] minutes; P < .001), and shorter lengths of stay (median [IQR] time, 274 [135-471] minutes vs 305 [154-491] minutes; P = .01). Black patients with a flag underwent fewer laboratory (eg, 2449 Black patients with 0 orders [43.4%] vs 441 White patients with 0 orders [36.7%]; P < .001) and imaging (eg, 3541 Black patients with no imaging [62.7%] vs 675 White patients with no imaging [56.2%]; P < .001) tests compared with White patients with a flag.

Conclusions and relevance: This cohort study found significant differences in ED clinical care metrics, including that flagged patients had longer wait times and were less likely to undergo laboratory testing and imaging, which was amplified in Black patients.

Conflict of interest statement

Conflict of Interest Disclosures: None reported.

Similar articles

Haimovich AD, Taylor RA, Chang-Sing E, Brashear T, Cramer LD, Lopez K, Wong AH. Haimovich AD, et al. Ann Emerg Med. 2024 Feb;83(2):100-107. doi: 10.1016/j.annemergmed.2023.04.004. Epub 2023 Jun 2. Ann Emerg Med. 2024. PMID: 37269262

Seeburger EF, Gonzales R, South EC, Friedman AB, Agarwal AK. Seeburger EF, et al. JAMA Netw Open. 2023 Apr 3;6(4):e239057. doi: 10.1001/jamanetworkopen.2023.9057. JAMA Netw Open. 2023. PMID: 37079303 Free PMC article.

Fee C, Burstin H, Maselli JH, Hsia RY. Fee C, et al. JAMA. 2012 Feb 1;307(5):476-82. doi: 10.1001/jama.2012.41. JAMA. 2012. PMID: 22298679 Free PMC article.

Dameff C, Tully J, Chan TC, Castillo EM, Savage S, Maysent P, Hemmen TM, Clay BJ, Longhurst CA. Dameff C, et al. JAMA Netw Open. 2023 May 1;6(5):e2312270. doi: 10.1001/jamanetworkopen.2023.12270. JAMA Netw Open. 2023. PMID: 37155166 Free PMC article.

Arbogast KB, Curry AE, Pfeiffer MR, Zonfrillo MR, Haarbauer-Krupa J, Breiding MJ, Coronado VG, Master CL. Arbogast KB, et al. JAMA Pediatr. 2016 Jul 5;170(7):e160294. doi: 10.1001/jamapediatrics.2016.0294. Epub 2016 Jul 5. JAMA Pediatr. 2016. PMID: 27244368 Free PMC article.

Cited by

Agboola IK, Rosenberg A, Robinson L, Brashear TK, Eixenberger C, Shah D, Pavlo AJ, Im DD, Ray JM, Coupet E Jr, Wong AH. Agboola IK, et al. Ann Emerg Med. 2024 Feb;83(2):108-119. doi: 10.1016/j.annemergmed.2023.09.014. Epub 2023 Oct 19. Ann Emerg Med. 2024. PMID: 37855791

Sangal RB, Su H, Khidir H, Parwani V, Liebhardt B, Pinker EJ, Meng L, Venkatesh AK, Ulrich A. Sangal RB, et al. JAMA Netw Open. 2023 Jul 3;6(7):e2326338. doi: 10.1001/jamanetworkopen.2023.26338. JAMA Netw Open. 2023. PMID: 37505495 Free PMC article.

Haimovich AD, Taylor RA, Chang-Sing E, Brashear T, Cramer LD, Lopez K, Wong AH. Haimovich AD, et al. Ann Emerg Med. 2024 Feb;83(2):100-107. doi: 10.1016/j.annemergmed.2023.04.004. Epub 2023 Jun 2. Ann Emerg Med. 2024. PMID: 37269262

Seeburger EF, Gonzales R, South EC, Friedman AB, Agarwal AK. Seeburger EF, et al. JAMA Netw Open. 2023 Apr 3;6(4):e239057. doi: 10.1001/jamanetworkopen.2023.9057. JAMA Netw Open. 2023. PMID: 37079303 Free PMC article.

References

    1. Hinton E, Cook D. The mass criminalization of Black Americans: a historical overview. Annu Rev Criminol. 2021;4(1):261-286. doi:10.1146/annurev-criminol-060520-033306 - DOI
    1. Engel-Rebitzer E, Dolan AR, Aronowitz SV, et al. . Patient preference and risk assessment in opioid prescribing disparities: a secondary analysis of a randomized clinical trial. JAMA Netw Open. 2021;4(7):e2118801. doi:10.1001/jamanetworkopen.2021.18801 - DOI - PMC - PubMed
    1. Lee P, Le Saux M, Siegel R, et al. . Racial and ethnic disparities in the management of acute pain in US emergency departments: meta-analysis and systematic review. Am J Emerg Med. 2019;37(9):1770-1777. doi:10.1016/j.ajem.2019.06.014 - DOI - PubMed
    1. Aronowitz SV, Mcdonald CC, Stevens RC, Richmond TS. Mixed studies review of factors influencing receipt of pain treatment by injured Black patients. J Adv Nurs. 2020;76(1):34-46. doi:10.1111/jan.14215 - DOI - PubMed
    1. Violence in emergency departments is increasing, harming patients, new research finds. News release. EmergencyPhysicians.org. October 2, 2018. Accessed January 20, 2022. https://www.emergencyphysicians.org/press-releases/2018/10-2-2018-violen.