Showing posts with label healthcare IT safety. Show all posts
Showing posts with label healthcare IT safety. Show all posts

Tuesday, October 8, 2013

Quality and Safety Implications of Emergency Department Information Systems: ED EHR Systems Pose Serious Concerns, Report Says

A report "Quality and Safety Implications of Emergency Department Information Systems"
appeared in the Oct. 2013 issue of "Annals of Emergency Medicine."  It is available fulltext at http://www.annemergmed.com/article/S0196-0644%2813%2900506-4/fulltext, or in PDF via the tab, free as of this writing.

First, a preamble:  I once tried to alert a hospital where I'd trained decades before, Abington Memorial Hospital (http://www.amh.org/), of impediments to safe care I'd noted in their EHR's, predominantly their ED EHR.  They did not listen.  In fact, their response to my concerns was characterized by an apparent incompetence regarding conduct of safety investigations.  For instance, to my written concern in an April 2010 letter to the CEO and CMO about the ED EHR that:

... I've also had to stop administration [to my mother] of an antibiotic (Levaquin) in the recent past in the ED that she has had an adverse reaction to (torn rotator cuff), despite my having told ED intake she was allergic to it. She relates that administration of Levaquin was then almost repeated on the floor until she herself refused it during that past admission.

This was the sworn testimony in May 2013 about the "investigation" that resulted, from the hospital's VP of Risk Management, Regina Sturgis:

A:      Deborah [hospital General Counsel] asked me to investigate the Levaquin issue which I did.
Q:      Did you do that on your own or did you delegate some of the --
A:      No.  I did it on my own.
Q:      Do you know whether any of the IT folks were ever brought in to look at the -- the EMR issues referenced in this letter?
A:     No, I do not.  I know that I was asked to look at the Levaquin because of my clinical background.
Q:      Okay.  Did you come up with any conclusions?
A:      Yes.
Q:      What was your conclusion?
A:      That she had been ordered Levaquin in the ETC [Emergency Trauma Center a.k.a. ED], that it had been discontinued about a very short period of time later, under a half an hour, and that she never received it.

So, the investigation of a complaint that family and then the patient themselves had to stop the administration of a drug whose staff and EHR had been informed of an allergy consisted of confirming that the medication was never given.  No problem, the ED EHR is safe.

(I am not joking; that is the testimony given.  Imagine such an investigation and conclusion about, say, reported aircraft flaws, or, in the industry in which I was once a safety officer, public transit vehicle defects and dangers.)

However, when competent people investigate similar issues, the findings are concerning.  From Modern Healthcare (http://www.modernhealthcare.com/), a publication for healthcare executives, on the new Annals of Emergency Medicine article:

ED EHR systems pose serious concerns, report says

By Joseph Conn
Modern Healthcare

June 24, 2013
Electronic health-record systems used in emergency departments are beset with poor data displays, loaded with so many alerts warning of potential patient-safety issues that they can lead to user alert fatigue, and may be generating incorrect physician orders, according to a report by two emergency physicians' study groups.

Meanwhile, providers wanting to address these EHR issues are hampered by a lack of research and solid evidence of the extent of the problem with these systems, and by contract provisions with EHR vendors that stymie the free flow of information about system-linked safety concerns, the report authors say.

So, ED's across the country are rolling out technology, often taking advantage of ARRA's HITECH incentives ... but there is a lack of research and solid evidence into the risks.  Allow me to opine - that's simply crazy.

The groups found that “poor data display is a serious problem with many of today's EDISs,” while “the sheer volume” of alerts that range from the “completely irrelevant to life threatening” [or lack of appropriate alerts to relevant, simple issues such as data input errors - ed.] can “dull the senses, leading to a failure to react to a truly important warning.” They also found that “an alarming number of clinicians are anecdotally reporting a substantial increase in the incidence of wrong order/wrong patient errors while using the computerized physician order entry component of information systems.

The word "anecdote", as I have written, is being misused.  The reports are not "anecdotes."  They are risk management-relevant incident reports.  (See "From a Senior Clinician Down Under: Anecdotes and Medicine, We are Actually Talking About Two Different Things" at http://hcrenewal.blogspot.com/2011/08/from-senior-clinician-down-under.html.)

Two study groups from the American College of Emergency Physicians have recommended a program of systemic vigilance over electronic health-record systems used in emergency departments to improve patient safety and enhance quality of care.

ACEP workgroups on informatics and on quality improvement and patient safety published their findings in an article, “Quality and Safety Implications of Emergency Department Information Systems,” in the current issue of the Annals of Emergency Medicine.

Post marketing surveillance, a standard for decades in other healthcare sectors, has been absent from health IT due to a long-obsolete special regulatory accommodation afforded that industry.  This accommodation was initiated when systems were simple and merely advisory - not the comprehensive enterprise clinical resource and clinician command-and-control systems they are today.  Now, clinician investigators of the technology such as the authors of this study are realizing that continuing this accommodation is a mistake.

It follows in the wake of, and references, an Institute of Medicine report from 2011, “Health IT and Patient Safety: Building Safer Systems for Better Care.” That report concluded that “current market forces are not adequately addressing the potential risks associated with the use of health IT.” It also comes eight months after the New England Journal of Medicine published “Electronic Health Records and National Patient-Safety Goals,” which warned that recent evidence “has highlighted substantial and often unexpected risks resulting from the use of EHRs and other forms of health information technology.”

I note that if you frequent this blog, you likely read material similar to the bolded red statements above here first, as authored by me, dating to the founding of this blog in 2004.

... “The rush to capitalize on the huge federal investment of $30 billion for the adoption of electronic medical records led to some unfortunate and unintended consequences, particularly in the unique emergency department environment,” said Dr. Heather L. Farley, the lead author of the report, in a news release. “The irreversible drive toward EDIS implementation should be accompanied by a constant focus on improvement and hazard prevention." Farley is assistant chairwoman of the Department of Emergency Medicine at Christiana Care Health System in Newark, Del.

Ironically, I note in Dr. Farley's statement some of my own advice, given to ED staff when I was Chief Medical Informatics Officer at Christiana Care 1996-8.   I had in that time period advised Charles Reese IV, MD, Chair of Emergency Medicine, to not implement EHRs or, at best, implement document imaging systems (since ED charts are not that long or complex), not full field-based EHRs, due to the "unfortunate and unintended consequences" of bad health IT in such an environment I recognized even then.  It was only a few years ago that my advice was finally overturned.

The authors also report “(t)here are few consistent data on how commonly these errors occur, and few studies are actually focused on collecting evidence of these errors.” Meanwhile, “there is currently no mechanism in place to systematically allow, let alone encourage, users to provide feedback about ongoing safety issues or concerns” with EHRs in general, and EDISs specifically.

On its face, that is not a safety-conscious environment and the rollout and use of such systems seems a fundamental violation of patient's rights, made worse by the fact that there is no informed consent process whatsoever to ED EHR use.

The workgroups came up with seven recommendations: appointing an emergency department “clinician champion,” creating within healthcare delivery organizations an EDIS performance improvement group and an ongoing review process, paying timely attention to EDIS-related patient-safety issues raised by the review process, disseminating to the public lessons learned from performance improvement efforts, distributing vendors' product updates in a timely manner to all EDIS users and removing the “hold harmless” and “learned intermediary clauses” from vendor contracts.

Many of these issues have been discussed on this blog.

“The learned intermediary doctrine implies that the end users (clinicians) are the medical experts and should be able to detect and overcome any fallibility or contributing factor of the product,” the authors said.

I have also pointed out the absurdity of such a "doctors are clairvoyant" attitude, e.g., at my 2011 post on basic common sense on IT adverse consequences at http://hcrenewal.blogspot.com/2011/04/common-sense-on-side-effects-lacking-in.html.

They conclude that the “lack of accountability for vendors through hold harmless clauses and the shifting of liability to the clinicians through the learned intermediary doctrine are significant and additional impairments to safety improvement. Electronic health records and EDISs are sufficiently complex that the physician and other users cannot be expected to anticipate unpredictable errors.”

That aligns with the work of Dr. Jon Patrick in Sydney, whose treatise "A study of an Enterprise Health information System" on the Cerner FirstNet ED EHR is available here: http://sydney.edu.au/engineering/it/~hitru/index.php?option=com_content&task=view&id=91&Itemid=146

Earlier this month, the Electronic Health Record Association, an EHR developers trade group affiliated with the Chicago-based Healthcare Information and Management Systems Society, announced the launch of a voluntary “code of conduct in which adherents would agree to drop “gag clauses” in the contracts with their provider customers.

Great.  Per the wonderful 2007 article "The Denialists' Deck of Cards: An Illustrated Taxonomy of Rhetoric Used to Frustrate Consumer Protection Efforts" by Chris Jay Hoofnagle, available at http://papers.ssrn.com/sol3/papers.cfm?abstract_id=962462, as of this writing free:

... At this point [of losing the argument], the denialist must propose "self regulation" to deal with the problem that doesn't exist. The cool thing about self regulation is that it cannot be enforced, and once the non-existent problem blows over, the denialist can simply scrap it! [20]

[20] In the runup to passage of bank privacy legislation, data brokers created a group called the "Individual Reference Services Group" that promptly disappeared after the legislation passed.

("Denialism" is the use of rhetorical techniques and predictable tactics to erect barriers to debate and consideration of any type of reform, regardless of the facts.)

IMO 'self regulation' of healthcare is, on its face, a deception.  There are simply too many conflicts of interest.

On use of "integrated" big systems:

“These systems do have glitches [indeed - see http://hcrenewal.blogspot.com/search/label/glitch - ed], but it can be plain and simple bad design that can lead to clinical errors,” Cozzens said.  But ED physicians, he said, are “having the enterprise systems forced upon them. To think you can take one system and adapt it to those different environments is totally wrong. That's why you see low physician satisfaction and the productivity is going down, all for the sacrifice of having an integrated system.”

In fact, so-called "best of breed" systems can be bad health IT as well.  See the aforementioned evaluation by Dr. Patrick in Australia.

Bad Health IT ("BHIT") is defined as IT that is ill-suited to purpose, hard to use, hard to customize, unreliable, loses data or provides incorrect data, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security, compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation. 


Through my own work, I've seen bad health IT result in patient harm and death.  It's just unfortunate that I got started in this line of work by being, in effect, shot out of a cannon.  That is, my own mother was a victim.

-- SS

Addendum 10/8/13:

From the article:

End-User Recommendation 4: EDIS-related patient safety concerns identified by the review process should be addressed in a timely manner by ED providers, the EDIS vendors, and hospital administration. Each of these processes should be performed in full transparency, specifically with openness, communication, and accountability. 

I'm not sure the aforementioned levaquin near-accident "investigation" meets these standards.

-- SS

Friday, May 17, 2013

American Medical Association finally on board with EHR views expressed on this blog since 2004

- Posted on the Healthcare Renewal Blog May 17, 2013 -

It seems to have taken awhile, but organized medicine seems to finally be recognizing that today's commercial health IT is not quite the revolutionizing, transformative, plug-and-play panacea to healthcare's ills it is often touted as:

AMA Wire
May 15, 2013
AMA board chair: HHS should address EHR usability issues immediately

The government needs to act quickly to remedy the impaired usability of electronic health records (EHR) if the technology's touted benefits are to be realized, AMA Board of Trustees Chair Steven J. Stack, MD (left), told officials during a federal hearing last week.

"The AMA and most physicians believe that, done well, EHRs have the potential to improve patient care," Dr. Stack, an emergency physician in Lexington, Ky., said during his 30-minute testimony. "At present, however, these EHRs present substantial challenges to the physicians and other clinicians now required to use them."

He emphasized that many of today's EHR systems require significant changes before they can deliver the promised outcomes. Referring to Medicare's meaningful use program, he pointed to undesired consequences of pushing EHR systems on physicians before the technology was completely ready for prime time.

"Immediately" is strong language.

I note that the phrase "health IT done well" is a term I've been using since 1998 at my now-Drexel-based health IT teaching website at http://www.ischool.drexel.edu/faculty/ssilverstein/cases, as well as at this blog.

Penned by me at my aforementioned Drexel graduate teaching site, originally housed on AOL, in 1998 and still appearing in its main essay:

... While clinical IT is now potentially capable of achieving many of the benefits long claimed for it such as improved medical quality and efficiency, reduced costs, better medical research and drugs, earlier disease detection, and so forth, there is a major caveat and essential precondition:  the benefits will be realized only if clinical IT is done well.  For if clinical IT is not done well, as often occurs in today’s environment of medical quick fixes and seemingly unquestioning exuberance about IT, the technology can be injurious to medical practice and biomedical R&D, and highly wasteful of scarce healthcare capital and resources. 

Those two short words “done well” mask an underlying, profound, and, as yet, largely unrecognized (or ignored) complexity.  This website is about the meaning of "done well" in the context of clinical computing, a computing subspecialty with issues and required expertise quite distinct from traditional MIS (management information systems, or business-related) computing.

(I have more recently switched to the easier-to-parse terminology of "good health IT" vs. "bad health IT" after discussions with Dr Jon Patrick at U. Sydney during my visit Down Under last summer, http://hcrenewal.blogspot.com/2012/08/my-presentation-to-health-informatics.html.)

I've also heard "not ready for prime time" before.  It is a phrase I used in speaking with a New York Times reporter that then appeared in the Oct. 8, 2012 NYT article "The Ups and Downs of Electronic Medical Records" (http://www.nytimes.com/2012/10/09/health/the-ups-and-downs-of-electronic-medical-records-the-digital-doctor.html?pagewanted=2) by Milt Freudenheim, October 8, 2012, where I am quoted and this blog cited:

... Critics are deeply skeptical that electronic records are ready for prime time. “The technology is being pushed, with no good scientific basis,” said Dr. Scot M. Silverstein, a health I.T. expert at Drexel University who reports on medical records problems on the blog Health Care Renewal. He says testing these systems on patients without their consent “raises ethical questions.”

The AMA Board chair went on to opine:

"Attempting to transform the entire health system in such a rapid and proscriptive manner has compelled providers to purchase tools not yet optimized to the end-user's needs and that often impeded, rather than enable, efficient clinical care," he said.

He noted that physicians are "prolific technology adopters" but that adoption of EHR systems has required federal incentives because the technology still is "at an immature stage of development."

My near-exact terminology has been that the technology is still experimental.

"EHRs have been and largely remain clunky, confusing and complex," he said.

Perhaps he read my ten-part series on the health IT mission hostile user experience at this blog, at http://www.tinyurl.com/hostileuserexper.

According to a recent survey by AmericanEHR Partners, physician dissatisfaction with EHR systems has increased. Nearly one-third of those surveyed in 2012 said they were "very dissatisfied" with their system, and 39 percent said they would not recommend their EHR system to a colleague—up from 24 percent in 2010.

A survey I posted about in Jan. 2010 is here:  "An Honest Physician Survey on EHR's", http://hcrenewal.blogspot.com/2010/01/honest-physician-survey-on-ehrs.html

Dr. Stack spoke at a "listening session" hosted by the Centers for Medicare & Medicaid Services (CMS) and the Office of the National Coordinator for Health Information Technology (ONC), a division of the U.S. Department of Health and Human Services (HHS). The agencies coordinated the session to examine how a marked increase in code levels billed for some Medicare services might be tied to the increased use of EHRs.

Dr. Stack noted that some Medicare carriers have begun denying payment for charts that are too similar to other records.

"In this instance, even when clinicians are appropriately using the EHR, a tool with which they are frustrated and the use of which the federal government has mandated under threat of financial penalty, they are now being accused of inappropriate behavior, being economically penalized, and being instructed ‘de facto' to re‐engineer non‐value‐added variation into their clinical notes," he said. "This is an appalling Catch‐22 for physicians."

"Mandated under threat of financial penalty" has been one of my stated "cart before the horse" issues with HITECH (e.g., http://hcrenewal.blogspot.com/2010/10/cart-before-horse-again-institute-of.html).

Dr. Stack advised officials that three key actions are necessary to rectify these issues with EHR systems:
  • The ONC promptly should address EHR usability concerns raised by physicians and add usability criteria to the EHR certification process.
  • CMS should provide clear and direct guidance to physicians concerning use of EHRs for documentation, coding and billing.
  • Stage 2 of the meaningful use program should allow more flexibility for physicians to meet requirements as EHR systems are improved.
The AMA will continue to work with federal agencies to improve EHR systems and the Medicare meaningful use program.

I've been calling for usability evaluation to be added to the certification process, including in comments during public comment periods to HHS, for some time.

What the AMA Board Chair is apparently missing, though, is health IT safety.  They should perhaps read my post on the recent ECRI Institute Deep Dive Study on health IT risk - itself based on a report in their own AMNews (amednews.com) publication ("Peering Underneath the Iceberg's Water Level: AMNews on the New ECRI Deep Dive Study of Health IT Events", http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html).

I don't think any prudent person would consider a 9-week study of 36 hospitals with volunteered reports of 171 health information technology-related problems, where eight of the incidents reported involved patient harm and three may have contributed to patient deaths, information to ignore.

-- SS