Showing posts with label ONC. Show all posts
Showing posts with label ONC. Show all posts

Monday, September 16, 2013

An Open Letter to David Bates, MD, Chair, ONC FDASIA Health IT Policy Committee on Recommendations Against Premarket Testing and Validation of Health IT

From http://www.healthit.gov/policy-researchers-implementers/federal-advisory-committees-facas/fdasia:

The Food and Drug Administration Safety Innovation Act (FDASIA) Health IT Policy Committee Workgroup is charged with providing expert input on issues and concepts identified by the Food and Drug Administration (FDA), Office of the National Coordinator for Health IT (ONC), and the Federal Communications Commission (FCC) to inform the development of a report on an appropriate, risk-based regulatory framework pertaining to health information technology including mobile medical applications that promotes innovation, protects patient safety, and avoids regulatory duplication.

My Open Letter to the Committee's chair speaks for itself:

From: Scot Silverstein
Date: Mon, Sep 16, 2013 at 9:39 AM
Subject: ONC FDASIA Health IT Policy Committee's recommendations on Premarket Surveillance
To: David Bates

Sept. 16, 2013

David Bates, Chair, ONC FDASIA Health IT Policy Committee
via email
   
Dear David,

I am disappointed (and in fact appalled) at the ONC FDASIA Health IT Policy Committee's recommendations that health IT including typical commercial EHR/CPOE systems not be subjected to a premarket testing and validation process.  I believe this recommendation is, quite frankly, negligent. [1]

As you know, my own mother was injured and then died as a result of EHR deficiencies, and nearly injured or killed again in the recuperation period from her initial injuries by more health IT problems in a second EHR used in her care.  In my legal consulting and from my colleagues, as well as from the literature, I hear about other injuries/deaths and many "near misses" as well.  That your recommendations came in the face of the recent ECRI Deep Dive study is even more appalling, with the latter's finding of 171 health IT-related incidents in 9 weeks from 36 member PSO hospitals, resulting in 8 injuries and 3 possible deaths, all reported voluntarily. [2]

It is my expert opinion the issues that cause these outcomes would never have made it into production systems, had a reasonable, competent, unbiased premarket testing and validation process been in place.

Consequently, I have shared the FDASIA HIT Policy Committee's recommendations with the Plaintiff's Bar, and will use its recommendations in my presentations to various chapters of the American Association for Justice (the trial lawyer's association) - as well as to interested Defense attorneys so they may advise their clients accordingly.

I am also making recommendations that in any torts, individual or class, regarding EHR problems that would likely have been averted with competent premarket testing and validation, that the FDASIA HIT Policy Committee members who agreed with the recommendation be considered possible defendants.

I am sorry it has come to this.

Please note I am also posting this message for public viewing at the Healthcare Renewal weblog of the Foundation for Integrity and Responsibility in Medicine (FIRM).

Sincerely,

Scot Silverstein, MD
Consultant/Independent Expert Witness in Healthcare Informatics
Adjunct Faculty, Drexel University, College of Computing and Informatics

Notes:


[1] FDA Law Blog, Recommendations of FDASIA Health IT Workgroup Accepted, September 11, 2013, available at http://www.fdalawblog.net/fda_law_blog_hyman_phelps/2013/09/recommendations-of-fdasia-health-it-workgroup-accepted.html: "Of particular interest is the recommendation that health IT should generally not be subject to FDA premarket requirements, with a few exceptions:  medical device accessories, high-risk clinical decision support, and higher risk software use cases."

[2] "Peering Underneath the Iceberg's Water Level: AMNews on the New ECRI 'Deep Dive' Study of Health IT Events" , Feb. 28. 2013, available at http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html.

-----------------------------------------------

Note: the following are listed on the linked site above as members of the committee:

Member List
  • David Bates, Chair, Brigham and Women’s Hospital
  • Patricia Brennan, University of Wisconsin-Madison
  • Geoff Clapp, Better
  • Todd Cooper, Breakthrough Solutions Foundry, Inc.
  • Meghan Dierks, Harvard Medical Faculty, Division of Clinical Informatics
  • Esther Dyson, EDventure Holdings
  • Richard Eaton, Medical Imaging & Technology Alliance
  • Anura Fernando, Underwriters Laboratories
  • Lauren Fifield, Practice Fusion, Inc.
  • Michael Flis, Roche Diagnostics
  • Elisabeth George, Philips Healthcare
  • Julian Goldman, Massachusetts General Hospital/ Partners Healthcare
  • T. Drew Hickerson, Happtique, Inc.
  • Jeffrey Jacques, Aetna
  • Robert Jarrin, Qualcomm Incorporated
  • Mo Kaushal, Aberdare Ventures/National Venture Capital Association
  • Keith Larsen, Intermountain Health
  • Mary Anne Leach, Children’s Hospital Colorado
  • Meg Marshall, Cerner Corporation
  • Mary Mastenbrook, Consumer
  • Jackie McCarthy, CTIA - The Wireless Association
  • Anna McCollister-Slipp, Galileo Analytics
  • Jonathan Potter, Application Developers Alliance
  • Jared Quoyeser, Intel Corporation
  • Martin Sepulveda, IBM
  • Joseph Smith, West Health
  • Paul Tang, Palo Alto Medical Foundation
  • Bradley Thompson, Epstein Becker Green, P.C
  • Michael Swiernik, MobileHealthRx, Inc.
Federal Ex Officios
  • Jodi Daniel, ONC
  • Bakul Patel, FDA
  • Matthew Quinn, FCC

 -- SS

Tuesday, July 2, 2013

Is ONC's definition of "Significant EHR Risk" when body bags start to accumulate on the steps of the Capitol?

In a June 25, 2013 Bloomberg News article "Digital Health Records’ Risks Emerge as Deaths Blamed on Systems" by technology reporter Jordan Robertson (http://go.bloomberg.com/tech-blog/author/jrobertson40/), an EHR-harms case in which I am (unfortunately) intimately involved as substitute plaintiff is mentioned:

When Scot Silverstein’s 84-year-old mother, Betty, starting mixing up her words, he worried she was having a stroke. So he rushed her to Abington Memorial Hospital in Pennsylvania.

After she was admitted, Silverstein, who is a doctor, looked at his mother’s electronic health records, which are designed to make medical care safer by providing more information on patients than paper files do. He saw that Sotalol, which controls rapid heartbeats, was correctly listed as one of her medications.

Days later, when her heart condition flared up, he re-examined her records and was stunned to see that the drug was no longer listed, he said. His mom later suffered clotting, hemorrhaged and required emergency brain surgery. She died in 2011. Silverstein blames her death on problems with the hospital’s electronic medical records.

“I had the indignity of watching them put her in a body bag and put her in a hearse in my driveway,” said Silverstein, who has filed a wrongful-death lawsuit. “If paper records had been in place, unless someone had been using disappearing ink, this would not have happened.”

How can I say that?  Because I trained in this hospital and worked as resident Admitting Officer in that very ED pre-computer.  The many personnel in 2010 who were given the meds history by my mother and myself directed it not to paper for others to see, but to /dev/null.

Why can I say that?  Because the hospital's Motion for Prior Restraint (censorship) against me was denied outright by the presiding judge just days before the Bloomberg article was published (http://en.wikipedia.org/wiki/Prior_restraint):

Prior restraint (also referred to as prior censorship or pre-publication censorship) is censorship imposed, usually by a government, on expression before the expression actually takes place. An alternative to prior restraint is to allow the expression to take place and to take appropriate action afterward, if the expression is found to violate the law, regulations, or other rules.

Prior restraint prevents the censored material from being heard or distributed at all; other measures provide sanctions only after the offending material has been communicated, such as suits for slander or libel. In some countries (e.g., United States, Argentina) prior restraint by the government is forbidden, subject to certain exceptions, by a constitution.

Prior restraint is often considered a particularly oppressive form of censorship in Anglo-American jurisprudence because it prevents the restricted material from being heard or distributed at all. Other forms of restrictions on expression (such as actions for libel or criminal libel, slander, defamation, and contempt of court) implement criminal or civil sanctions only after the offending material has been published. While such sanctions might lead to a chilling effect, legal commentators argue that at least such actions do not directly impoverish the marketplace of ideas. Prior restraint, on the other hand, takes an idea or material completely out of the marketplace. Thus it is often considered to be the most extreme form of censorship.

The First Amendment lives.

(I wonder if it irks the hospital that they cannot perform sham peer review upon me now that the censorship motion is denied.  Sham peer review is a common reaction by hospital executives to "disruptive" physicians, but I have not worked there since 1987 and I no longer practice medicine.)

In the Bloomberg story Mr. Robertson wrote:

... “So far, the evidence we have doesn’t suggest that health information technology is a significant factor in safety events,” said Jodi Daniel (http://www.healthit.gov/newsroom/jodi-daniel-jd-mph), director of ONC’s office of policy and planning. “That said, we’re very interested in understanding where there may be a correlation and how to mitigate risks that do occur.”

In my opinion this statement represents gross negligence by a government official.  Ms. Daniel is unarguably working for a government agency pushing this technology.   She makes the claim that "so far the evidence we have doesn't suggest significant risk" while surely being aware (or having the fiduciary responsibility to be aware) of the impediments to having such evidence.

From my March 2012 post "Doctors and EHRs: Reframing the 'Modernists v. Luddites' Canard to The Accurate 'Ardent Technophiles vs. Pragmatists' Reality" at http://hcrenewal.blogspot.com/2012/03/doctors-and-ehrs-reframing-modernists-v.html  (yes, this was more than a year ago):

... The Institute of Medicine of the National Academies noted this in their late 2011 study on EHR safety:


... While some studies suggest improvements in patient safety can be made, others have found no effect. Instances of health IT–associated harm have been reported. However, little published evidence could be found quantifying the magnitude of the risk.

Several reasons health IT–related safety data are lacking include the absence of measures and a central repository (or linkages among decentralized repositories) to collect, analyze, and act on information related to safety of this technology. Another impediment to gathering safety data is contractual barriers (e.g., nondisclosure, confidentiality clauses) that can prevent users from sharing information about health IT–related adverse events. These barriers limit users’ abilities to share knowledge of risk-prone user interfaces, for instance through screenshots and descriptions of potentially unsafe processes. In addition, some vendors include language in their sales contracts and escape responsibility for errors or defects in their software (i.e., “hold harmless clauses”). The committee believes these types of contractual restrictions limit transparency, which significantly contributes to the gaps in knowledge of health IT–related patient safety risks. These barriers to generating evidence pose unacceptable risks to safety.[IOM (Institute of Medicine). 2012. Health IT and Patient Safety: Building Safer Systems for Better Care (PDF). Washington, DC: The National Academies Press, pg. S-2.]

Also in the IOM report:

… “For example, the number of patients who receive the correct medication in hospitals increases when these hospitals implement well-planned, robust computerized prescribing mechanisms and use barcoding systems. But even in these instances, the ability to generalize the results across the health care system may be limited. For other products— including electronic health records, which are being employed with more and more frequency— some studies find improvements in patient safety, while other studies find no effect.

More worrisome, some case reports suggest that poorly designed health IT can create new hazards in the already complex delivery of care. Although the magnitude of the risk associated with health IT is not known, some examples illustrate the concerns. Dosing errors, failure to detect life-threatening illnesses, and delaying treatment due to poor human–computer interactions or loss of data have led to serious injury and death.”


I also noted that the 'impediments to generating evidence' effectively rise to the level of legalized censorship, as observed by Koppel and Kreda regarding gag and hold-harmless clauses in their JAMA article "Health Care Information Technology Vendors' Hold Harmless Clause: Implications for Patients and Clinicians", JAMA 2009;301(12):1276-1278. doi: 10.1001/jama.2009.398.

FDA had similar findings about impediments to knowledge of health IT risks, see my Aug. 2010 post "Internal FDA memorandum of Feb. 23, 2010 to Jeffrey Shuren on HIT risks. Smoking gun?" at http://hcrenewal.blogspot.com/2010/08/smoking-gun-internal-fda-memorandum-of.html.

I also note this from amednews.com's coverage of the ECRI Deep Dive Study (http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html):


... In spring 2012, a surgeon tried to electronically access a patient’s radiology study in the operating room but the computer would show only a blue screen. The patient’s time under anesthesia was extended while OR staff struggled to get the display to function properly. That is just one example of 171 health information technology-related problems reported [voluntarily] during a nine-week period [from 36 hospitals] to the ECRI Institute PSO, a patient safety organization in Plymouth Meeting, Pa., that works with health systems and hospital associations in Kentucky, Michigan, Ohio, Tennessee and elsewhere to analyze and prevent adverse events. Eight of the incidents reported involved patient harm, and three may have contributed to patient deaths, said the institute’s 48-page report, first made privately available to the PSO’s members and partners in December 2012. The report, shared with American Medical News in February, highlights how the health IT systems meant to make care safer and more efficient can sometimes expose patients to harm.


One wonders if Ms. Daniels' definition of "significant" is when body bags start to accumulate on the steps of the Capitol.

I also note she is not a clinician but a JD/MPH.

I am increasingly of the opinion that non-clinicians need to be removed from positions of health IT leadership at regional and national levels.

In large part many just don't seem to have the experience, insights and perhaps ethics necessary to understand the implications of their decisions.

At the very least, such people who never made it to medical school or nursing school need to be kept on a very short leash by those who did.

-- SS

Thursday, May 30, 2013

Marin General Hospital's Nurses are Afraid a Defective EMR Implementation Will Harm or Kill Patients .. CEO Cites Defective HHS Paper and Red Herrings As Excuse Why He Knowingly Allows This To Continue

- Posted at the Healthcare Renewal Blog on May 30, 2013 -

The following appeared in the Marin County Independent Journal about an EHR system so bad the nurses at Marin General Hospital were publicly complaining, putting their careers at risk (see my May 17, 2013 post "Marin General Hospital nurses warn that new computer system is causing errors, call for time out"):

National critic of health care information technology says Marin General should heed nurses' advice

The critic is me.   I spoke to the reporter but did not know he would publish:

A nationally known critic of electronic health records has harshly criticized managers at Marin General Hospital for their response to a plea by nurses to hold off on a new computer system to prevent potentially dangerous errors.

"The executives at the hospital should be taking out extra insurance policies because they're setting themselves up for a massive corporate negligence lawsuit," said Dr. Scot Silverstein, an adjunct professor of health care informatics at Drexel University in Philadelphia.

Silverstein, who contacted the Independent Journal after reading about the Marin General situation, doesn't dispute the potential of digital records; but he believes implementation has been rushed. He thinks electronic health records should be regulated by the federal Food and Drug Administration, much like medical hardware or pharmaceuticals.

Or regulated by someone with experience in similar mission critical software, and with regulatory teeth.  Paper tigers and bad health IT are a very poor mix where patients' rights are concerned IMO.


At issue is a new computerized physician order entry system, known as CPOE; doctors place medication orders for patients directly into the system.

At a meeting of the Marin Healthcare District board on May 14, a group of Marin General nurses told the board problems with the new computer system were diverting them from their patients and causing errors, such as sending orders to the wrong patients. One nurse reported that a patient had received a medication to which he was allergic.

That is a very direct calling out of the potential for harm and death by front line clinical personnel.  To ignore it is grossly if not criminally negligent.


Lee Domanico, who serves as the CEO of both Marin General and the Marin Healthcare District, assured the board that the hospital was safe, despite "glitches" in the new system. Domanico said he was working to fix the problem.

Glitches = safe?  The Board must be highly gullible if they believe this  See http://hcrenewal.blogspot.com/search/label/glitch for more on "safe" glitches.

Silverstein said, "Glitches are a euphemism for life-threatening electronic health record malfunctions and defects."


"What they need to do is exactly what the nurses are asking for," Silverstein said. "They need to turn the system off and put it through rigorous testing and confirm the thing is going to work properly with no glitches before they use it on patients."

That's not rocket science - its common sense - unless they think their own nurses are lying.

Of course, as computers have more rights than patients, and bonuses might be affected, the system will likely continue in full operation, with patients as guinea pigs, and the nurses punished for informing the public that perhaps they should consider other hospitals while the "glitches" in this enterprise clinician command-and-control system are worked out.


Two days after the Marin Healthcare District meeting, Domanico issued a press release stating, "We have not received any medication error incident reports resulting from the implementation of computerized physician order entry."

On Friday, however, Barbara Ryan, a Marin General registered nurse who serves as the California Nurses Association/National Nurses United representative, said, "I can't understand why that statement was made."

Ryan said nurses have told her of errors, and information about errors appears in "Assignment Despite Objection" forms that nurses have filed since implementation of the computerized order system began on May 7. Nurses file the forms to document formal objections to an unsafe, or potentially unsafe, patient care assignment.

The statement's reason and purpose seems fairly obvious. 

Ryan said Marin General nurses have filed close to 50 such forms so far this month; she said typically 10 to 20 such forms are filed per month at the hospital.

"There are still problems with the system," she said. "There are still mistakes being made." Ryan said the hospital needs to boost nurse staffing ratios during the implementation.

That would increase costs (and probably decrease the pool of money for bonuses).

Jon Friedenberg, Marin General's chief fund and business development officer, said the hospital is in the process of upgrading computer servers and adding memory to work stations to increase the speed of the new computerized order system.

"We completed an upgrade of memory to 200 of the work stations, and 120 of the work stations have been replaced," Friedenberg said.

This reminds me of a similar IT fiasco I faced some years ago, when the brilliance of IT personnel really shone through regarding an ICU monitoring system that crashed regularly.  Their solution?  Add more RAM.  (See "Serious clinical computing problems in the worst of places: an ICU" at http://www.ischool.drexel.edu/faculty/ssilverstein/cases/?loc=cases&sloc=clinical%20computing%20problems%20in%20ICU).

... Silverstein earned a medical degree from Boston University and subsequently completed a two-year fellowship in medical informatics at Yale University School of Medicine. He served as Merck Research Laboratories' director of scientific information in the early 2000s before serving for a time as a full-time professor at Drexel University. Today, in addition to teaching part-time, Silverstein works on [EHR-related - ed.] medical liability cases for plaintiff attorneys. [And the defense too, when asked; I'd rather advise on how to prevent mistakes, in fact, than get involved after the fact when someone's been injured or killed - ed.]


What was not mentioned was that I was a CMIO in a major hospital in the mid to late 1990s.

But of course, I - and similarly trained Medical Informatics experts - "don't have enough experience" to lead (as opposed to being an 'internal consultant') health IT projects, a refrain I've often heard from hospital executives.


Silverstein said he started assisting on the liability cases after his mother died as the result of an electronic health care record error that resulted in her not being given the proper heart medicine. Silverstein said his mother's case was not an anomaly.
For example, he pointed to the results of a recent Emergency Care Research Institute study of 36 hospitals conducted over a nine-week period. Asked to report electronic record problems on a volunteer basis, Silverstein said the hospitals reported 170 malfunctions, including eight incidents that resulted in patient harm, three of which may have contributed to patients' deaths.  Although the federal Food and Drug Administration does not regulate health care information technology, some manufacturers have voluntarily supplied data to the FDA. In February 2010, the FDA reported it had been notified of 260 problem events involving health care information technology in the previous two years that were linked with 44 injuries and six deaths.

See my Feb. 28, 2013 post "Peering Underneath the Iceberg's Water Level: AMNews on the New ECRI Deep Dive Study of Health IT Events" at http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html.  Also see my Aug. 5, 2010 post "Internal FDA memorandum of Feb. 23, 2010 to Jeffrey Shuren on HIT risks. Smoking gun? I report, you decide" at http://hcrenewal.blogspot.com/2010/08/smoking-gun-internal-fda-memorandum-of.html. I merely report what ECRI, AMA and FDA have reported.

Finally:

In his press release, however, [CEO] Domanico stated that "more than 150 studies conducted since 2007 have confirmed that organizations using health information technology, like CPOE, have seen positive outcomes."

I believe he's referring to a highly biased and scientifically defective ONC paper of 154 selected studies: "The Benefits Of Health Information Technology: A Review Of The Recent Literature Shows Predominantly Positive Results."

What an unbelievably cavalier attitude.

My colleagues and I refuted (dare I say trashed) that paper pretty thoroughly here:
http://hcrenewal.blogspot.com/2011/03/benefits-of-health-information.html.

Even worse, the mention of that paper, or EHR benefits in general, is a diversion, an in-your-face red herring (at best; an inability to reason logically at worst), steering away from the real issue:  an EHR implementation about which nurses are complaining ... in the now.

http://www.nizkor.org/features/fallacies/red-herring.html:  A Red Herring is a fallacy in which an irrelevant topic is presented in order to divert attention from the original issue.

That a CEO of a major hospital relies on one defective paper - one that he most likely lacks the experience and expertise to understand, let alone critically evaluate - and red herrings is a poster example of why medical and medical informatics amateurs should not be running hospitals or clinical IT projects.

-- SS

Saturday, March 16, 2013

Bad Science (and Perhaps Conflict of Interest) At ONC / HHS

This article recently appeared, quoting Jacob Reider, M.D., chief medical officer at ONC on an upcoming Health IT Safety Plan:

Health Data Management

http://www.healthdatamanagement.com/news/HIMSS13-ONC-HIT-safety-plan-45809-1.html 

ONC Sets Early Summer for Release of HIT Safety Plan

The Office of the National Coordinator for Health Information Technology anticipates releasing a final health information technology safety plan by early summer, officials announced on March 5 at HIMSS13 in New Orleans.

ONC released a draft plan in December and accepted public comment until February 4. The draft followed an Institute of Medicine report that ONC commissioned that highlighted the need for better understanding of the HIT impacts on safety, as well as shared responsibilities among all stakeholders to improve safety, Jodi Daniel, director of the ONC office of policy and planning, said during an educational session.

There is little doubt that use of I.T. results in fewer medical errors, particularly medication-related because of electronic prescriptions and clinical decision support, noted Jacob Reider, M.D., chief medical officer at ONC. “It’s obvious that in many areas there will be fewer errors, but at the same time, in other areas there will be more errors.” Consequently, a priority of the plan will be implementing a framework to help the industry better understand what the trouble areas will be as I.T. use increases.

Less than 1 percent of patient safety events are related to HIT, Reider contended, but the industry needs more data to better understand the level of harm from such events and how to improve the technology. HIT-related errors, he reminded the audience, are not always the fault of vendors; providers can introduce risk when customizing their systems.

The upcoming safety plan release is fine and good, but I, for one, wonder if it can be trusted.

The level of bias and lack of knowledge of the domain, evidence of incomplete research, and/or poor scientific judgement inherent in the statements I bolded above are disturbing.  They are also  reminiscent of the problems in the ONC-authored paper discussed at this link.

First:

  • There is little doubt that use of I.T. results in fewer medical errors

On the contrary, there is significant well-researched doubt in that the evidence is quite contradictory.  Let's cite the IOM's 2012 report on health IT risk:

… “For example, the number of patients who receive the correct medication in hospitals increases when these hospitals implement well-planned, robust computerized prescribing mechanisms and use barcoding systems. But even in these instances, the ability to generalize the results across the health care system may be limited. For other products— including electronic health records, which are being employed with more and more frequency— some studies find improvements in patient safety, while other studies find no effect 

IOM (Institute of Medicine) 2012. Health IT and Patient Safety: Building Safer Systems for Better Care (PDF). Washington, DC: The National Academies Press.

Let's quote one of the IOM study panel members, an international authority on safety, Dr. Richard Cook:

... HIT's cornucopia has been promised repeatedly since the 1960's. Nothing like the promises has materialized.  Indeed, the IOM committee that was commissioned to evaluate the best evidence on this subject found no persuasive evidence that HIT improved patient safety. I know because I was there. 

The body of literature here also contains relevant studies contradicting Dr. Reider's quoted, dispositive statement.

Next:

  • It’s obvious that in many areas there will be fewer errors

This statement requires no response, but I'll respond anyway.  

In science, stating something is "obvious" (i.e., what is referred to at the site "36 Humorous Methods of Proof" as "Proof by obviousness") is, on its face, bad science.

Next:

  • Less than 1 percent of patient safety events are related to HIT

The aforementioned IOM report was quite clear on the following:

... Several reasons health IT–related safety data are lacking include the absence of measures and a central repository (or linkages among decentralized repositories) to collect, analyze, and act on information related to safety of this technology. Another impediment to gathering safety data is contractual barriers (e.g., nondisclosure, confidentiality clauses) that can prevent users from sharing information about health IT–related adverse events. These barriers limit users’ abilities to share knowledge of risk-prone user interfaces, for instance through screenshots and descriptions of potentially unsafe processes. In addition, some vendors include language in their sales contracts and escape responsibility for errors or defects in their software (i.e., “hold harmless clauses”). The committee believes these types of contractual restrictions limit transparency, which significantly contributes to the gaps in knowledge of health IT–related patient safety risks. These barriers to generating evidence pose unacceptable risks to safety.

... The magnitude of the risk associated with health IT is not known.

Likewise, FDA has concluded that what they know on HIT-related patient safety events is likely "the tip of the iceberg"  due to systematic impediments to knowing, as has the ECRI Institute who has only now begun to study the issue with any degree of rigor.  (The results are of great concern to anyone who should know, or should have made it their business to know, as at this link.)

Perhaps Dr. Reider needs a lesson on basic epistemology:  "We simply don't know what we don't know."

Finally:

  • HIT-related errors, he reminded the audience, are not always the fault of vendors; providers can introduce risk when customizing their systems.

I find it remarkable that a government official uses a public/industry platform HIMSS to defend an industry, while at the same time stating more study is needed to understand the causative factors of harm from the industry's products.

This raises the question of conflict of interest, and the possibility this official is not impartial or trying to be "fair" but aiming towards protecting an industry he once worked for - and to where he's likely to return at some point.  (See Roy Poses' posts on "revolving doors" for examples of that.)

From his government biography here:

Dr. Jacob Reider
Director, Office of the Chief Medical Officer

Jacob Reider, MD is a family physician with 20 years of experience in health information technology and special interest in clinical innovation, user experience, and clinical decision support. His background includes leadership roles in nearly all facets of the health IT domain – from small start-up companies to academic facilities, primary care medical groups, and large health IT development organizations. Dr. Reider has served as a member of the Board of Trustees of the American Medical Students Association, the Society of Teachers of Family Medicine, and has served in directorial positions on boards of several innovative health IT companies.
  
I note I do not find evidence of formal medical informatics education, which selfsame ONC recommends for leadership roles in health IT (see my Dec. 2009 post "ONC Defines a Taxonomy of Robust Healthcare IT Leadership"), but I do find roles such as:

Chief Medical Informatics Officer
Allscripts
June 2009 – January 2011 (1 year 8 months)

Medical Director
Allscripts
March 2007 – June 2009 (2 years 4 months)

Chief Medical Officer
MedRemote (Now Nuance)
November 1999 – December 2002 (3 years 2 months)

One might reasonably wonder what personal gains might accrue to Dr. Reider from the promotion of health IT - which includes downplaying its current risks - from an influential government perch.  (I for example held many Merck stock options after my late 2003 departure.  They remained underwater until expiration, but even a a $10 or $20 increase in stock price could have bought me, say, a new sports car or even house.)

I also note that the former CEO of Allscripts, Glen Tullman was, in fact, a close confidant of our current President and advisor on health IT during his first campaign:

A tireless advocate of technology in medicine, Tullman has been featured in virtually every major news outlet. An early supporter of fellow Chicagoan Barack Obama, Tullman introduced him to the Electronic Health Record (EHR) and served on his finance and healthcare committees during the 2008 presidential campaign.

Is it any wonder, then, that my expectation is that the forthcoming ONC HIT safety plan will be biased towards industry, reflect poor science and incomplete/selective research, and overall be a whitewash?

I'll be presenting on issues such as this to the Plaintiff's Bar.  They seem to be the last protectors of people's/patient's rights where clinical IT is concerned - a role they seem most familiar with in other sectors.

I emailed Dr. Reider a link to this post with a request that if he has robust evidence to support his assertions that is not publicly available, to please release it.

-- SS

Mar. 16, 2012 Addendum: 

A correspondent asked me the following that I thought deserved mention beyond the comments section:

"How would he know, exactly, when we know, that they never tallied the thousands of e-Rx errors from a national Siemens defect that was disclosed only at the Brown Medical Center Hospitals (Lifespan) but was a systemwide defect; nor from the Cerner convert to e-Rx defect that was evident at the Trinity Health System; and millions of other errors from when the e-Rx system was unavailable. Or, do they simply do not count those?"

My response?  No, they probably consider those "anecdotal." 

-- SS
 

Monday, February 18, 2013

Kaiser Health News/Philadelphia Inquirer on InformaticsMD: "The flaws of electronic records"

At my Dec. 2012 post "How an interview for Kaiser Health News rekindled memories of health IT dysfunction in the 90's that persist in the 10's" I mentioned an interview by a reporter from the Kaiser Health Foundation regarding health IT flaws.

His article appeared in both the Philadelphia Inquirer and Kaiser Health News today under the title "The flaws of electronic records":

Philadelphia Inquirer / Kaiser Health News
Feb. 18, 2013
The flaws of electronic records

Drexel University's Scot Silverstein is a leading critic of the rapid switch to computerized medical charts, saying the notion that they prevent more mistakes than they cause is not proven.


 



Scot Silverstein of Lansdale, one of the most ardent critics of electronic medical records, works on an antique computer. A growing collection of evidence suggests poorly designed medical software can obscure clinical data, generate incorrect treatment orders, and cause other problems.

RON TARVER /Staff Photogapher

Jay Hancock, KAISER HEALTH NEWS
Posted: Monday, February 18, 2013, 3:01 AM

Computer mistakes like the one that produced incorrect prescriptions for thousands of Rhode Island patients are probably far more common and dangerous than proponents of electronic medical records believe, says Drexel University's Scot Silverstein.

Flawed software at Lifespan hospital group printed orders for low-dose, short-acting pills when patients should have been taking stronger, time-release ones, the Providence-based system disclosed in 2011. Lifespan says nobody was harmed.

But Silverstein, a physician and adjunct professor of health-care informatics who is making a name for himself as a strident critic of electronic health records, says the Lifespan breakdown is part of a much larger problem.

"We're in the midst of a mania right now" as traditional patient charts are switched to computers, he said in an interview in his Lansdale home. "We know it causes harm, and we don't even know the level of magnitude. That statement alone should be the basis for the greatest of caution and slowing down."

In an ethical world, it would be.  Medicine, though, is in the throes of a loss of ethics, as many stories at this site and many others attest to.

Use of electronic medical records is speeding up, thanks to $10 billion and counting in bounties the federal government is paying to caregivers who adopt them. The consensus among government officials and researchers is that computers will cut mistakes and promote efficiency. So 4,000 hospitals have installed or are installing digital records, the Department of Health and Human Services said last month. Seventy percent of doctors surveyed in September by research firm CapSite said they had switched to digital data.

But the notion that electronic charts prevent more mistakes than they cause just isn't proven, Silverstein says. Government doesn't require caregivers to report problems, he points out, so many computer-induced mistakes may never surface.

The recent ECRI "deep dive" study of "EHR events" (link) is just the latest to raise red flags on that point.

Even Dr. David Blumenthal, former chair of the Office of the National Health IT Coordinator (ONC) in HHS seems to have changed his message about reporting of medical problems.

From a Feb. 16, 2013 New York Times article "Doctors Who Don’t Speak Out":

....  TRADITIONALLY, doctors have brought problems to the attention of colleagues by conducting research and publishing their findings in a medical journal. The advantage of that system helps ensure the credibility of study data and protects a researcher from random attack, said Dr. David Blumenthal, the president of the Commonwealth Fund, a group that studies health policy issues.

But getting a study published can take a year or two; some Johnson & Johnson consultants did publish studies about the hip’s flaws, but they largely appeared after it had been recalled.

Dr. Blumenthal said there was probably a need for more immediate ways for doctors to share their concerns, like forums supported by professional medical organizations.

Back to the Inquirer article:

He doesn't discount the potential of digital records to eliminate duplicate scans and alert doctors to drug interactions and unsuspected dangers.

But the rush to implementation has produced badly designed products that may be more likely to confound doctors than enlighten them, he says. Electronic health records, Silverstein believes, should be rigorously tested under government supervision before being used in life-and-death situations, much like medical hardware or airplanes.

In fact, arguments otherwise are specious.  "Harm to innovation" is the one I've heard most often.  Yet, those proffering such claims cannot point out what aspect of regulation - adherence to GMP's (good manufacturing processes), pre-market safety and quality testing, post-market surveillance, etc. - will "harm innovation."  Indeed, they opine as if innovation in medicine without objective safety and quality checks is a virtue, rather than a potential vice.

Silverstein "is an essential critic of the field," said physician George Lundberg, editor at large for MedPage Today and former editor of the Journal of the American Medical Association. "It's too easy for those of us in medicine to get excessively enthusiastic about things that look like they're going to work out really well. Sometimes we go too far and don't see the downside of things."

(Dr. Lundberg mentioned me in Nov. 2011 at MedPage today in a piece entitled "Health IT: Garbage In, Garbage Out" as here.)

The patients - including ourselves and our own family members, I might add - are the ones who pay the price of our hyper-enthusiasm.

... The FDA's Jeffrey Shuren, a neurologist, has said such cases "likely reflect a small percentage of the actual events that do occur."

"Tip of the iceberg" were his exact words (link).

... At conferences and working from home on the "Health Care Renewal" blog, Silverstein chronicles digital failures and criticizes hospitals in the same dogged way he applied himself to building the 1970s-era Heathkit computers [and amateur radio equipment - ed.] he still keeps in his home, say people who know him.

"His message has been consistent": Health IT "provides far less benefit than is claimed by its proponents and opens new, sometimes potent, routes to failure," said Richard I. Cook, a medical error expert at the University of Chicago who sat on a panel examining electronic record safety at the authoritative Institute of Medicine. "No one wants him to be visible. But his message and tone have not wavered."

Dr. Cook wrote the lone dissent to milquetoast IOM recommendations on health IT risk - the magnitude of which IOM itself admitted is unknown - in their 2012 report "Health IT and Patient Safety: Building Safer Systems for Better Care" available here.  See Appendix E.

The last scientific conference at which I chronicled these failures was at the Health Informatics Society of Australia's HIC2012, as a keynote speaker on health IT trust (link).  I would have been at HIC2011, to which I had been originally invited, but was helping care for a relative injured by bad health IT at that time.  Her death freed me to travel Down Under in 2012.

I have presented at a number of plaintiff attorney's meetings since then, however, such as the American Association for Justice Winter Convention (AAJ, formerly the Trial Lawyer's Association) just last week (link).  Trial lawyers don't seem to mind a very direct approach to the issues, unlike many so-called scientists who, as author Michael Crichton once warned (link), seem to believe in "consensus" rather than science.

The HIMSS Electronic Health Record Association, an industry group, declined to comment on Silverstein. A spokesman for the Office of the National Coordinator for Health Information Technology, the administration's proponent of digital records, said: "It's important to listen to all the voices" in the discussion of the subject. 

Some voices, unfortunately, are louder than others and backed by lobbyists and big money.  See, for instance, the May 2009 Washington Post article by Robert O'Harrow Jr. "The Machinery Behind Health-Care Reform: How an Industry Lobby Scored a Swift, Unexpected Victory by Channeling Billions to Electronic Records" (link to the article and my essay about it is here).

I do point out, however, for the benefit of those at HIMSS and ONC, that knowing of risks, while doing nothing substantive while "listening to all voices in the discussion" can be seen as gross negligence.

Trained as an internist and in medical information technology [Medical Informatics- ed.] as a Yale University postdoc, Silverstein, 55, served as Merck & Co.'s director of scientific information in the early 2000s and then as a full-time Drexel professor, shifting in recent years to part-time teaching and working on medical liability cases for plaintiff attorneys. His insistent warnings about digital health risks over more than a decade have effectively barred him from a lucrative career at a hospital or software vendor.

Perverse as that reality may be, it's also the reverse:  I would not want to work for a hospital or software vendor in 2013, where effecting change to protect patients from bad health IT is hard if not impossible, e.g., as at link, link, and link, and at the other case examples at that site.  I find it a far more effective use of my time to help enact change from the outside - and avoiding the pathological individuals who make such scenarios possible.

"I'm sure Scot would be better off by keeping his mouth shut and getting a job with a hospital that's just put in a big . . . system," said Matthew Holt, a Silverstein critic and cochairman of Health 2.0, which organizes health technology conferences.

I note that the raison d'être for this blog is the impact of many people doing just that sort of thing - "keeping their mouth shut" and making money, no matter what the ethical implications.  (The patients killed by such behaviors are, unfortunately, unavailable for comment.)

Many say he comes on too strong. Even admirers cringed when he began blogging about the 2011 death of his mother, which he blames in a lawsuit on a computer error that allegedly caused Abington Memorial Hospital to overlook a key medication. (Both he and the hospital said they couldn't comment on a pending suit.) Personalizing his campaign, some thought, made him seem less objective.

I'm at a loss here.  "Too strong" - on matters of life and death that affect everyone?  A proficient writer, who had been writing about health IT problems since 1998, should have kept silent about a first hand story of HIT harm in 2010 of potential great relevance towards public safety?  Writing about the incident 'lessens objectivity'?  That makes little sense, and is perverse.  Those who opined as such have their priorities in serious disarray.

Such personalized accounts are common and have caused great change.  Libby Zion's death due to hospital neglect, and her father's making the issues quite public, comes to mind, as do the many laws enacted that are named after people who've gone public after personal tragedy:

... Grieving the loss of their child, Zion's parents became convinced that their daughter's death was due to inadequate staffing at the teaching hospital.  Sidney Zion questioned the staff's competence for two reasons. The first was the administration of meperidine, known to cause fatal interactions with phenelzine, the antidepressant that Libby Zion was taking. The second issue was the use of restraints and emergency psychiatric medication. Sidney's aggrieved words were: "They gave her a drug that was destined to kill her, then ignored her except to tie her down like a dog." To the distress of the doctors, Zion began to refer to his daughter's death as a "murder." Sidney also questioned the long hours that residents worked at the time. In a New York Times op-ed piece he wrote: "You don't need kindergarten to know that a resident working a 36-hour shift is in no condition to make any kind of judgment call—forget about life-and-death." The case eventually became a protracted high-profile legal battle, with multiple abrupt reversals; case reports about it appeared in major medical journals.

An alternate explanation is that, lacking other credible means, this is an ad hominem reaction (of those "some") seeking an angle to attack the message ... and the messenger ... or is simply a reaction of, to put it bluntly, castrati who are more at home in a country club than in the world of ideas.

For a bona fide example of "coming on too strong", there's this:

In the NEJM article "The 'Meaningful Use' Regulation for Electronic Health Records", David Blumenthal, M.D., M.P.P. (ONC Chair) and Marilyn Tavenner, R.N., M.H.A. (10.1056/NEJMp1006114, July 13, 2010) available at this link, the opening statement is (emphases mine):

The widespread use of electronic health records (EHRs) in the United States is inevitable. EHRs will improve caregivers’ decisions and patients’ outcomes. Once patients experience the benefits of this technology, they will demand nothing less from their providers. Hundreds of thousands of physicians have already seen these benefits in their clinical practice.

I think it fair to say those are grandiose statements and predictions presented with a tone of utmost certainty in one of the world's most respected scientific medical journals. 


Even though it is a "perspectives" article, I once long ago learned that in writing in esteemed scientific journals of worldwide impact, statements of certainty were at best avoided, or if made should be exceptionally well referenced.

I note the lack of footnotes showing the source(s) of these statements.

Another bona fide example of "coming on too strong":

“We have the capacity to transform health with one thunderous click of a mouse after another,” said (former) HHS Secretary Michael Leavitt - 2005 HIMSS Summit 


We shall transform health (into what, exactly, is not specified) one thunderous mouse click after another!

It doesn't get any stronger than that, unless, perhaps, the thunderous wrath of God is invoked.

Back to the Inquirer once again:

"His refusal to temper his message makes it sometimes difficult to hear," said Ross Koppel, a University of Pennsylvania sociologist and digital health record skeptic.

As per a recent article by Joe Conn in Modern Healthcare entitled "Health IT Iconoclasts" (link), which wrote of Dr. Koppel, Deborah Peel, Lawrence Weed and me, Dr. Koppel has firsthand experience at his message being found "difficult to hear" by the hyper-enthusiasts:

... Researcher Ross Koppel started an uproar in 2005 when he and a colleague coauthored an article in the Journal of the American Medical Association that found a first-generation computerized physician order entry system (CPOE) at the Hospital of the University of Pennsylvania was simultaneously creating new errors even as it reduced others.

Koppel’s bombshell—he’s now an adjunct professor of sociology at the University of Pennsylvania— brought down the wrath of information technology boosters. The Healthcare Information and Management Systems Society, a health IT trade group, challenged the study’s “methodology and its subsequent outcomes,” and criticized its authors for their “limited view” and not “looking at the big picture.”  [Others wrote that his work was 'disingenuous', although it had similar findings to my own observation of the very same CPOE system at Yale-New Haven Hospital ... in 1992 - ed.]

... In 2009, he revealed in another JAMA article that health IT vendors’ contracts included “hold harmless” clauses that shielded software developers from legal liability for medical errors their systems caused, even if the developers had been warned about the defects. “That got me major upheaval,” the worst of his career, Koppel recalls.

Koppel, a sociologist, has probably done more for health IT transparency and safety than the physicians of the entire academic medical and medical informatics community combined.

... But Silverstein says his position today is the same as it has always been. He believes in the potential power of electronic records for good, he says. But any doctor who feels bound by the Hippocratic oath's injunction to "first, do no harm," he adds, should balk at what's going on.

"Patients are being harmed and killed as a result of disruptions to care caused by bad health IT," he said. "I'm skeptical of the manner and pace" of implementation, "not of the technology itself. . . . My only bias is against bad medicine. And my bias is against people with complacent attitudes about bad medicine."

The issues are actually relatively simple, using terminology coined by Dr. Jon Patrick of U. Sydney at the aforementioned HIC2012 meeting in Australia during our discussions.  Bad health IT must be removed from the market, and good health IT must replace it.

Good Health IT ("GHIT") is defined as IT that provides a good user experience, enhances cognitive function, puts essential information as effortlessly as possible into the physician’s hands, keeps eHealth information secure, protects patient privacy and facilitates better practice of medicine and better outcomes.

Bad Health IT
("BHIT") is defined as IT that is ill-suited to purpose, hard to use, unreliable, loses data or provides incorrect data, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security, compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation.  
  
It is this author's opinion that this change will not happen by "going along to get along" or "listening to all the voices in the discussion of the subject" (especially those with Big Money and Big Lobbyists behind them) while doing nothing.

I also note that "complacent attitudes about bad medicine" are not the sole province of IT personnel or healthcare management.  Physicians and nurses who acquiesce to bad health IT are part of the problem.

-- SS

Wednesday, February 13, 2013

Texas Medical Association slams ONC Healthcare IT safety plan

The Texas Medical Association offers views similar to the views I have been writing about for a decade and a half on healthcare IT quality and patient care risks:
FierceHealth IT today

Texas Medical Association slams ONC safety plan
By Dan Bowman

The health IT safety action plan proposed by the Office of the National Coordinator for Health IT in December is not specific enough to succeed, according to recent comments made by the Texas Medical Association. In its letter to National Coordinator for Health IT Farzad Mostashari, TMA said that responsibility for the plan "lacks focus," and should be overseen by a "highly visible HIT Safety Czar.

TMA also called setting mandatory deadlines and developing a "robust" reporting and learning system imperative to the success of the plan, saying that the plan's current reliance on voluntary reporting and funding represents a "fundamental weakness."

"TMA believes that significant patient safety risks exist now, and new ones will emerge in the next one to two years as many [electronic health record] and other HIT vendors merge or go out of business," the letter said.

Additionally, the group expressed doubts about a code of conduct proposed to keep vendors in line as far as ensuring cooperation with safety organizations for adverse event reporting. "TMA is concerned that this will not materially affect industry accountability and generate the changes that are needed," the letter said. "For example, what if a developer does not comply with said code of conduct? There is no penalty or impetus for change."

The American Medical Association was a bit less harsh in its assessment of ONC's plan. It supports most of the ideas outlined in the plan, although it called for more research to be done on the impact of electronic health record use regarding patient safety in the ambulatory setting.

"Physicians are concerned about potential liabilities from EHR system design and software flaws, as well as lack of interoperability among EHR systems that could result in incomplete or missing information, which may lead to errors in patient diagnosis and treatment," the AMA letter said. "In addition, the impact that EHRs have on physician practice workflows can lead to unintended consequences. Those impacts are the result of how the software is developed."

HIMSS said in its letter to Mostashari that it wants to see more provider-vendor cooperation when it comes to investigation of patient safety events, as well as usability, while the AHA said in its letter that its stakeholders would like to see more of a focus on a single, national approach to matching patients with their records with a goal of patient safety.


To learn more:
- here's the TMA 
letter (.pdf)
- read the AMA 
letter (.pdf)


The TMA and AMA letters linked above are worth reading in their entirety.

I note, with little surprise, the "softer" stances (e.g., self-policing vs. government oversight) taken by industry-dominated bodies such as HIMSS and CHIME.

On the other hand, I find the AMA's "less harsh" views somewhat disappointing.  Their letter is welcome, and more research needs to be done as to risks in ambulatory settings (and inpatient settings as well).  However, the delays in action during the research are of concern.


Where patient safety is concerned, fast action is a top priority.  Patients, needless to say, have more rights than computers and their sellers.

-- SS