Electronic medical records and what statistics can do

| 5 Comments

The Sumerian god Ningizzida was the patron of ...

Image via Wikipedia

Groopman and Hartzband wrote an opinion piece arguing against electronic medical records. The issue is essentially analogous to a debate of the dangers of paper in comparison to the traditional clay tablets. Still, I can appreciate criticism that will make electronic records better. I will quote some of the criticism, and respond to it.


The impact of medication errors on malpractice costs is likely to be minimal, since the vast majority of lawsuits arise not from technical mistakes like incorrect prescriptions but from diagnostic errors, where the physician makes a misdiagnosis and the correct therapy is delayed or never delivered. There is no evidence that electronic medical records lower the chances of diagnostic error.

The electronic record can encourage a physician to consider all the relevant information. Now that features are known, automated prediction tools such as those developed at Memorial Sloan-Kettering Cancer Center can support a doctor in making a diagnosis. Such tools can reach considerably higher accuracy because they're based on considerably larger datasets than before. Related information and checklists can be provided. This way the joint knowledge of the whole medical community will complement an individual physicians schooling and experience.


All of us are conditioned to respect the printed word, particularly when it appears repeatedly on a hospital computer screen, and once a misdiagnosis enters into the electronic record, it is rapidly and virally propagated.[...]

But the propagation of mistakes is not restricted to misdiagnoses. Once data are keyed in, they are rarely rechecked with respect to accuracy. For example, entering a patient's weight incorrectly will result in a drug dose that is too low or too high, and the computer has no way to respond to such human error.

Most of what I see on my computer display are printed words. A computerized system based on a probabilistic view of diagnosis will make it easier to understand that a diagnosis is not a binary choice but a probabilistic one. By design, such a system will reveal other possible diagnoses. Just as a diagnosis is entered into the record, it will be possible to check it and re-check it. The design of the system should encourage multiple checks and individual responsibility of those confirming or checking.


Doctors in particular are burdened with checking off scores of boxes on the computer screen to satisfy insurance requirements, so called "pay for performance." But again, there are no compelling data to demonstrate that such voluminous documentation translates into better outcomes for their sick patients.

A statistical model can determine which boxes are more or less important, saving time that would otherwise be spent for checking off what does not matter. At the same time, a good user interface would allow doctors to enter a new box if they notice something salient.


Some have speculated that the patient data collected by the Obama administration in national electronic health records will be mined for research purposes to assess the cost effectiveness of different treatments.[...]
And Americans should decide whether they want to participate in such a national experiment only after learning about the nature of the analysis of their records and who will apply the results to their health care.

This is true, and one has to be careful here not to create mis-incentives: incorrect or biased data (biases emerge from self-selection too) that might lead to lower costs and better care for a patient, or higher costs for the doctor would dangerously pollute the models. At the same time, it is possible to detect such data fraud automatically.

In summary:


  • It is important to collect the data correctly.

  • Electronic medical records make it possible to deploy predictive models widely, improving health care. It is important to build user interfaces that make use of this.

  • There will be opportunities for centers that specialize in predictive models for specific symptoms or diseases, combining the background knowledge aggregated in medical profession over many years with the modern data collection and analysis.

[Included some information from Bob Carpenter's comment]

5 Comments

Everyone's already at the table: statisticians, doctors and nurses, computer scientists, insurance providers, public health workers, the government, and the military.

For more info, check out AMIA (American Medical Informatics Association): http://symposium2009.amia.org/

Or the NIH i2b2 (Informatics for Integrating Biology and the Bedside) programme: https://www.i2b2.org/

I went to an i2b2 workshop at AMIA '08 on predictive modeling for obesity-related diseases using EHR. We're also working with Health Monitoring Systems in Pittsburgh to monitor emergency room chief complaints by syndromes for epidemiology. There's a huge amount of information coded in natural language that'll continue to be coded in natural language.

We all need to work together. If we let the statisticians run wild, we'll wind up with non-scalable tools like R and BUGS. Not to mention a fight between the Bayesians and non-Bayesians.

If the author of the article you cite is worreid about EMR, he or she should check out what the situation's like now with patient charts.

Of course you could give everyone access to all information to allow for some powerful statistics. On the other hand the data is supposed to be private.
The more data you have available the easier it will get to reveal private medical information about individuals.

At one point you say:

"For example, entering a patient's weight incorrectly will result in a drug dose that is too low or too high, and the computer has no way to respond to such human error."

The only way I see a doctor can cope with this bad diagnosis on the part of the computer (which is based on having bad data in the first place) is to have a look also at the inputs the computer used: the weight should be displayed in a very nice way...so the doctor could check.

Of course, this is not to flood the docs with even more info...it should be done in a smart neat graphical way...

The key point is diplaying not only the results but also the most relevant inputs so the doctor can just look over the diagnosis and do a quick pattern matching in his brain saying..."hmmm, this is reasonable", "hmmm, this is not"

I guess this way things would be better.

Several considerations:

1) Medical record systems fall into the category of large computer systems which are doomed to fail -- they will be mismanaged, take years, be several times over budget and the public will question whether you will need them. See Fred Brooks' " Mythical Man Month".

2) This debate has occurred in other countries, see http://www.cl.cam.ac.uk/~rja14/#Med for details

3) Privacy has already been mentioned.

4) (more subjective) This, quite simply, cannot be a priority in a country where so many people do not have access to healthcare

Through email I received:
--
i assume you also saw, possibly of interest:

http://www.nytimes.com/2009/03/06/opinion/06coben.html

and letters in reply

(interestingly they published another article with same title 4 years ago:
http://www.nytimes.com/2005/11/01/health/01comm.html )

Leave a comment

Recent Comments

  • Aleks Jakulin: Through email I received: -- i assume you also saw, read more
  • SecurityResearcher: Several considerations: 1) Medical record systems fall into the category read more
  • Jose Ignacio Marín Alberdi: At one point you say: "For example, entering a patient's read more
  • ChristianK: Of course you could give everyone access to all information read more
  • Bob Carpenter: Everyone's already at the table: statisticians, doctors and nurses, computer read more

Back to archived post list | Wayback snapshot | Live page