Evidence based testing of electronic medical record systems for general practitioners

Background. In the broad context of the nation?wide introduction of electronic medical records, several committees, coordinated by the Ministry of Social Affairs, Health and Environment, worked out a list of requirements, via consensus procedures. This paper describes the results of the full testing that took place in 2002 and 2003. In 2004 and 2005, only "incremental" tests were performed.
Objectives. The main objective of this work was to develop a flexible and widely accepted evaluation method for the quality of electronic medical record (EMR) systems, in the context the long term policy of improved electronic record keeping by the medical professions in Belgium. Efforts lead by the Federal Ministry of Health, implemented via several committees, working groups and teams. After two years of successful application, we present
the methodology, analyse the results and draw conclusions for future developments.
Materials and methods. The development of a scenario?based test sequence based on a list of requirements or criteria, pertaining professional functionality, user?friendliness and implementation robustness. The new test method was devised and applied during two consecutive years.
Results. We clearly see an increase in the average test?scores in all the categories of the criteria, comparing the two consecutive test sessions, except for the category "data extraction". Moreover, the marked decrease in "spread", shows that the surviving EMR systems become more homogeneous.
Conclusions. After two years of in the field practice, we can conclude that we have developed an objective, efficient and easy to use test procedure, well linked to "everyday practice" and accepted by the healthcare professionals.