Assessing the effectiveness and cost-effectiveness of audit and feedback on physician’s prescribing indicators: study protocol of a randomized controlled trial with economic evaluation
© Soleymani et al.; licensee BioMed Central Ltd. 2012
Received: 30 October 2012
Accepted: 30 November 2012
Published: 6 December 2012
Physician prescribing is the most frequent medical intervention with a highest impact on healthcare costs and outcomes. Therefore improving and promoting rational drug use is a great interest. We aimed to assess the effectiveness and cost-effectiveness of two forms of conducting prescribing audit and feedback interventions and a printed educational material intervention in improving physician prescribing.
A four-arm randomized trial with economic evaluation will be conducted in Tehran. Three interventions (routine feedback, revised feedback, and printed educational material) and a no intervention control arm will be compared. Physicians working in outpatient practices are randomly allocated to one of the four arms using stratified randomized sampling. The interventions are developed based on a review of literature, physician interviews, current experiences in Iran and with theoretical insights from the Theory of Planned Behavior. Effects of the interventions on improving antibiotics and corticosteroids prescribing will be assessed in regression analyses. Cost data will be assessed from a health care provider’s perspective and incremental cost-effectiveness ratios will be calculated.
This study will determine the effectiveness and cost-effectiveness of three interventions and allow us to determine the most effective interventions in improving prescribing pattern. If the interventions are cost-effective, they will likely be applied nationwide.
Iranian Registry of Clinical Trials Registration Number: IRCT201106086740N1Pharmaceutical Sciences Research Center of TUMS Ethics Committee Registration Number: 90-02-27-07
Over the past decades, new generations of antibiotics, analgesics, corticosteroids and other medicines have been introduced to the pharmaceuticals market. At the same time, health care systems are confronted with a continuing pressure to provide high-quality care in the face of increasing costs and limited financial resources.
Due to the rising pharmaceutical expenditures in the world, governments are struggling to keep costs under control [1–3]. There are valid concerns about the rationality of use of medicines, mostly as a result of inappropriate physician prescribing. Physicians’ prescribing is the most common medical intervention with a high impact on health care costs . Improving and promoting rational use of medicines contributes to a more efficient use of meager health care resources, as well as ensuring better population health outcomes.
Changing prescriber behavior is difficult and may require complex multilayered interventions . Such interventions may include using audit and feedbacks, dissemination of printed educational materials, educational outreach visits, reminders, and opinion leaders among others [6, 7]. Implementing the multilayered intervention is more costly and resource intensive. Hence, it is important to identify easy to implement an effective intervention to improve physicians’ prescribing. Several studies have been conducted to develop interventions and strategies to improve prescribing [8–13] but most of them have been carried out in high-income countries, sometimes with conflicting results . Only limited high quality studies exist from low and middle-income countries.
According to a Cochrane Review, audit and feedback is defined as a summary of health care performance over a specified period of time with or without recommendations for a clinical action . Evidence from 118 randomized controlled trials indicated that audit and feedback resulted in a modest improvement in care . Grimshaw and colleagues  undertook a comprehensive review of the effects of using different strategies for implementing guidelines. They found that audit and feedback alone or combined with educational meetings and materials result in a modest improvement in the implementation of guidelines in comparison to no intervention group. Furthermore the studies on assessing the effectiveness of printed educational materials indicated only a small impact on practice, but there was no reliable assessment of the cost effectiveness of such programs. As the small benefits from dissemination of printed educational materials are achieved at relatively low costs, they may still be worthwhile interventions [17, 18].
In Iran for many years, the problems of irrational drug use have been investigated by academic members of several universities [19–24]. In 1996, the National Committee of Rational Use of Drug (NCRUD) was established and a formal process of assessing physician prescribing started in the country. To make this possible, different data sources were developed that included a central data warehouse as well as access to insurance organization prescription datasets. Also different interventions including audit and feedbacks, dissemination of printed educational materials, public education and workshops and conferences were employed. Although these national plans were not subjected to formal evaluations, descriptive assessments suggest that they may have resulted in improving prescribing behavior, including a descending trend in the mean medicine items per prescription as an important indicator for rational drug use [25, 26]. So far, no systematic and scientific evaluation has been conducted to determine the effectiveness and cost effectiveness of audit and feedback interventions in Iran. This trial is designed to test three different interventions for improving rational drug use indicators of general physicians, pediatricians and infectious disease specialists.
Does the routinely conducted prescribing audit and feedback intervention influence general physicians, pediatricians and infectious disease specialists prescribing behavior in comparison to printed educational materials and no intervention?
Does a revised audit and feedback intervention improve prescribing behavior compared to the routinely conducted prescribing audit and feedback, printed educational materials and no intervention? At the same time, we evaluated cost-effectiveness of the interventions compared to the control groups.
Population and setting
The target population included general physicians, pediatricians and infectious disease specialists who have an outpatient practice in Tehran, and have a current contract with at least one of the two main social health insurance organizations.
Details of the interventions
Average medicine items per prescription
Average price per prescription (IR Rials)
Proportion of prescriptions including one medicine item (%)
Proportion of prescriptions including four or more medicine items (%)
Maximum medicine items in a prescription
Proportion of injectable medicine items per all prescribed items (%)
Proportion of prescriptions that includes at least one injectable medicine item (%)
Consequently, the prescription indicators for important drug groups such as antibiotics, corticosteroids and NSAIDs will be reported. These groups will be chosen based upon common prescribing problems in any given area. Moreover, the list of 10 most-prescribed drugs and 10 first most expensive drugs are reported in separate tables. Finally, 10 important drug interactions with high severity and intensity in the physician’s prescriptions are reported .
The revised audit and feedback has been developed for this trial based on current drug use problems in Iran. We developed our intervention based on four inputs: the current audit and feedback, a literature review, interviews with physicians, and the theoretical justifications acquired from the Theory of Planned Behavior (TPB).
We conducted a literature review to obtain feedback’ samples from other countries  and identifying current and important drug prescribing problems in our country [25, 26]. Face-to-face interviews were conducted with16 physicians.
Average medicine items per prescription
Average price per prescription (IR Rials)
Proportion of prescriptions including four or more medicine items (%)
Proportion of prescriptions that includes at least one injectable medicine item (%)
Proportion of prescriptions that includes at least one antibiotic medicine item (%)
Proportion of prescriptions that includes at least one corticosteroid medicine item (%)
In the second page, table of the most prescribed antibiotics in the country as prescribed by each physician are reported. Then, a graph reports all antibiotics prescribed by a physician and his/her peer group according to differentiate seasons. At the bottom of the second page, two important practice points related to prescribing antibiotics are presented.
Table of prescription amount of most prescribed systemic corticosteroids in the country as prescribed by the physician are presented on the third page. Then, a graph reports all injectable forms of medicines prescribed by the physician and compares it with his/her peer group. At the bottom of the third page, two important practice points related to prescription of injectable forms of medicines and corticosteroids are presented.
Printed educational material (pamphlet)
The educational material was also developed using literature review, interviews with physicians, with theoretical attentions based on the TPB. Most physicians participating in the interviews emphasized on the usefulness of a concise pamphlet with a practical training content. Hence, a 4-page A5 size pamphlet was designed. The pamphlet provides practical tips on prescribing antibiotics, corticosteroids and injectable dosage forms and the current status of utilization of these medicines in the country. It also documents examples of serious adverse effects reported from inappropriate usage of ceftriaxone injections and serious complications after dexamethasone injections.
Study setting and participants
The study is conducted in Tehran. All general physicians, pediatricians and infectious disease specialists who have an outpatient practice in Tehran, issue a minimum of 100 prescriptions per month, and have a current contract with at least one of the two main social health insurance organizations are eligible for inclusion in the study.
Sample size calculation and allocation to the intervention arms
Considering that about 14% of outpatient prescriptions in Tehran contain dexamethasone injections and expecting that the intervention may reduce such prescriptions by 10%, we aimed to recruit 200 participants in each study arm (i.e. a total 800 participants).
As the interventions will be delivered to all the physicians allocated to the study arms (effectiveness trial) and that we used routinely collected data to assess the effects, the prospect of loss to follow was low.
To allocate the participants to the study arms, we first prepare a list of all eligible physicians working in Tehran (about 6000 physicians). The physicians will be grouped into the three physician groups (i.e. general physicians, pediatricians, infectious disease specialists). Within each group we will randomly select the required number of physicians, proportional to the size of each group. Using a random number generator, the participants will be allocated to the study arms, and use the physician group and the contracted insurance organization as the stratifying factors. As a result we will have, in each study arm, 175 general physicians, 24 pediatricians, and four infectious disease specialists (totaling 203 physicians in each arm). Random numbers will be generated by a member of the team who is not involved in the delivery of the interventions.
The main outcome measures for assessing the effectiveness of the interventions, the percentage of change in the proportion of dexamethasone injectable form, oral form of cefixime and amoxicillin which prescribed by general physicians, pediatricians and infectious disease specialists will be considered.
Costs are assessed from a health care provider perspective. We include all identifiable costs related to the implementation of the interventions. Our analysis therefore focuses on the incremental costs of developing and implementing audit and feedback and printed educational material interventions. Recurring and non-recurring costs are considered. Nonrecurring costs include revising the computer software and designing the new format of the feedback, and the pamphlet. Recurring costs include printing materials, travel costs, postage costs and other administrative tasks.
Study procedures and data collection
Data at baseline, one month and 3 months after the intervention will be collected.
Statistical and cost-effectiveness analyses
Demographic and baseline analyses will be conducted to ensure random allocation procedure has been effective in producing comparable study arms. Chi-square, t-test, repeated measure ANOVA and logistic regression analyses will be the primary modes of analyzing the results. As the primary outcomes, we will assess the effects of the study arms on the proportion of prescriptions containing each of the target prescribed medicines. We will also assess the effects of the interventions on the mean cost per prescription, and the mean number of items prescribed per prescription. Appropriate interaction analyses will be conducted to assess the interactions between the selected variables and the interventions. A fixed-effect two-level analysis approach will be followed in which prescriptions will be used as the first level and the physicians as the second level of data.
Cost data will be assessed using the actual costs incurred in the study, from a health care provider view point. Incremental cost-effectiveness ratios will be calculated and sensitivity analyses will be also conducted to assess the effects of changes in important variables in the cost-effectiveness of the interventions.
Intention-to-treat analyses will be carried out with physicians as the primary analysis approach. We will also conduct a per protocol analysis as a sensitivity analysis.
These data have been extracted from the Health Insurance Organization claims database and are provided confidentially for each physician for personal review. This study was approved by the Ethics Committee of Pharmaceutical Sciences Research Center of TUMS and has been registered with the Center for International Registration of Clinical Trial.
A thorough evaluation of the intervention for improving and promoting rational drug use may bring important benefits, whereas inappropriate prescribing may lead to undesirable consequences. We see this trial as a necessary prerequisite for the development and implementation of a cost-effective intervention that will improve and promote rational drug use in Iran.
This study will determine the effectiveness of the three interventions, and allow us to determine what kind of intervention will be the most effective in improving prescribing pattern. This work will be the first to assess the effectiveness and cost-effectiveness of the routinely conducted audit and feedback that has been widely used in the country.
The risk of contamination between the study arms is a potential limitation of the study. However as the study sample is selected from a large number of physicians working in Tehran, the risk of contamination should be small. Additional potential limitation of the study may arise due to concurrent interventions that might happen by the responsible authorities within the Ministry of Health and Medical Education, as well as the universities in charge of health care in Tehran. We will follow such activities throughout the study, and will assess their potential impacts on the study findings, if they occur.
We believe that the current proposal may have other benefits. We expect that it will lead to the development of focused interventions that could greatly promote rational drug use. Changing physician’s behavior is challenging and involves attention to the views and concerns of practicing physicians. We attended to the physicians’ views while developing our interventions. In addition, this trial shall establish whether the design of targeted feedback can be used as a novel format of interventions for promoting rational drug use. We hope that, if our interventions are cost-effective, they shall be widely applied nationwide. The interventions may also be of use in middle income countries with appropriate infrastructures.
We thank the assistance of Ahmadali Mostoufi for his technical support in designing the presentational formats of the interventions.
The study is the PhD thesis of the first author and has been supported by the Faculty of Pharmacy and in the meantime as a project in TUMS with number of 90-03-33-14661.
- Lexchin J: Improving the appropriateness of physician prescribing. Int J Health Serv. 1998, 28: 253-267. 10.2190/ABWY-YFPA-ME5R-7BQP.View ArticlePubMedGoogle Scholar
- Bloor K, Freemantle N: Lessons from international experience in controlling pharmaceutical expenditure. II: influencing doctors. BMJ. 1996, 312: 1525-1527. 10.1136/bmj.312.7045.1525.PubMed CentralView ArticlePubMedGoogle Scholar
- Beilby JJ, Silagy CA: Trials of providing costing information to general practitioners: a systematic review. Med J Aust. 1997, 167 (2): 89-92.PubMedGoogle Scholar
- Lopez Bastida J, Mossialos E: Pharmaceutical expenditure in Spain: cost and control. Int J Health Serv. 2000, 30: 597-616. 10.2190/YL3J-QK9B-0NMQ-KMVK.View ArticlePubMedGoogle Scholar
- Madridejos-Mora R, Amado-Guirado E, Teresa Pe’rez-Rodrı’guez M: Effectiveness of the combination of feedback and educational recommendations for improving drug prescription in general practice. Med Care. 2004, 42: 643-648. 10.1097/01.mlr.0000129495.43422.58.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.View ArticleGoogle Scholar
- Wensing M, van der Weijden T, Grol R: Implementing guidelines and innovations in general practice: which interventions are effective?. Br J Gen Pract. 1998, 48: 991-997.PubMed CentralPubMedGoogle Scholar
- Psaty BM, Smith NL, Siscovicd DS, Koepsell TD, Weiss NS, Heckbert SR: Health outcome associated with antihypertensive therapies used as first-line agents: a systematic review and meta-analysis. JAMA. 1997, 277: 739-745. 10.1001/jama.1997.03540330061036.View ArticlePubMedGoogle Scholar
- Wright JM, Lee C-H Chimbers GK: Systematic review of antihypertensive therapies: does the evidvnce assist in choosing a first-line drug. CMAJ. 1999, 161: 25-32.PubMed CentralPubMedGoogle Scholar
- Messerku FH, Grossman E, Goldbourt U: Are betablockers efficacious as first-line therapy hypertension in the elderly? A systematic review. JAMA. 1998, 279: 1903-1907. 10.1001/jama.279.23.1903.View ArticleGoogle Scholar
- Packer M, Bristow MR, Cohn JN, Colucci WS, Fowler MB, Gilbert EM: The effect of carvedilol on morbidity and mortality in patients with chronic heart failure. US Carvedilol Heart Failure Study Group. NEJM. 1996, 334: 1349-1355. 10.1056/NEJM199605233342101.View ArticlePubMedGoogle Scholar
- Scandinavian Simvastatin Survival Study Group: Randomised trial of cholesterol lowering in 4444 patients with coronary heart disease: the Scandinavian Simvastatin Survival Study (4S). Lancet. 1994, 344: 1383-1389.Google Scholar
- Shepherd J, Cobbe SM, Ford I, Isles CG, Lorimer AR, MacFarlane PW: Prevention of coronary heart disease with pravastatin in men with hypercholesterolemia. West of Scotland coronary prevention study group. NEJM. 1995, 333: 1301-1307. 10.1056/NEJM199511163332001.View ArticlePubMedGoogle Scholar
- Hogerzeil HV: Promoting rational prescribing: an international perspective. Br J Clin Pharmacol. 1995, 39: 1-6. 10.1111/j.1365-2125.1995.tb04402.x.PubMed CentralView ArticlePubMedGoogle Scholar
- Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2006, 3: CD000259-Google Scholar
- Grimshaw JM: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. iii–ivView ArticleGoogle Scholar
- Freemantle N, Harvey EL, Wolf F, Grimshaw JM, Grilli R, Bero LA: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000, 2: CD000172-PubMedGoogle Scholar
- Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, Makosso-Kallyth S, Wolf FM, Farmer AP, Gagnon MP: Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 10.1002/14651858.CD004398.pub3. Issue 10. Art. No.: CD004398Google Scholar
- Cheraghali AM, Soleymani F, Behmanesh Y, Hbibipour F, Ismaeilzadeh A, Nikfar S, Rahimi W: Physicians’ Attitude toward Injectable Medicines. J Pharmacol Toxicol. 2006, 1 (1): 33-39.View ArticleGoogle Scholar
- Nikfar S, Kebriaeezadeh A, Majdzadeh R, Abdollahi M: Monitoring of National Drug Policy (NDP) and its standardized indicators; conformity to decisions of the national drug selecting committee in Iran. BMC Int Health Hum Rights. 2005, 5: 5-5. 10.1186/1472-698X-5-5.PubMed CentralView ArticlePubMedGoogle Scholar
- Garjani A, Salimnejad M, Shamsmohamadi M, Baghchevan V, Vahidi RG, Maleki-Dijazi N, Rezazadeh H: Effect of interactive group discussion among physicians to promote rational prescribing. East Mediterr Health J. 2009, 15 (2): 408-415.PubMedGoogle Scholar
- Cheraghali AM, Nikfar S, Behmanesh Y, Rahimi V, Habibipour F, Tirdad R, Asadi A, Bahrami A: Evaluation of availability, accessibility and prescribing pattern of medicines in the Islamic Republic of Iran. East Mediterr Health J. 2004, 10 (3): 406-415.PubMedGoogle Scholar
- Sepehri G, Meimandi MS: The quality of prescribing in general practice in Kerman, Iran. Int J Health Care Qual Assur. 2005, 18 (5): 353-360. 10.1108/09526860510612207.View ArticleGoogle Scholar
- Cheraghali AM, Soleymani F, Shalviri G: Promoting rational use activities in Iran: a successful trend. Essential Drugs Monitor. 2003, 33: 10-11.Google Scholar
- Soleymani F, Valadkhani M, Dinarvand R: Challenges and achievements of promoting Rational Use of Drug in Iran. Iran J Public Health. 2009, 38 (Suppl 1): 166-168.Google Scholar
- Soleymani F, Abdollahi M: Management information system in promoting rational drug use. Intl J Pharmacol. 2012, 8 (6): 586-589. 10.3923/ijp.2012.586.589.View ArticleGoogle Scholar
- Wickersham RM, Novak KK: managing eds: Drug Facts and Comparisons. 2005, St. Louis MO: Wolters Kluwer Health pressGoogle Scholar
- Canadian Agency for Drugs and Technologies in Health 2008: Audit and feedback on prescribing practices: a guide for decision makers in Canada. 2008, Ottawa: CADTHGoogle Scholar
- Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.View ArticleGoogle Scholar
- Rashidian A, Miles J, Russell D, Russell I: Sample size for regression analyses of theory of planned behavior studies: case of prescribing in general practice. Brit J Health Psychol. 2006, 11 (4): 581-593. 10.1348/135910705X66043.View ArticleGoogle Scholar
- Rashidian A, Russell I: Intentions and statins prescribing: can the Theory of Planned Behavior explain physician behavior in following guideline recommendations?. J Eval Clin Pract. 2011, 17: 749-757. 10.1111/j.1365-2753.2011.01690.x.View ArticlePubMedGoogle Scholar
- Rashidian A, Russell I: General practitioners’ intentions and prescribing for asthma: using the Theory of Planned Behavior to explain guideline implementation. Int J Prev Med. 2012, 3 (1): 17-28.PubMed CentralPubMedGoogle Scholar
- Rashidian A, Eccles Martin P, Russell I: Falling on stony ground? A qualitative study of implementation of clinical guidelines’ prescribing recommendations in primary care. Health Policy. 2008, 85 (2): 148-161. 10.1016/j.healthpol.2007.07.011.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.