|Year : 2015 | Volume
| Issue : 4 | Page : 264-271
Appraisal of maternity management and family planning guidelines using the agree II instrument in India
Devendra B Sonawane1, Shilpa S Karvande2, Francoise A Cluzeau3, Sandeep A Chavan1, Nerges F Mistry4
1 Research Associate, Foumdation for Research in Community Health, Pune, Maharashtra, India
2 Research Officer, Foumdation for Research in Community Health, Pune, Maharashtra, India
3 Associate Director, NICE International, National Institute of Health and Care Excellence (NICE), United Kingdom
4 Director, Foumdation for Research in Community Health, Pune, Maharashtra, India
|Date of Web Publication||17-Nov-2015|
Nerges F Mistry
3-4 85, Trimiti B Apartment, Anand Park, Aundh, Pune - 411 007, Maharashtra
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Introduction: Guideline development gathered pace in India after the inception of National Rural Health Mission (NRHM) in 2005. However, there is a lack of adequate information about guideline development process, review, and update. This paper reports on the systematic appraisal of Indian guidelines related to maternity management (MM) and family planning (FP) using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument, which was one of the components of a pilot research in 2012-13. Materials and Methods: Forty-four selected guidelines about MM and FP, identified through a consensus building workshop, were independently appraised by two appraisers with AGREE instrument having six different domains. Mean item scores, domain scores, and standardized scores were calculated by averaging the scores across the two appraisers. Results: Most guidelines scored high in scope and purpose and clarity of presentation. However, they had little documentation about the development group member details, incorporation of patient views, evidence search method, method chosen for formulating recommendations, tools for application, potential barriers, cost implications, and information about the funding body. Nonclinical guidelines scored higher than clinical guidelines (P = 0.01) for MM in the domain applicability. Clinical FP guidelines scored higher than nonclinical guidelines in the domain of rigor of development (0.01). Conclusion: Despite being clinically sound, Indian guidelines score poorly due to weak documentation about their development process. It is recommended that the guideline development process be improved with systematic documentation for achieving standardization.
Keywords: Guideline appraisal, guidelines, maternity management (MM) guidelines
|How to cite this article:|
Sonawane DB, Karvande SS, Cluzeau FA, Chavan SA, Mistry NF. Appraisal of maternity management and family planning guidelines using the agree II instrument in India. Indian J Public Health 2015;59:264-71
|How to cite this URL:|
Sonawane DB, Karvande SS, Cluzeau FA, Chavan SA, Mistry NF. Appraisal of maternity management and family planning guidelines using the agree II instrument in India. Indian J Public Health [serial online] 2015 [cited 2020 Jul 8];59:264-71. Available from: http://www.ijph.in/text.asp?2015/59/4/264/169651
| Introduction|| |
Progress in medical science is evolving. In response to the rapid advances in biomedical science, technology, and diagnostic criteria, clinical practice guidelines (CPGs) that will hereafter be referred to as guidelines help health care providers to make informed decisions about optimum treatment for patients. , They provide recommendations about best practice based on evidence. ,, Numerous national and international professional bodies, educational institutes, and government agencies have developed guidelines covering specialty-specific topics including issues of public health importance in respective geographical areas. 
The pursuit of equity and quality in health and health care has gained momentum recently in India and formed the guiding basis of national health policy. , However, fewer efforts were made in achieving generalization of quality health services until 2005.  With the inception of the National Rural Health Mission (NRHM) , health care in India started to change rapidly. The move toward Universal Health Care (UHC) , and expansion of health insurance coverage  and health financing , have prompted the need to improve quality care including the use of standardized guidelines.
Maternal health is an important focus of NRHM as a part of its commitment to meet the millennium development goals (MDGs).  Several guidelines, manuals, and reference materials focusing on maternal health have been developed to enhance the quality of antenatal care, safe delivery, perinatal care and to avert maternal deaths.  Guidelines have also been developed in family planning  (FP) in an effort to cover the high unmet need of the community and to improve the quality of services.  However, to date there is no information available on the research, evidences, or experiences underpinning the development of guidelines in India. Given the potential impact of such documents and their direct synergy with the quality in health care and medical education, it is crucial to appraise the available guidelines, especially in the domain of maternity management (MM) and FP. This paper reports on an attempt to conduct a systematic assessment of Indian guidelines related to MM and FP, using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument. The AGREE II instrument has been validated widely and is considered as the gold standard for assessing the quality of guidelines. ,,,
| Materials and Methods|| |
Searching Indian guidelines
The NRHM and Ministry of Health and Family Welfare (MOHFW) website  were searched for guidelines related to pregnancy, skilled birth attendance, and FP. Additionally, guidelines developed by several nongovernment professional bodies , were accessed through their web portals. Nondigital copies of some guidelines were obtained from the authors.
Selecting priority clinical areas for guidelines
At a workshop organized by the Foundation for Research in Community Health at Mumbai, Maharashtra, India in 2012, senior obstetricians and public health researchers from different parts of India agreed on priority clinical areas of maternal care for selecting guidelines for appraisal. These included anemia, malaria in pregnancy, eclampsia, sepsis, postpartum hemorrhage (PPH), and referrals. Guidelines covering these key clinical conditions and FP were prioritized. Documents/guidelines pertaining to selected clinical areas developed by Indian agencies after 2000 that were available in the public domain were selected for appraisal. Documents in the form of circular, memos, checklists, government orders but labeled as "guidelines" were excluded.
During the workshop, the National Institute of Health and Care Excellence (NICE), International, UK provided technical assistance for assessing guidelines through the AGREE II Instrument. Participants learnt how to use the instrument using real guidelines and including qualitative comments based on their observations.
Following the workshop, a guideline appraisal advisory group was formed involving eight obstetricians including three from India, four from the UK, and one from the USA. The UK obstetricians were affiliated to the Royal College of Obstetrics and Gynaecology. Four public health researchers from India and one member of NICE International also participated in the appraisal.
As per the AGREE II recommendation, repeated attempts were made to contact the guideline authors to seek additional information about guideline development process; however, only one author responded with details. The selected guidelines were randomly distributed among the appraisers and each guideline was examined by two independent appraisers which was a prerequisite of AGREE II to ensure the reliability of guideline assessment. The appraisers had declared conflicts of interest regarding their nonparticipation in the development of the selected guidelines before undertaking their assessment. The AGREE II user manual served as a reference document for the appraisers.
The AGREE II instrument
The original AGREE instrument published in 2003 and designed by the AGREE collaboration aimed at assessing the process of guideline development and reporting.  It was revised in 2010 by the AGREE Next Consortium (AGREE II) through extensive research and psychometric testing, extending the response scale to a 7-point Likert scale instead of a 4-point scale.  The AGREE II comprises 23 items organized into six domains:
- Scope and purpose
- Stakeholder involvement
- Rigor of development
- Clarity of presentation
- Applicability, and
- Editorial independence.
The scores ranged from 1 (strongly disagree) to 7 (strongly agree), based on the completeness and quality of reporting. A score of 7 is given for exceptional quality and fulfillment of all criteria of AGREE II manual. A score of 1 is given for missing or poorly reported information. A score between 2 and 6 is assigned based on availability of information in the ascending order. In addition to the six domains, a 3-point scale (1 = not recommended, 2 = recommended with provision or modifications, and 3 = strongly recommended) provides an overall judgement on the potential use of the guideline. 
In this study the appraisers' scores for each item were collated and analyzed. Standardized domain scores (expressed on 0-100 scale) were calculated as using the AGREE II method [(obtained score- minimum possible score)/(maximum possible score-minimum possible score) * 100]. AGREE II neither recommends the usage of a threshold for acceptance of a guideline and nor does it advocate aggregating the domain scores. Instead, it recommends reporting the standardized score for each of the six domains. The standardized domain scores were compared regarding the different characteristics by applying Mann-Whitney U test.  Statistical Package for the Social Sciences (IBM Corp. Released 2013. IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp.) was used for statistical analysis and P value < 0.05 was considered as significant. Intraclass correlation coefficient (ICC) was used as a measure of agreement between two appraisers with values above 0.7 as strong agreement, 0.4-0.6 as moderate agreement, and less than 0.4 as poor agreement among appraisers.
| Results|| |
Profile of the guidelines
A total of 91 documents related to MM and FP were identified through a wide search of all possible national sources from June 7, 2012 to September 3, 2013. Forty-four guidelines met the inclusion criteria, out of which 30 were related to MM and 14 related to FP [Table 1]. Most of the excluded guidelines did not have background information about their development, which made their assessment with AGREE II unfeasible.
All except two guidelines were developed after 2005 (post-NRHM). The agencies that developed them were MOHFW (30 guidelines), nongovernment professional bodies (seven guidelines), health departments of selected states (five guidelines), and private hospitals (two guidelines). There were 20 clinical and 24 clinico-managerial guidelines, respectively. The clinical guidelines covered MM (14) and FP (six) targeting end-line users such as doctors including obstetric consultants, medical officers at Primary Health Centre (PHC) level, staff nurses, and auxiliary nurse midwives (ANMs) etc. The clinicomanagerial guidelines covered MM (16) and FP (eight) targeting primarily policy makers, program managers, and training institutes. Notably, 10 guidelines did not have any reference about their target users.
Evaluation of the AGREE II domains of appraised guidelines
The overall quality of the selected guidelines varied considerably, both within and across the six domains of AGREE II [Figure 1]. The result depicted in each bar of the [Figure 1] represents the 75th (Q3) and 25th (Q1) percentile (interquartile range). The band near the middle of the bar represents the median. A small dot (o) represents outliers and (*) represents extreme outliers.  There were also score variations between the groups of guidelines, i.e., MM and FP, which is detailed here.
|Figure 1: Comparison of the standardized AGREE domain scores for maternity management and family planning guidelines|
Click here to view
The mean score for the first domain of scope and purpose was 70 [standard deviation (SD) 19.5] for MM guidelines and 70 (SD 22.7) for FP guidelines, indicating that there was a clear mention about the objective of the document and target population in both groups of guidelines [Figure 1].
The mean score for the second domain of stakeholder involvement was 40.3 (SD 17.2) for MM guidelines and 43 (SD 25) for FP guidelines. This indicates an overall moderate level of documentation about the experience, involvement, roles, and responsibilities of members of guideline development groups as well as inclusion of patients' views as one of the key stakeholders.
The mean score for the third domain of rigor of development was 17 (SD 12.2) for MM guidelines and 23 (SD 14) for FP guidelines. There was an extreme outlier in the MM guidelines' rigor of development domain score [refer to [Figure 1], which might be the reason behind the closeness of mean and SD for MM guidelines. There was no such outlier in FP guidelines, indicating the possibility of most of the scores being clustered around the mean. This was one of the two domains that scored the lowest in the guidelines of both the groups. In other words, most of the selected guidelines lacked information about a systematic method for the search of evidence, criteria for selecting evidence, method for consensus-building, discussion about health benefits and side effects, external review of guideline, and procedure for updating guideline.
The mean score for the fourth domain of clarity and presentation was 77.2 (SD 16.8) for MM guidelines and 69.6 (SD 22.1) for FP guidelines. Similar to the first domain of scope and purpose, most of the selected guidelines were rated high for this domain. These guidelines presented clarity in recommendations, different options for the management of health conditions, and tools for the application of recommendations.
The mean score for the fifth domain of applicability was 46.1 (SD 18.2) for MM guidelines and 50.7 (SD 17.5) for FP guidelines. There was inadequate information about potential organizational barriers and cost implications of the recommendations. Additionally, there was insufficient mention regarding the review criteria for the monitoring and auditing of suggested recommendations to ensure quality.
The mean score for the sixth domain of editorial independence was 6.8 (SD 9.3) for MM guidelines and 17.5 (SD 15.4) for FP guidelines. This was the second domain that scored the lowest in the guidelines of both the groups. Information about the funding bodies and conflict of interest of guideline development group members was missing in almost all the selected guidelines.
Overall, most of the Indian guidelines for MM and FP demonstrated relatively better documented information about the scope and objectives of the guidelines and clarity in presentation of all recommendations.
AGREE II domain scores
Domain scores were further analyzed across various characteristics of guidelines.
In case of MM guidelines, clinicomanagerial guidelines scored significantly higher as compared to clinical guidelines (P value = 0.01) for the domain of applicability because they presented more details about facilitators and barriers for implementation of recommendations as well as discussed the cost implications of suggested recommendations. The MM guidelines developed by other professional bodies have significantly scored high as compared to the government guidelines (P value = 0.03) in the domain of rigor of development, as they included relatively more information about evidence search and review process. However, the year of development of the guidelines did not have any significant relation with any of the six domains of guideline appraisal [Table 2].
|Table 2: Standardized AGREE domain scores (mean and median) of maternity management guidelines with different characters expressed as percentage (values represents the median compared as per the characteristics of Mann-Whitney U test)|
Click here to view
In FP guidelines, clinical guidelines scored significantly high as compared to clinicomanagerial guidelines for the domain of rigor of development (P value = 0.02) since they included relatively more details about the information on evidence search, review process, and criteria for selecting evidence. However, the development agency as well as year of development of guideline did not have any significant relation with any of the six domains of guideline appraisal [Table 3].
|Table 3: Standardized AGREE domain scores (mean and median) of family planning guidelines with different characters expressed as percentage (values represents the median compared as per the characteristics of Mann-Whitney U test)|
Click here to view
Of the total 44 selected guidelines, two guidelines were strongly recommended by the reviewers without any provision or modification; Six guidelines received a comment of not being recommended due to gaps in the background information and clarify of recommendations while the remaining 36 guidelines were recommended with modifications. This indicates that despite the relatively moderate low scores on application of AGREE II across various domains, some guidelines had the potential to be recommended with modifications.
Agreement among appraisers regarding the recommendation of MM-related guidelines was low (ICC-0.269); however, appraisers had a moderate level of agreement while recommending FP guidelines (ICC-0.606). At the domain level, stakeholder involvement had the highest level of agreement ICCs 0.750 and 0.881 for MM and FP guidelines, respectively. Additionally, there was strong agreement among appraisers with regard to the domain scope and purpose (0.717) for FP guidelines. The disagreement between the appraisers in some domains might be due to the challenge in interpretation of the review point, for example, in "Guidelines for home delivery of emergency contraceptive pills by ASHA workers" there may be differential assumptions on what should be the pivotal health question - home delivery of contraceptives or emergency contraceptive pill. Accordingly, the scores could differ for the same item under appraisal. Such a disagreement would probably be minimal in case of exclusively clinical guidelines where the health question would be more explicit as compared to any operational or mixed type of guideline.
| Discussion|| |
To our knowledge this is the first time Indian guidelines have been appraised using an internationally validated approach. The important finding of the study is that although the number of guidelines in maternal care and FP has increased since the inception of NRHM, these are still few (clinical 30) as recorded by the study. This suggests that there is a need for developing new guidelines on various prevalent clinical conditions related to MM and FP and increasing their accessibility in the public domain.
The results indicate that selected guidelines scored very low in the domains of rigor of development and editorial independence. This compares with Korean guidelines,  which similarly failed to provide information on rigor of guideline development. A guideline becomes obsolete within a period of 3-4 years,  thus the validity of all guidelines should be reevaluated every 3 years, one of the key components under the domain of rigor of development. The second domain with the lowest scores, editorial independence, includes recording conflict of interest of guideline development group members and influence of a funding body. Conflict of interest (COI) is an important potential source of bias in the development of guidelines. , Practices for declaring COI, association with the industry, and the funding body need be promoted in guideline development.
An appraisal study conducted in Argentina questioned the relevance or application of the AGREE II tool in the national guidelines in low- and middle-income countries,  arguing that the AGREE II standard may be too high for these countries.  However, this assumption does not entirely hold true in the Indian context as Indian guidelines present differential strengths across the six domains and have definite scope for further improvement in the domains of stakeholders' involvement, editorial independence, and applicability. It is important to note that the appraisers in this study, despite giving a particular guideline the score of "low" for various domains, recommend the same guidelines for further use with some modifications. As per AGREE II ,this process of appraisal should not be considered as a comprehensive evaluation of a particular guideline but an attempt to appraise guidelines regarding various characteristics; it is not about labeling any guideline "good" or "bad."
This study has some limitations. First, the lack of a dedicated guideline database or electronic repository may have limited the access to Indian guidelines, raising a possibility that some important guidelines have been missed. At the international level, the United States National Guideline Clearinghouse website hosts 2,216 guidelines related to various diseases, 549 specifically about female urogenital diseases and pregnancy complications.  NICE UK has 41 guidelines related to pregnancy care that are available on a single web portal. Second, the assessment is based on documented information about the guideline development process, indicating the fact that systematic development of guidelines is not sufficient but has to be supported with a systematic documentation of the development process. Given the lack of documentation in the guidelines appraised, it is difficult to be certain of their intrinsic quality.
There should be a robust process for developing guidelines with a thrust on documentation in line with international standards, ,, for example, NICE UK guidelines are explicitly based on openness and inclusiveness. The NICE process involves setting up advisory groups that bring together technical expertise and relevant "lay" or service user experience. Such activity brings strengths in terms of plurality of experiences, perspectives, and backgrounds to inform evidence-based recommendations.  Similar experiences from international organizations could provide a useful basis for developing a guideline development process in India.
Roadmap for guideline development in India
Establishing or nominating an independent national agency for guideline development, implementation, and monitoring housed within the Directorate of Health Services could be an option in strengthening guidelines in India. Involving stakeholders from the group of care givers, nurses, and users in the development process will improve the quality and inclusiveness of guidelines. The scope of guidelines should be broadened to cover varied clinical conditions and operational or health system issues. Development of clinical guidelines should be a central mandate to safeguard standardized and evidence based clinical care; the development of operational guidelines should be prioritized by state level policy makers according to local needs and priorities. These may not need to be developed de novo and can be adapted from existing nationally or internationally recognized guidelines. 
Adherence and down streaming
Guideline development is a step toward quality instillation with adherence and downstreaming being the crucial aspects of ensuring quality. Hence, adherence to guidelines should be prioritized through national health policy and strengthened by relevant regulations. Additionally, guidelines should be embedded as teaching tools in medical and paramedical education to inculcate the value of evidence-based practice. This attempt at appraising guidelines has thrown light on various aspects of guideline development and the prerequisites for their implementation in the Indian context.
The authors acknowledge the generous support received from Population Foundation of India, New Delhi, Delhi, India and Tata Steel, Jamshedpur, Jharkhand, India. Additionally, the authors would like to express their special thanks to the clinicians and public health professionals who participated in the process of guideline appraisal. They would also like to express their gratitude to Ms. Shimoni Shah for her guidance in suggesting leads for data analysis.
Financial support and sponsorship
Financial support for the study was provided by the organizations mentioned below.
- Population Foundation of India, New Delhi, Delhi, India.
- Tata Steel, Jamshedpur, Jharkhand, India.
Conflicts of interest
Francoise Cluzeau was a member of the research team that designed the AGREE II instrument. The other authors declare that they do not have any competing interests.
1*Accredited Social Health Activist (ASHA) - A woman developed as a community health worker in the NRHM since 2005, selected from the village itself and accommodation to it, the ASHA has been trained as a link worker between her community and Public Health System.
2†India has 29 States and 7 Union Territories. Each state looks after the local administration within the framework of Constitution of India. Health being the responsibility of State, health programs is prioritized as per state priorities.
| References|| |
Weisz G, Cambrosio A, Keating P, Knaapen L, Schlich T, Tournay VJ. The emergence of clinical practice guidelines. Milbank Q 2007;85:691-727.
Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E. Clinical Practice Guidelines We Can Trust. USA: Institute of Medicine (USA), The National Academies Press; 2011. p. 15-28.
Vernooij RW, Sanabria AJ, Solà I, Alonso-Coello P, Martínez García L. Guidance for updating clinical practice guidelines: A systematic review of methodological handbooks. Implement Sci 2014;9:3.
Solà I, Carrasco JM, Díaz Del Campo P, Gracia J, Orrego C, et al
. Attitudes and perceptions about clinical guidelines: A qualitative study with Spanish physicians. PLoS One 2014;9:e86065.
Ansari S, Rashidian A. Guidelines for guidelines: Are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One 2012;7:e49864.
Ghosh S. Equity in the utilization of healthcare services in India: Evidence from National Sample Survey. Int J Health Policy Manag 2014;2:29-38.
Taneja DK. National Rural Health Mission - a critical review. Indian J Public Health 2005;49:152-5.
Varkey P, Kollengode A. A framework for healthcare quality improvement in India: The time is here and now! J Postgrad Med 2011;57:237-41.
Lahariya C, Khandekar H, Prasuna J, Meenakshi. A critical review of National Rural Health Mission in India. The Internet Journal of Health 2006;6:1. Available from http://ispub.com/IJH/6/1/6287
. [Last Accessed on 2015 March 15].
Bisht R. Universal health care: The changing international discourse. Indian J Public Health 2013;57:236-41.
Peer RF. Right to healthcare: The way forward. J Family Med Prim Care 2013;2:4-8.
Kumar AK, Chen LC, Choudhury M, Ganju S, Mahajan V, Sinha A, et al
. Financing health care for all: Challenges and opportunities. Lancet 2011;377:668-79.
Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India′s Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: An impact evaluation. Lancet 2010;375:2009-23.
Devadasan N, Seshadri T, Trivedi M, Criel B. Promoting universal financial protection: Evidence from the Rashtriya Swasthya Bima Yojana (RSBY) in Gujarat, India. Health Res Policy Syst 2013;11:29.
Nath A. India′s progress toward achieving the millennium development goals. Indian J Community Med 2011; 36:85-92.
Nair H, Panda R. Quality of maternal healthcare in India: Has the National Rural Health Mission made a difference? J Glob Health 2011;1:79-86.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al
.; AGREE Next Steps Consortium. AGREE II: Advancing guideline development, reporting and evaluation in health care. CMAJ 2010;182:E839-42.
Oxman AD, Schünemann HJ, Fretheim A. Improving the use of research evidence in guideline development: 16. Evaluation. Health Res Policy Syst 2006;4:28.
Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D. A systematic review of appraisal tools for clinical practice guidelines: Multiple similarities and one common deficit. Int J Qual Health Care 2005;17:235-42.
AGREE Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: The AGREE project. Qual Saf Health Care 2003;12:18-23.
The Federation of Obstetric and Gynaecological Societies of India. FOGSI ICOG Good Clinical Practice Recommendations; [About 1 Screen]. Available from: http://www.fogsi.org/index.php
. [Last accessed on 2013 Dec 12].
Seshiah V, Sahay BK, Das AK, Shah S, Banerjee S, Rao PV, et al
. Gestational diabetes mellitus- Indian guidelines. J Indian Med Assoc 2009;107:799-802, 804-6.
Jo MW, Lee JY, Kim NS, Kim SY, Sheen S, Kim SH, et al
. Assessment of the quality of clinical practice guidelines in Korea using the AGREE Instrument. J Korean Med Sci 2013;28:357-65.
McCrum-Gardner E. Which is the correct statistical test to use? Br J Oral Maxillofac Surg 2008;46:38-41.
Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, et al
. Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: How quickly do guidelines become outdated? JAMA 2001;286:1461-7.
Norris SL, Holmer HK, Ogden LA, Burda BU, Fu R. Conflicts of interest among authors of clinical practice guidelines for glycemic control in type 2 diabetes mellitus. PloS One 2013;8:e75284.
Gasparyan AY, Ayvazyan L, Akazhanov NA, Kitas GD. Conflicts of interest in biomedical publications: Considerations for authors, peer reviewers, and editors. Croat Med J 2013;54:600-8.
Esandi ME, Ortiz Z, Chapman E, Dieguez MG, Mejía R, Bernztein R. Production and quality of clinical practice guidelines in Argentina (1994-2004): A cross-sectional study. Implement Sci 2008;3:43.
Bero LA, Hill S, Habicht J, Mathiesen M, Starkopf J. The updated clinical guideline development process in Estonia is an efficient method for developing evidence-based guidelines. J Clin Epidemiol 2013;66:132-9.
National Health And Medical Research Council, Australian Government. Resources for Guideline Developer′s Page. Available from: https://www.nhmrc.gov.au/guidelines-publications/information-guideline-developers/resources-guideline-developers. [Last accessed on 2014 Mar 6].
Atkins L, Smith JA, Kelly MP, Michie S. The process of developing evidence-based guidance in medicine and public health: A qualitative study of views from the inside. Implement Sci 2013;8:101.
[Table 1], [Table 2], [Table 3]
|This article has been cited by|
||Appraisal of clinical practice guidelines on the management of hypothyroidism in pregnancy using the Appraisal of Guidelines for Research and Evaluation II instrument
| ||Yuan Fang,Liang Yao,Jing Sun,Jian Zhang,Yanxia Li,Ruifei Yang,Kehu Yang,Limin Tian |
| ||Endocrine. 2018; |
|[Pubmed] | [DOI]|
||Clinical practice guidelines in India: Quality appraisal and the use of evidence in their development
| ||Soumyadeep Bhaumik,Soushieta Jagadesh,May Ellatar,Neeraj Kohli,Muhammad Riedha,Monday Moi |
| ||Journal of Evidence-Based Medicine. 2018; |
|[Pubmed] | [DOI]|
||What does quality of care mean for maternal health providers from two vulnerable states of India? Case study of Bihar and Jharkhand
| ||Shilpa Karvande,Devendra Sonawane,Sandeep Chavan,Nerges Mistry |
| ||Journal of Health, Population and Nutrition. 2016; 35(1) |
|[Pubmed] | [DOI]|