|ORIGINAL RESEARCH PAPER
|Year : 2012 | Volume
| Issue : 2 | Page : 116-123
An Educational International Partnership Responding to Local Needs: Process Evaluation of the Brazil FAIMER Regional Institute
E Amaral1, HH Campos2, S Friedman3, PS Morahan3, MNT Araujo2, PM Carvalho4, V Bollela5, MGF Ribeiro2, S Mennin6, AE Haddad7, F Campos8
1 State University of Campinas, Sao Paulo, Brazil
2 Federal University of Ceara, Ceara, Brazil
3 Foundation for the Advancement of International Medical Education and Research (FAIMER), Philadelphia, Pennsylvania, USA
4 Marilia Medical School, Sao Paulo, Brazil
5 Ribeirao Preto Medical School. State University of Sao Paulo, Brazil
6 University of New Mexico School of Medicine & Mennin Consultoria Em Saude Ltd., New Mexico, USA
7 State University of Sao Paulo, Sao Paulo, Brazil
8 Federal University of Minas Gerais, Minas Gerais, Brazil
|Date of Submission||12-Dec-2011|
|Date of Decision||17-Jul-2012|
|Date of Acceptance||13-Aug-2012|
|Date of Web Publication||14-Nov-2012|
State University of Campinas, Rua Alexander Fleming, 101, Campinas, Sao Paulo 13083-887
Source of Support: None, Conflict of Interest: None
Introduction: The Brazilian public health system requires competent professionals sensitive to the needs of the population. The Foundation for Advancement of International Medical Education and Research (FAIMER) provides a two-year faculty development programme for health professions educators, aiming to build leadership in education to improve health. A partnership with governmental initiatives and FAIMER was established for meeting these needs. This paper describes the initial process evaluation results of the Brazilian FAIMER Institute Fellowship (FAIMER BR). Methods: Data were analysed for the classes 2007-2010 regarding: application processes; innovation project themes; retrospective post-pre self-ratings of knowledge acquisition; and professional development portfolios. Results: Seventeen of 26 Brazilian states were represented among 98 Fellows, predominantly from public medical schools (75.5%) and schools awarded Ministry of Health grants to align education with public health services (89.8%). One-third (n = 32) of Fellows' innovation projects were related to these grants. Significant increases occurred in all topic subscales on self-report of knowledge acquisition (effect sizes, 1.21-2.77). In the follow up questionnaire, 63% of Fellows reported that their projects were incorporated into the curriculum or institutional policies. The majority reported that the programme deepened their knowledge (98%), provided new ideas about medical education (90%) and provided skills for conflict management (63%). One-half of the Fellows reported sustained benefits from the programme listserv and other communications, including breadth of expertise, establishment of research collaboration and receiving emotional support. Conclusion: Contributors to initial programme success included alignment of curriculum with governmental initiatives, curriculum design merging educational technology, leadership and management skills and central role of an innovation educational project responding to local needs.
Keywords: Faculty development, healthcare system, health professions education, leadership, programme evaluation
|How to cite this article:|
Amaral E, Campos H H, Friedman S, Morahan P S, Araujo M, Carvalho P M, Bollela V, Ribeiro M, Mennin S, Haddad A E, Campos F. An Educational International Partnership Responding to Local Needs: Process Evaluation of the Brazil FAIMER Regional Institute. Educ Health 2012;25:116-23
|How to cite this URL:|
Amaral E, Campos H H, Friedman S, Morahan P S, Araujo M, Carvalho P M, Bollela V, Ribeiro M, Mennin S, Haddad A E, Campos F. An Educational International Partnership Responding to Local Needs: Process Evaluation of the Brazil FAIMER Regional Institute. Educ Health [serial online] 2012 [cited 2020 Apr 2];25:116-23. Available from: http://www.educationforhealth.net/text.asp?2012/25/2/116/103459
| Introduction|| |
There is increasing awareness that leadership and management skills are a critical component of faculty development in health professions education (HPE). ,,, However, the methods and content of faculty development and education leadership programmes have received little attention in resource limited regions. , In 2001, the Foundation for Advancement of International Medical Education and Research (FAIMER) in Philadelphia, USA, began a fellowship programme for mid-career faculty members from health professions schools from developing countries to increase educational skills, develop leadership and management skills and grow a community of practice. ,,, The ultimate goal is to build field leadership  in HPE, to help develop competences to understand and support education values, mission, goals and practice linked to improving the health of communities. , To expand on achievement of its goals, the FAIMER Institute added five Regional Institutes (FRI), three in India, and one each in southern Africa and Brazil. 
The Brazilian Unified Health System (SUS) provides universal access to care, under the direction of the Ministry of Health (MoH), relying on a primary care strategy assuming a family health model.  This innovative paradigm requires health professionals competent to work in teams that provide care for geographically assigned population groups or territories. In 2001, the Brazilian Ministry of Education established National Guidelines for Health Professions curricula (DCN), stating that professionals should be trained at all levels of care, and be competent to work in teams within SUS.  As a strategy to enhance consolidation of the primary care-based health system, the Brazilian MoH, in conjunction with the Ministry of Education, initiated grant programmes to support the implementation of curricular reforms and stimulate the interaction between academic institutions and Brazilian healthcare services. The first of these programmes, Program for the Promotion of Changes in Medical School Curricula (PROMED), was launched in 2002 at 19 medical schools.  In 2005, it was replaced by Pró-Saúde (National Programme on Reorientation of Health Professional), and extended to Nursing and Dental schools (89 schools received grants). In 2010, Pró-Saúde expanded to include all undergraduate health schools (69 additional schools received grants). In early 2010, a new initiative, Pet-Saúde (interdisciplinary student group Programme for Education through the Work in Health) complemented Pró-Saúde, offering scholarships for students, tutors from public health services and faculty supervisors to implement action projects on family health, health surveillance, mental health and drugs (606 groups awarded). In 2010, new initiatives broadened the actions implemented to promote the development of HPE as a field of study and career pathway. These included Pró-Residência that aims to increase the number of specialists in shortage areas, with mentoring for new programmes by well-established residency programmes, and Pró-Ensino, an initiative to provide financial support and scholarships for the development of graduate degree programmes in HPE, promoting development of lines of research, with 31 projects awarded. ,
Concomitant with these governmental initiatives, FAIMER BR was initiated in 2007, with support from the Brazilian MoH, Pan American Health Organization (PAHO) and FAIMER. FAIMER's ultimate goal to improve the health of populations through the development of HPE was closely aligned with the Brazilian MoH policies on capacity-building of a health workforce to meet the needs of the population and the national health system. FAIMER BR was originally offered to medical school faculty and later expanded to all health professions.
The core elements of FAIMER BR are similar to the FAIMER Institute's two-year part-time fellowship in Philadelphia [Figure 1], merging education technologies with leadership and management topics, and creating a sustained community of educators to develop field leadership.  First-year Fellows overlap with returning second-year Fellows for three days to share presentation of project achievements, and plan future activities together. The distance learning component involves interaction through an electronic discussion list, and both classes design and direct monthly distance learning modules with faculty supervision. Fellows implement an education project in their home institution.  The application of learning to authentic situations supports effective human capacity-building and is compatible with adult learning and leadership development research. , The model also takes into account that education for health professions is a social and complex endeavour. 
|Figure 1: Components of the FAIMER Brazil Programme for Health Professions Educators|
Click here to view
Some differences between FAIMER BR and the global FAIMER Institute include an increased number of Fellows per class (25 compared with 15), shorter residential sessions, a high degree of alignment of Fellows' projects with governmental initiatives and close collaboration with national HPE stakeholders.
The FAIMER Institute has been evaluated to understand its dynamics and effects on Fellows and other stakeholders. , The theoretical basis for evaluation integrates several established evaluation frameworks. ,,, The process evaluation of FAIMER BR offers a unique opportunity to study the initial results of a national leadership faculty development programme in HPE in a developing country where such studies have been limited. It also represents an opportunity to evaluate the programme alignment with the human capacity-building plan to improve the Brazilian unique universal healthcare system (SUS). This paper describes process (implementation and progress) evaluation results  of the FAIMER BR programme and includes its reach in the country, project themes and participants' perceptions of knowledge gain and impact of the fellowship.
| Methods|| |
Complete data were collected from the 2007 and 2008 classes, with initial data from the 2009 and 2010 classes. Consent rates for participation in the evaluation of the programme were 80% (20/25) for the 2007 class and 100% (25/25) for each of the 2008, 2009 and 2010 classes.
The project was approved by the Institutional Review Board at the Federal University of Ceara, Brazil, the Institutional Review Board at the University of Pennsylvania and the Institutional Review Board of the University of New Mexico.
Information available from the application process focused on the programme reach, including number of applicants and Fellows in comparison with the total number of schools, country geographic regions and type of school (private, public state, public federal), gender, academic rank and discipline of Fellows and number of schools with multiple Fellows. Data also were obtained from a retrospective pre/post survey instrument  completed at the end of each of the two residential sessions, based on self-ratings of knowledge and importance of curriculum topics (instrument available on request). The questionnaire asks respondents to "rate the importance to you" of a series of curriculum topics on a scale from 1 (none) to 7 (very high), with separate rating scales for "before FAIMER" (retrospective pre-test) and "today" (post-test). The second portion of the survey asks respondents to "rate your skills, knowledge or competence to address" each of the same topics on a scale from 1 (none or no skill) to 7 (expert, teach others), both pre and post. The Post-Session 1 electronic survey, starting for session 1 in the 2008 class, offered 32 (open and close-ended) questions under seven topic subscales including: Change Theory and Management; Personal Professional Development; Educational Methods; Electronic Mentoring and Learning Web; Assessment and Student Performance; Educational Programme Evaluation; and Project Management. The Post-Session 3-survey analysis included 14 (open and closed-ended) questions distributed under four topic subscales: Building a Community of Educators; Distance Learning; Whole Systems Models to Sustain Change; and Qualitative Methods.
The types of educational innovation projects were assessed by the themes of the projects (all four classes). Most projects included more than one theme and the two judged by two reviewers (SF and EA) as most relevant for the project were included in the analysis. In addition, the proportion of projects that were completed for all classes and resulted in the preparation of a poster and an abstract (Year 1 outcomes) was calculated. Information about the status and impact of the projects was obtained from an on-line portfolio. The portfolio asks Fellows, through a combination of structured and open-ended items, to reflect on the FAIMER experience, the progress of their FAIMER projects, their advice to FAIMER and their professional accomplishments since starting the FAIMER experience. All classes were asked to complete the "accomplishments" portion of the portfolio (13/20, 65% of 2007; 8/25, 32% of 2008; 17/25, 68% of 2009; 22/25, 88% of 2010 completed this portion). Only 2007-2009 classes were asked to complete other portions of the portfolio; these questions are designed to be used first by Fellows near completion of the programme (16/20, 80% of 2007; 11/25, 44% of 2008; 14/25, 56% of 2009 completed). Scholarly outcomes of projects for these classes, measured as presentations at national and international meetings, were identified through review of the conference proceedings of the Brazilian Congress on Medical Education (COBEM) and the Association of Medical Education in Europe (AMEE) meetings from 2007 to 2010.
Demographic and electronic portfolio data were analysed via descriptive statistics. For the retrospective pre-post questionnaire, means, standard deviations and effect size were calculated for each pre/post topic subscale for both importance and knowledge/skills. Effect size (standard mean difference between paired post-participation and pre-participation ratings) was calculated by using the average paired difference between post-participation and pre-participation ratings as the numerator and the standard deviation of the paired differences as the denominator, considering effect sizes of 0.8 or greater as large.  Internal consistency of responses for both pre and post responses within each topic sub-scale of the retrospective pre/post survey was calculated via Cronbach's alpha. The internal consistency coefficients for Session 1 survey topic areas ranged from 0.84 to 0.95; for Session 3 internal consistency for each topic area ranged from 0.81 to 0.96.
| Results|| |
The reach of FAIMER BR
Analysis of the 251 applications showed an average of 2.4:1 for the 100 places offered in the first four classes, with an increase in candidates for 2010, with a more competitive application process and reduction of the acceptance rate [Table 1]. [Figure 2] shows the broadening reach of the programme, with 65% (17/26) of all Brazilian states being represented among the Fellows by 2010. The range of Fellows from each school was 1-6; there has been a substantial rate of "repeat" schools, that is, 24 schools have nominated a second or third Fellow [Table 1].
|Table 1: Reach of the FAIMER BR, as evidenced by cumulative applications and fellows|
Click here to view
|Figure 2: Geographic distribution of fellows accepted for the 2007– 2010 classes at the FAIMER BR|
Click here to view
Alignment with MoH
Fellows are predominantly faculty from public medical schools (74/98; 75.5%) and from schools with MoH grants (88/98; 89.8%). There has been an increasing involvement of medical schools as the government grant programme expanded: 30% (14/46) of the schools received PROMED grants; 28 received Pró-Saúde grants (60.8%); and 73.9% (34/46) received Pet-Saúde grants. The themes of the 98 projects show that one-third mainly focused on alignment with the mission of the Brazilian MoH [Table 2].
|Table 2: Major themes of the educational innovation projects for FAIMER BR (n = 95a)|
Click here to view
Changes in knowledge and skills
The response rate for the retrospective pre-post survey was 73/75 (97%) for the Session 1 survey (2008, 2009 and 2010 classes) and 65/70 (93%) for the Session 3 survey (2007, 2008 and 2009 classes). There were significant changes on all topic subscales of the Session 1 and Session 3 Retrospective Pre-Post surveys, from pre to post self-assessment of knowledge and large effect sizes, ranging from 1.21 to 2.77 [Table 3]. The greatest improvements were reported for whole systems models to sustain change, distance learning, building a community of educators, project management, personal professional development and educational programme evaluation, all greater than 1.90 [Table 3].
|Table 3: Retrospective pre-post survey mean and effect size on self-report about knowledge on specific topics from sessions 1 and 3 at the Brazil FAIMER Regional Institute|
Click here to view
Indications of field leadership in health professions education
Almost all Fellows from the first four classes (98%) completed their projects through preparation of abstracts and posters for presentation at the beginning of the second year of the Fellowship and nearly all Fellows completed the second year of the programme (96%). When asked in the portfolio about sustaining and expanding their curriculum innovation project, almost two-thirds of the 41 respondents from the 2007 to 2009 classes (63%) indicated that their projects were being sustained by permanent incorporation into the curriculum and/or policy. Nearly one-quarter of all respondents reported growth in scope to other subjects (22% for all 2007-2009 classes and 56% of the 2007 class). This is not surprising since the 2007 class completed their Fellowship in 2009 and thus had the longest opportunity for project growth. A smaller proportion reported that their project had widened its scope to other objectives (25% from 2007 only, 10% from 2007-2009), other years in the curriculum (19% from 2007, 7% from 2007-2009), other departments (13% from 2007, 5% from 2007-2009) or outside their institution (19% from 2007, 7% from 2007-2009). When asked about the impact of their projects, one-third or more of all 2007-2009 respondents noted that there is more faculty interest in the quality of teaching (49%), more intra-departmental collaboration on education (37%), the curriculum is better aligned with community health needs (34%) and quality of teaching (32%) and student performance (32%) have improved.
When questioned about deepening their knowledge about HPE and development of a community of educators, over one-half of the 41 respondents from the 2007 to 2009 classes read the listserv three or more times per month (58%) and one-third reported contributing to the FAIMER BR listserv more than three times per month (33%). Beyond the listserv, over one-half of the respondents communicated with more than two other FAIMER Fellows per month (59%) and over one-third with more than two FAIMER BR faculty members per month (35%). When asked about what they gained from individual and group communication with Fellows and faculty, the vast majority reported deepening their knowledge (98%) and getting new ideas about medical education (90%). Fifty percent or more reported receiving advice managing conflict (63%), benefiting from the breadth of expertise (54%), research collaboration (50%) and emotional support (63%).
Over one-half of the 60 respondents to the portfolio reported presentations from their projects (55%). One-quarter (27%) of all respondents reported organizing education conferences or meetings at the national, regional or local level. The 48 Fellows from the 2007 and 2008 classes presented a total of 71, 105, 92 and 62 abstracts, respectively, at 2007-2010 national medical education meetings (called COBEM). The same Fellows presented 3, 0, 13 and 7 abstracts at the Association for Medical Education in Europe (AMEE) meeting during the same period. Six have published 'Really Good Stuff' reports in Medical Education based on their FAIMER BR projects. There is no pre-Institute data on education-related activities for 2007 and 2008 applications, but 2009 fellows reported six education-related presentations (conferences/meetings/workshops as organizer or presenter) on their applications. Moreover, 20 graduates of the 2007-2009 classes have been invited to serve as junior faculty in FAIMER BR and/or mentoring the first-year Fellows.
| Discussion|| |
Data from 98 Fellows from the first four classes of the FAIMER BR programme demonstrate the satisfaction of Fellows and their institutions, as well as progress towards a critical mass of health professions educators within their schools, regions and country. The predominance of public schools shows that the FAIMER BR is specifically reaching schools that are at the vanguard of fostering the vision of the Brazilian MoH to offer well-prepared health providers to the national health system. Since FAIMER BR expanded to an interprofessional faculty development programme, Fellows from dentistry, nursing and pharmacy have joined those from medicine, in alignment with the MoH direction for organization of care in health teams. 
The retrospective pre/post-test self-report data also indicated positive results, demonstrating a significant increase in perceived importance, knowledge and skills in all 11 curriculum themes of the programme, with large effect sizes. These data are similar to other faculty development programmes, including the global FAIMER Institute. ,,, The lower means for management and leadership topics reported by the Fellows before the start of FAIMER BR are not a surprise, since faculty have little formal leadership and management training. , These components were incorporated to facilitate successful introduction of the curriculum innovation project because curricular change also requires leadership and management skills. The retrospective post-pre survey responses show the special value of project management, leadership and personal development for Fellows, as already indicated by others. ,,
The follow-up survey showed that almost two-thirds of the first three classes reported their curriculum innovation projects were sustained by permanent inclusion in the curriculum or by policy, and almost one-quarter reported that they were able to enlarge the scope of their projects. Almost all the respondents reported that they deepened their knowledge of medical education through the programme listserv, attending the workshops, etc. This is another desired result of leadership development programmes in medical education, motivating faculty for continued self-learning and engagement in communities of practice. ,,
The FAIMER Institute model  intentionally reinforces the bonds between Fellows. FAIMER BR has this focus as well and includes team-building and group dynamics exercises, intensive interaction and dialogue during the residential sessions, evening "learning circles" for sharing personal stories, , continuous emphasis on development of a "safe" learning environment, creation of on-line e-learning module teams, continuous electronic contact during the non-residential session and encouragement of "social presence" through listserv and scientific events. Local and regional faculty development programmes initiated by FAIMER BR alumni may also create concentrations of educators in Brazil. There has been little intentional encouragement of global professional networks for educators ,, until the recent appreciation of this essential component.  However, the concept has rarely been operationalised for educators from more resource-limited environments; an exception is the global organization, the Network: Towards Unity for Health (http://www.the-networktufh.org).
Additional evidence of impact on Fellows as well on developing the field of HPE in Brazil was found in the resulting scientific presentations on medical education, publications, positions at national institutions and associations, advanced positions in their schools and commitment to FAIMER BR as new faculty members. Such evidence is an important addition to the self-report data. , Some Fellows have also taken positions in a new certification process for foreign medical doctors who desire to practice in Brazil and positions on specialty board examination processes (data not shown), all evidence of field development.  While it is not possible to know if these steps would have been taken anyway without the FAIMER BR programme, the degree of such activity within four years of beginning a Fellowship is notable. The rapid growth of careers in HPE suggests a relevant role for the experience as FAIMER BR Fellows and the power of the network.
This initial process evaluation of the FAIMER BR programme has several limitations. First, there is a need for more time to search for outcomes in institutions and communities. The longest follow-up is for the first class (2007) that completed the programme in February 2009. Second, there is the inherent challenge in evaluating such a complex educational programme where changes evolve gradually over time with many potential contributing factors. ,,,,,
It is also important to note that retrospective pre/post methodology is not without limitations. , This method was chosen to ensure a robust response rate as well as to avoid response bias. Nevertheless, this study included achievements of the Fellows not only during the programme, but also at a period distant enough from the residential sessions to enable later impact on their professional career. Quantitative data regarding presentations, publications and positions can document programme impact and field development. ,
It would be interesting to probe such career advancement further by measuring HPE productivity prior to the Fellowship and in a similar period later.  It would also be useful to obtain information from other stakeholders, such as deans of the Fellows' health professions schools.  Even more challenging would be direct comparison of the knowledge, skills and career outcomes of FAIMER BR fellows with other faculty interested in advancing as health professions educators who have not undertaken such a fellowship.  However, such extensive and labour intensive programme evaluation studies have substantial costs, and generally cannot be supported in resource-constrained countries.
Several lessons can be drawn from the progress evaluation data from the experience of the Brazil Regional FAIMER Institute. First, the intentional alignment of the expectations of stakeholders and faculty who applied, faculty selected, schools, FAIMER, FAIMER BR faculty, MoH, national and international experts on HPE were powerful contributions to success. The programme was implemented at an opportune moment when policies to support a major educational change for health professions were both expected and demanded, and also supported in the country.
Second, a major element for the observed success was the power of the educational design of the parent programme upon which FAIMER BR was modelled and adapted to fulfil national needs. , Key design features included the intentional development and fostering of a safe environment in which educators could reflect and develop a community of practice, particularly valued by Fellows. Combining the two major curricular themes -HPE and leadership-management - was another essential element. Finally, the programme stimulated knowledge application focused on a curriculum innovation project designed by the Fellow to meet a real need,  and implemented during the Fellowship with advice and support from the faculty and other Fellows.
A third key element was the sharing of expertise, experience, resources and perspectives among national and international faculty. The contribution of joining the global movement on educational changes for health professionals , was recognized and valued as an important step to increase the value of the health professions educator career in Brazilian universities. Even more relevant, there is an existing body of knowledge and a well-known national movement to improve health professional's education linked to the health system. ,,, The Brazilian experience is aligned with the direction recently stated by an international consensus on social accountability of HPE and strengthening health systems. ,
| Acknowledgments|| |
The authors want to acknowledge the Secretariat of Human Resources at the Ministry of Health, Brazil (SGETS), the Pan American Health Organization (PAHO) and the Foundation for Advancement of Medical Education and Research - FAIMER, United States, for providing technical and financial support for the FAIMER BR programme. The authors also thank the Brazilian Association on Medical Education (ABEM) for its partnership in promoting the programme and Helena Maria da Costa Lima, librarian, for reviewing references.
| References|| |
|1.||Gruppen LD, Frohna AZ, Anderson RM, Lowe KD. Faculty development for educational leadership and scholarship. Acad Med 2003;78:137-41. |
|2.||Dwyer J, Paskavitz M, Vriesendorp S, Johnson S. An urgent call to professionalize leadership and management in health care worldwide: Occasional Paper No 4 [Internet]. Cambridge (MA): Management Sciences for Health; 2006. Available from: http://archive.k4 health.org/system/files/An-Urgent-Call-to-Professionalize-Leadership-and-Management-in-Health-Care-Worldwide.pdf. [Last cited 2011 Nov 2]. |
|3.||Steinert Y. Commentary: Faculty development: The road less traveled. Acad Med 2011;86:409-11. |
|4.||Hafler JP, Ownby AR, Thompson BM, Fasser CE, Grigsby K, Haidet P, et al. Decoding the learning environment of medical education: A hidden curriculum perspective for faculty development. Acad Med 2011;86:440-4. |
|5.||Bansal P, Supe A. Training of medical teachers in India: Need for change. Indian J Med Sci 2007;61:478-84. |
|6.||Wong JG, Agisheva K. Developing teaching skills for medical educators in Russia: A cross-cultural faculty development project. Med Educ 2007;41:318-24. |
|7.||Burdick WP, Morahan PS, Norcini JJ. Capacity building in medical education and health outcomes in developing countries: The missing link. Educ Health (Abingdon) 2007;20:65. |
|8.||Wenger E, McDermott R, Synder WM. Cultivating communities of practice: A guide to managing knowledge. Boston, MA: Harvard Business School Publishing; 2002. Available from: http://hbswk.hbs.edu/archive/2855.html. [Last cited 2011 Sep 17]. |
|9.||Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula M, et al. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach 2006;28:497-526. |
|10.||Steinert Y. Faculty development: from workshops to communities of practice. Med Teach 2010;32:425-8. |
|11.||Mouradian WE, Huebner CE. Future directions in leadership training of MCH professionals: Cross-cutting MCH leadership competencies. Matern Child Health J 2007;11:211-8. |
|12.||Haan CK, Edwards FH, Poole B, Godley M, Genuardi FJ, Zenni EA. A model to begin to use clinical outcomes in medical education. Acad Med 2008;83:574-80. |
|13.||Burdick WP, Diserens D, Friedman SR, Morahan PS, Kalishman S, Eklund MA, et al. Measuring the effects of an international health professions faculty development fellowship: The FAIMER Institute. Med Teach 2010;32:414-21. |
|14.||Paim J, Travassos C, Almeida C, Bahia L, Macinko J. The Brazilian health system: History, advances, and challenges. Lancet 2011;377:1778-97. |
|15.||Brasil. Ministério da Educação. Conselho Nacional da Educação. Câmara da Educação Superior. Resolução CNE/CES Nº 4, de 7 de novembro de 2001: Institui Diretrizes Curriculares Nacionais do Curso de Graduação em Medicina [Internet]. Brasília (DF): Ministério da Educação (BR); 2001. Available from: http://portal.mec.gov.br/cne/arquivos/pdf/CES04.pdf. [Last cited 2011 Mar 26]. |
|16.||de Souza PA, Zeferino AM, Ros Mda A. Changes in medicine course curricula in Brazil encouraged by the Program for the Promotion of Medical School Curricula (PROMED). BMC Med Educ 2008;8:54. |
|17.||Brasil. Ministério da Saúde. Secretaria de Gestão do Trabalho e da Educação na Saúde. Acesso direto: ações na educação [Internet]. Brasília (DF): Ministério da Saúde (BR); 2010. Available from: http://portal.saude.gov.br/portal/saude/Gestor/area.cfm?id_area=382. [Citado 2011 Sep 17]. |
|18.||Brasil. Coordenadoria de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) Pró-Ensino na Saúde [Internet]. Brasília (DF): CAPES; 2010. Available from: http://www.capes.gov.br/bolsas/programas-especiais/pro-ensino-na-saude. [Citado 2011 Sep 3]. |
|19.||Bransford JD, Brown AL, Cocking RR (editors). How people learn: Brain, mind, experience, and school. Washington (DC): National Academy Press (USA); 1999. |
|20.||Nchinda TC. Research capacity strengthening in the South. Soc Sci Med 2002;54:1699-711. |
|21.||Mennin S. Complexity and health professions education: A basic glossary. J Eval Clin Pract 2010;16:838-40. |
|22.||Mennin SP, Kalishman S. FAIMER Institute Evaluation Plan, Office of Program Evaluation, Education and Research, University of New Mexico School of Medicine. New Mexico: Mimeo; 2002. |
|23.||Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs. The four levels. 3 rd ed. San Francisco (CA): Berrett-Koehler Publishing; 2005. |
|24.||WK Kellogg Foundation. Logic model development guide [Internet]. Beattle Creek (MI): W. K. Kellogg Foundation; 2004. Available from: http://www.wkkf.org/knowledge-center/resources/2006/02/WK-Kellogg-Foundation-Logic-Model-Development-Guide.aspx. [Last cited 2011 Sep 17]. |
|25.||Grove JT, Kibel BM, Haas T. EVALULEAD: A guide for shaping and evaluating leadership development programs [Internet]. Batte Creek (MI): W. K. Kellogg Foundation; 2005. Available from: http://www.wkkf.org/knowledge-center/resources/2005/05/EVALULEAD-A-Guide-For-Shaping-And-Evaluating-Leadership-Development-Programs.aspx. [Last cited 2011 Nov 27]. |
|26.||Patton MQ. The essentials of utilization-focused evaluation. New York (NY): Sage Publications; 2011. |
|27.||United States of America. National Sciences Foundation. The 2002 user friendly handbook for project evaluation [Internet]. Arlington (VA): National Science Foundation (USA); 2002. Available from: http://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf. [Last cited 2011 Sep 25]. |
|28.||Umble K, Upshaw V, Orton S, Mathews K. Using the post-then method to assess learner change [Internet]. 2000. Paper presented at the AAHE Assessment Conference, Charlotte, North Carolina, 2000. Available from: http://www.maph.unc.edu/outcomes/post-then.pdf. [Last cited 2011 Nov 28]. |
|29.||Cohen J. Statistical power analysis for the behavioral sciences. 2 nd ed. Hillsdale (NJ): Lawrence Erlbaum Associates; 1988. |
|30.||Haddad AE, Morita MC, Pierantoni CR, Brenelli SL, Passarella T, Campos FE. Undergraduate programs for health professionals in Brazil: An analysis from 1991 to 2008. Rev Saude Publica 2010;44:383-91. |
|31.||Steinert Y, Nasmith L, Daigle N. Executive skills for medical faculty: A workshop description and evaluation. Med Teach 2003;25:666-8. |
|32.||McDade SA, Richman RC, Jackson GB, Morahan PS. Effects of participation in the Executive Leadership in Academic Medicine (ELAM) program on women faculty's perceived leadership capabilities. Acad Med 2004;79:302-9. |
|33.||Mennin SP, Kalishman S, Eklund M, Mines J, Serna L. FAIMER Institute Evaluation. Office of Program Evaluation, Education and Research, University of New Mexico School of Medicine; 2007. |
|34.||Robins L, Ambrozy D, Pinsky LE. Promoting academic excellence through leadership development at the University of Washington: The Teaching Scholars Program. Acad Med 2006;81:979-83. |
|35.||Gruppen LD, Simpson D, Searle NS, Robins L, Irby DM, Mullan PB. Educational fellowship programs: Common themes and overarching issues. Acad Med 2006;81:990-4. |
|36.||Baldwin C. Calling the circle: the first and future culture [Internet]. New York: Bantam Books; 1998. |
|37.||Danzig A. How might leadership be taught? The use of story and narrative to teach leadership. Int J Leadersh Educ 1999;2:117-31. |
|38.||Macleod ML, Dosman JA, Kulig JC, Medves JM. The development of the Canadian Rural Health Research Society: Creating capacity through connection. Rural Remote Health 2007;7:622. |
|39.||Moses AS, Skinner DH, Hicks E, O'Sullivan PS. Developing an educator network: The effect of a teaching scholars program in the health professions on networking and productivity. Teach Learn Med 2009;21:175-9. |
|40.||Hewson MG, Copeland HL, Fishleder AJ. What's the use of faculty development? Program evaluation using retrospective self-assessments and independent performance ratings. Teach Learn Med 2001;13:153-60. |
|41.||Armstrong EG, Doyle J, Bennett NL. Transformative professional development of physicians as educators: Assessment of a model. Acad Med 2003;78:702-8. |
|42.||Reinelt C, Russon C. Evaluating the outcomes and impacts of leadership development programs: Selected findings and lessons learned from a scan of 55 programs. In: Cherrey C, Gardine JJ, Huber N., editors. Building Leadership Bridges. Greensboro (NC): International Leadership Association; 2003. p. 119-36. |
|43.||Sullivan AM, Lakoma MD, Billings JA, Peters AS, Block SD; PCEP Core Faculty. Creating enduring change: demonstrating the long-term impact of a faculty development program in palliative care. J Gen Intern Med 2006;21:907-14. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1831593/pdf/jgi0021-0907.pdf. [Last cited 2011 Sep 17]. |
|44.||Lamb TA, Tschillard R. Evaluating learning in professional development workshops: Using the retrospective pretest. J Res Prof Learn 2005. Available from: http://www.mdecgateway.org/olms/data/resource/6794/Evaluating%20Learning%20in%20PD%20Workshops_OST-PD.pdf [Last cited 2012 November 7]. |
|45.||Hill LG, Betz DL. Revisiting the retrospective pretest. Am J Eval 2005;26:501-17. |
|46.||Dannels S, McLaughlin J, Gleason KA, McDade SA, Richman R, Morahan PS. Medical school deans' perceptions of organizational climate: Useful indicators for advancement of women faculty and evaluation of a leadership program's impact. Acad Med 2009;84:67-79. |
|47.||Dannels SA, Yamagata H, McDade SA, Chuang YC, Gleason KA, McLaughlin JM, et al. Evaluating a leadership program: A comparative, longitudinal study to assess the impact of the Executive Leadership in Academic Medicine (ELAM) Program for Women. Acad Med 2008;83:488-95. |
|48.||Burdick WP, Morahan PS, Norcini JJ. Slowing the brain drain: FAIMER education programs. Med Teach 2006;28:631-4. |
|49.||Gusic ME, Milner RJ, Tisdell EJ, Taylor EW, Quillen DA, Thorndyke LE. The essential value of projects in faculty development. Acad Med 2010;85:1484-91. |
|50.||Morahan PS, Fleetwood J. The double helix of activity and scholarship: Building a medical education career with limited resources. Med Educ 2008;42:34-44. |
|51.||Simpson DE, Fincher RM, Hafler JP, Irby DM, Richards BF, Rosenfeld GC, et al. Advancing educators and education: defining the components and evidence of educational scholarship. Washington (DC): Association of American Medical Colleges; 2007. Available from: http://louisville.edu/medschool/researchunit/national-reports-on-medical-education/AAMC_Educational_Scholarship_Report.v2 pdf.pdf/at_download/file. [Last cited 2011 Sep 20]. |
|52.||Cornwall A, Shankland A. Engaging citizens: Lessons from building Brazil's national health system. Soc Sci Med 2008;66:2173-84. |
|53.||Faleiros VP, Silva JF, Vasconcellos LC, Silveira RM. A construção do SUS: Histórias da reforma sanitária e do processo participativo [Internet]. Brasilia (DF): Ministério da Saúde (BR); 2006. Available from: http://portal.saude.gov.br/portal/arquivos/pdf/construcao_do_SUS.pdf. [Last cited 2011 April 25]. |
|54.||Boelen C, Woollard RF. Global Consensus for Social Accountability of Medical Schools [Internet], 2010. Available from: http://healthsocialaccountability.sites.olt.ubc.ca/files/2011/06/11-06-07-GCSA-English-pdf-style.pdf. [Last cited 2011 Apr 4]. |
|55.||Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: Transforming education to strengthen health systems in an interdependent world. Lancet 2010;376:1923-58. |
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3]
|This article has been cited by|
||How Culture Is Understood in Faculty Development in the Health Professions
| ||Lerona Dana Lewis,Yvonne Steinert |
| ||Academic Medicine. 2020; 95(2): 310 |
|[Pubmed] | [DOI]|
||Objective structured clinical examination, OSCEs: an advance in the teaching and learning process in the student’s perception
| ||Fabiana Aparecida Mayrink DE OLIVEIRA,Fernanda Ribeiro PORTO,Cleide Gisele RIBEIRO,Ana Estela HADDAD,Rodrigo Guerra DE OLIVEIRA,Antônio Márcio Lima FERRAZ JÚNIOR |
| ||Revista de Odontologia da UNESP. 2019; 48 |
|[Pubmed] | [DOI]|
||Perfil dos Principais Autores da Revista Brasileira de Educação Médica entre 2006 e 2015: Perspectivas para um Novo Futuro?
| ||Pedro Tadao Hamamoto Filho,Jacqueline Teixeira Caramori |
| ||Revista Brasileira de Educação Médica. 2017; 41(3): 442 |
|[Pubmed] | [DOI]|
||Building midwifery educator capacity in teaching in low and lower-middle income countries. A review of the literature
| ||Florence West,Caroline Homer,Angela Dawson |
| ||Midwifery. 2016; 33: 12 |
|[Pubmed] | [DOI]|
||Formative Second Opinion: Qualifying Health Professionals for the Unified Health System Through the Brazilian Telehealth Program
| ||Ana Estela Haddad,Mary Caroline Skelton-Macedo,Verônica Abdala,Caren Bavaresco,Daniele Mengehel,Camilla Galatti Abdala,Erno Harzheim |
| ||Telemedicine and e-Health. 2015; 21(2): 138 |
|[Pubmed] | [DOI]|