Where We Work

Building M&E Capacity

Name: EJF - Building M&E Capacity
Dates: August 2008 - December 2009
Donor: Elton John Foundation 

Monitoring and evaluation (M&E) represents the base on which key decisions are made regarding project implementation and continuation. Despite the fundamental role M&E plays in improving the efficiency and effectiveness of NGO activities, it is often a weakness of many organizations.  Over the past three years Pact Brasil has had extensive experience monitoring thirty NGOs conducting HIV/AIDS prevention work in Brazil and Peru. While the methodologies used for implementing activities are often well designed, it has been clear that the NGOs in large part lacked effective monitoring and evaluation systems to clearly demonstrate the results and reach of their activities.

In response to this, Pact Brasil developed an M&E workshop in 2006 specifically directed at NGOs working in HIV/AIDS prevention and based on the models for M&E systems used by Pact worldwide in addition to the National STD/AIDS Program and Center for Disease Control and Prevention (CDC) in Brazil. The workshop has a practical focus, with the broad goal of incorporating M&E into the organizational culture of NGOs and providing them with the instruments necessary to effectively and efficiently monitor and evaluate their activities.  To date, Pact Brasil has successfully facilitated 16 M&E workshops to over 200 participants.

In our experience, we have noted that perhaps the most difficult indicators are those related to the quality of life of PLHIV. At a time when approximately 165,000 people are currently receiving antiretroviral therapy (representing  nearly 100% of formally reported cases of PLHIV in need of treatment), the importance of working in complementary areas to improve the quality of life of PLHIV is becoming increasingly apparent. In São Paulo, the state with the largest concentration of registered AIDS cases in the country, countless NGOs are currently implementing important activities with PLHIV. As such, NGOs focused on providing services for PLHIV are currently grappling with establishing measurable and appropriate indicators to measure their results in the area of quality of life, stigma and discrimination and social inclusion. This has been a challenge given two factors: 1) This is a relatively new area in Brazil for which there are few technical references 2) Indicators of results in these areas tend to rely on the application of specific instruments and surveys which NGOs do not have access or knowledge.  Pact is positioned to provide specialized technical assistance in the area.

The goal of “Positive Results! Building M&E Capacity of NGOs in São Paulo” is to strengthen the M&E systems of 16 NGOs in the São Paulo region, prioritizing those NGOs whose activities focus on PLHIV. To achieve this goal, Pact Brasil will update, improve and adapt our current M&E workshops materials to include specific information regarding NGOs working with PLHIV and the development of a toolkit of M&E tools for this population. In addition, to ensure that NGOs put into practice what they have learned, Pact will monitor NGO activities post-workshop and test and validate tools for M&E of NGO activities with PLHIV. The final toolkit will be shared with NGO partners and government officials from the city and state HIV/AIDS programs to ensure they are widely disseminated and used.

General objective:

Contribute to implementing an organizational culture of monitoring and evaluation among NGOs in São Paulo, prioritizing NGOs that work with people living with HIV/AIDS. 

Specific Objectives:

1. Increase knowledge regarding the development and implementation of comprehensive monitoring and evaluation systems among NGO's who work with HIV/AIDS through dynamic and participatory workshops.

2. Expand access to quality tools available for monitoring and evaluating NGO actions for PLHIV.

The Results and process indicators defined for the project include:

• Number and type of NGOs selected for participation in workshop.
• Number of workshops held.
• Number of participants in the workshops.
• Number of participants increasing their knowledge on pre and post survey 
   applied after each workshop.
• Qualitative results from monitoring visits regarding the forms in which NGOs 
   are incorporating M&E tools into their systems and collecting indicators.
• Level of satisfaction of NGO coordinators in relation to the use of 
   information learned in the workshop.
• Number of tools identified, adapted and included in toolkit.
• Number of tools finalized for inclusion in toolkit. 
• Number of M&E guides printed.
• Number of NGOs and government offices receiving copies of the toolkit. 

The Impact indicators defined for the project include:

• Number of NGOs with M&E plans for all projects currently being 
   implemented.
• Number of indicators being systematically collected by NGOs
• Number of NGOs participating in workshops systematically using the tools 
   developed in their activities two months after training.

Publications

Guia para Ações em Monitoramento e Avaliação

Staff contacts

Lilia Rossi
Chief of Party
Rio de Janeiro
lrossi@pactbrasil.org

Erica Mongelli                                                                                Program Officer                                                             Washington, DC                                                                         
emongelli@pacthq.org