Skip to main content

indicators

LESSON

Lesson Learned: Tunisia - Meta Evaluation Report

In addition to UNDEF’s already existing procedures and practices, grantees should be encouraged to build deeper synergies between project components for coherence, and trust among participants and stakeholders through the application of specific, measurable, achievable, relevant and time-bound (SMART) criteria for their and partners’ activities. This is especially critical for projects in which grantees provide capacity development opportunities and sub-grants to local partners around project cycle management. This can alleviate risks related to potential delays in proposed timeframes, without compromising the overall timeline of the project and its objective.
Project Partner
Various CSOs
Project Description
The Tunisia meta-evaluation of UNDEF-funded projects implemented between 2013 and 2021 shows positive trends at two principal levels: (1) with respect to Tunisia’s overall development context and needs; and (2) with respect to local democracy-building (sub-national, sub-regional, and in marginalized areas) via projects that commit to a participatory CSO-centric approach. Most successful UNDEF project strategies fall within two broad categories: (1) project designs based on regular participation by partners and stakeholders, especially when these are engaged in finetuning activities and their content; (2) participatory models connecting citizens, CSOs and local authorities (as seen in joint activity designs). Gender and youth elements are prioritized and integrated throughout the projects and within activities, albeit at different levels of effectiveness. A critical element of the meta-evaluation is the identification of synergies across projects, as well as trends that have slowed, stalled, or provided implementation challenges to projects, with recommendation to alleviate these in future. Coherence and Relevance To date (2013-2021), UNDEF has funded 17 projects that have buttressed Tunisia’s democratic transition by supporting government strategic priorities and aligning with broader democracy-assistance funding trends. UNDEF-funded projects have a clear CSO focus and stress participatory and dialogue-based project designs. UNDEF has a niche advantage of funding geographically diverse projects, implemented at the local level by smaller CSOs with solid areas of expertise and ability to work effectively within marginalized areas, where need is highest. At the time of implementation, and under the framework of the priorities defined by government-donor strategic plans, all projects addressed relevant and urgent democracy needs, and responded to the needs of target groups. UNDEF projects which were geographically diverse, with a significant focus on local communities and marginalized areas, were relevant. Effectiveness With nearly all projects facing contextual and institutional delays, effectiveness depended on three main factors: (1) the capacity, expertise, and issue-specific strength of the UNDEF’s grantees, (2) the adaptability of project design (elasticity) and clearly identified project objectives and activities, (3) as well as timely communication and consultation with all partners and stakeholders. Three trends can be highlighted. First, trainings were seen by most project participants as useful and successful but could sometimes have been more effective had they been clearly articulated around the other project components, especially advocacy, during the design phase, to better harness the newly acquired knowledge. Second, UNDEF’s grantees successfully identified a niche area of working directly with newly established municipalities on participative democracy and several projects were effective in achieving their objectives. Third, positive results were also obtained when well-defined methods, such as coaching and mentoring, or techniques for establishing new participatory budgeting processes were applied. Efficiency Efficiency varied widely among projects and was largely impacted by institutional delays and a continuing depreciation of the local currency. The increase in funds resulting from this depreciation missed opportunities in optimizing budget use and enhancing the projects’ general efficiency. Efficiency was neither improved nor impaired by low utilization rates or extensions. Nevertheless, and despite the limited amounts allocated to partnerships, the latter generally enhanced efficiency, especially in finding solutions to implementation and contextual issues. Impact We found highest impact at the CSO-level, where civil society was strengthened through its engagement with local authorities and citizen trainings, broadening of CSO networks, and expanding in geographic reach. UNDEF-funded projects have positively impacted citizen trust in local democracy by augmenting participation in local governance beyond elections. Activities that included participatory and dialogue-based elements across project designs showed positive effects, as did projects that work at multi-scalar levels or focused on niche-expert issues. Gender-specific activities also yielded positive impact. Sustainability Projects that supported long-term processes and mechanisms, that produce activities and materials adaptable over-time and in different geographic regions, have the highest potential for achieving sustainability. We found sustainability trends in participatory mechanisms at the local level especially in municipalities, among local partners who continued their partnership beyond the life of the UNDEF-grant pro-bono or with new funding, and in some platforms and materials that are adaptable over time. We also found sustainability among CSOs and partners that were able to secure new funding streams after the completion of UNDEF-grants and expanding their activities thematically and geographically. UNDEF-Added Value A critical value is that UNDEF-funded projects are not affected by Tunisia's polarized political context. The range of grantees shows that UNDEF works well with partners across political and ideological orientations. UNDEF-projects also complement larger development initiatives by working at the expert-local level, with a (self-evident) focus on marginalized areas where development need is highest. Conclusions & Recommendations The meta-evaluation concludes that UNDEF-funded projects carried out by knowledgeable grantees with technical expertise relevant to the scope of activities have demonstrated strongest project designs and problem-solving skills, enhanced by what this evaluation refers to as “project elasticity.” These qualities result in effective, efficient, coherent and context-relevant initiatives. Projects that build strategies to transfer ownership of processes to participants and stakeholders have the highest potential for effectiveness, impact, and sustainability. This evaluation proposes a set of recommendations around processes to further strengthen UNDEF-funded work in Tunisia in the future. UNDEF is at a competitive advantage to continue funding both local expert CSOs (e.g., capital-based), as well as smaller grassroots organizations. Recommendations for processes include on-going reviews of activities as they function coherently in project designs, and as these relate to contextual needs in the near future, in which Tunisia is moving towards democratic consolidation. Project implementation partnerships play an important role in varying degrees throughout all grants and are critical to the transfer of ownership and sustainability – recommendations specifically address this process and relationship. The evaluation also recommends a centralized platform of all UNDEF-funded materials, as these are useful for future project designs and contain critical information for future grantees.
Evaluation Date
May 2021
Country
LESSON

Lesson Learned: Emerging Leaders of the Arab Region

Awareness raising activities should be strategic as well as tactical, for increased long-term effect. Activities should maximize the number of people reached, and the message should be focused and applied locally. Also include accurate indicators and means of verification in order to assess if there were any changes or impact, positive or negative, foreseen and unforeseen, on democratization.
Project Partner
World Youth Alliance – Middle East (WYA-ME)
Project Description
The project’s overall development goal was to “increase the civic and democratic participation of young people in the Arab region”. The specific objective was to “empower young leaders in the Arab region to play a bigger role in civic and democratic life”. The project sought to empower young leaders in five countries in the Arab region - Jordan, Lebanon, Morocco, Tunisia, and the United Arab Emirates. The project approach was based on the observation that while youth played a key role in the Arab uprisings; they continued to find themselves with limited empowerment or support to take control of their lives and futures. While the intervention rationale is broadly accurate, the project document did not include substantive contextual background for each targeted country and the project design lacked context analysis for each country. There also did not seem to be any involvement from project stakeholders and beneficiaries in the formulation and design of the project. Given the lack of contextual understanding, the project’s intervention rationale and the process for implementation also lacked essential elements to make the project relevant to the needs of the beneficiaries at the local and national levels.  
Evaluation Date
November 2017
LESSON

Lesson Learned: Rural Media Development for Promoting Democracy and Human Rights

The grantee collected rich and interesting data but was let down by not analyzing this data sufficiently to provide evidence of progress. Moreover, the overall M&E system needed more coherence, so that projects are able to measure the same indicators at the beginning and the end to show progress. This could have been done in various ways, for instance, by using the same framework for baseline and endline data collection, or by pre and post training questionnaires.
Project Partner
News Network
Project Description
This was a well-structured project which laid the foundation for a nationwide network of journalists concerned with human rights issues, particularly in rural marginalized areas. The project was relevant and much needed given the context of human rights abuses and the suppression of the media. It was also appropriate, although there are constraints there is sufficient democratic space for human rights influenced journalism since journalists were able to write about a range of human rights issues and call duty-bearers to account. The project also met its objectives: the skills of journalists in relation to human rights issues have been enhanced, reporting on human rights has increased, and civil society capacity to understand how the media works has improved – though closer engagement between NGOs and the media could be further strengthened.
Evaluation Date
November 2017
Theme
Country
LESSON

Lesson Learned: Strengthening Participation of Women in Geographically Deprived Communities in Local Governance in Ghana

A lack of qualitative monitoring tools and practices prevented a deeper assessment of the impact of the project. Project indicators should have been designed that were appropriately matched to the available tools for data collection and analysis, such as perception surveys, media monitoring and regular field inspections. These tools should have been budgeted for in the project and rigorously implemented.
Project Partner
Gender Centre for Empowering Development
Project Description
The project’s objective was to increase participation of women in decision making to develop sustainable, decentralized, bottom-up planning processes in Ghana. The grantee institutionalized Women’s Group Advocacy (WOMGA) Platforms to engage and dialogue with local government authorities in decision making processes on public service delivery. At the heart of the project strategy was the mobilization and empowerment of 150 women, who were trained and deployed to monitor policy implementation at the district level using a Gender Monitoring and Tracking Tool, and to champion the participation of women in local planning and implementation processes. The project’s intervention logic was sound and had clarity and coherence. Institutionalizing the WOMGA Platforms facilitated regular engagement with local government authorities, and hence effectively contributed to the overall development goal of increasing women’s participation in decision-making process on public service delivery. Local officials commended the high level of preparation they had to undertake for the public sessions the project held, during which they faced thorough questioning by the WOMGA members and the community.
Evaluation Date
June 2017
Country
LESSON

Lesson Learned: Civic education and empowerment for more women in leadership, from villages to parliament in Fiji

The project design and logical framework were weak and too ambitious. Lack of baseline studies and mapping of women participation in politics was another handicap, as well as the inappropriate indicators for selecting the trainers.
Project Partner
National Council of Women Fiji
Project Description
The project aimed to increase women’s representation in public office as part of wider support for women’s representation in political processes and civic leadership in Fiji. The project strategy was structured around three expected outcomes: increased awareness and knowledge of civic education principles among potential women leaders in Fiji; increased capacity of potential women leaders for active participation in civil leadership within both parliament and administrative boards and councils in Fiji and increased awareness within the broader community of the importance of the involvement of women in political processes and civic leadership in Fiji. The project had some success, in particular in training marginal women who are usually excluded from mainstream education and in working with church groups and political parties from across the political spectrum. Implementation, however, was marred by a number of administrative and management shortcomings including a lack of SMART indicators and irregular communication. In addition, the project encountered a number of external challenges including political tensions that generated delays in implementation and the tropical cyclone in February 2016 that left homeless ten thousands of people.
Evaluation Date
July 2016
Country
LESSON

Lesson Learned: Strengthening Democratic Processes for Bangsamoro Government in Lanao Lake Watershed Reservation in the Philippines

While the project recognized the rich cultural traditions of the people of the Lake, the grantee underestimated the time and resources needed to overcome the challenges and divisions, which characterize the political and societal context. This is why in some areas the project fell short of its objectives.
Project Partner
Tanggol Kalikasan
Project Description
The goal of the project was the objective was to build a strong coalition to ensure the efficient management, conservation and protection of the Lake Lanao Watershed Reservation – through democratic processes involving community integration and the introduction of partnerships, pre-consultation, capacity building, the promotion of micro-projects, and monitoring of policy implementation. The design of the project’s training methodology was appropriate to introduce the basic concept of ecology, best management practices, and to raise awareness of applicable environmental laws, rules and regulations. The project contributed to the joint elaboration and adoption of environmental action plans, as well as supporting policies and ordinances on watershed, fisheries and solid waste management. Print and radio media outputs also facilitated the wider public’s key role in the protection of the environment and to empower individual citizens to participate in the enforcement of environmental laws. The grantee managed to work with the full range of different political, religious and social leaders in the Lanao Lake Watershed Reservation. This was reported by the beneficiaries as an unparalleled achievement.
Evaluation Date
March 2016
Country
LESSON

Lesson Learned: Together against violence and discrimination of women

The project appeared to be effective, but only because the target indicators were quantitative and not qualitative. For example, the project achieved the indicator of training and installing 20 local vigilance groups in the 20 target sites, however evaluators found that the functioning of these groups was not likely to contribute to the project’s objectives.
Project Partner
Association des Femmes de Tadjourah
Project Description
The objective of the project was to contribute to the elimination of violence and discrimination against women in 20 communes of Djibouti’s Tadjourah region. This was to be achieved through awareness raising and mobilisation of the local population; and by building the personal capacities of local actors and structures, followed by the creation of 20 local vigilance groups in the targeted communes. There was, however, a fundamental flaw in the design of the project that reflected a mismatch between the problem identified and the responses chosen. The grantee’s research identified the principal cause of violence against women as patriarchal attitudes and behaviours that relegate women to an inferior status in the couple, the community and the nation. A weak legal framework to support action to end violence, and weak implementation of existing clauses in the Constitution that promise gender equality were also found. The project did not address these causes but focused on raising the awareness of women, potentially putting them at risk of reprisals.
Evaluation Date
March 2016
Country
LESSON

Lesson Learned: Youth as Agents of Democratic Change through Knowledge and Information Acquisition and Exchange in Laos

The grantee (a) imposed on itself very ambitious target indicators, and (b) confused monitoring data, all of which made analysis and reporting of project outcomes less pertinent.
Project Partner
Participatory Development Training Center
Project Description
The project enhanced the technical capacity of youth group leaders to introduce rights-based development knowledge. It also supported leadership development, and therefore was a relevant effort to involve youth in democratic and participatory processes regarding the management and use of natural resources. In addition, trained teachers of 17 primary schools from 6 provinces developed locally relevant curricula introducing indigenous knowledge. Given the political and administrative realities, the identification of bio-diversity issues and general development challenges, rather than direct democracy issues, represented smart approaches to support participation in environmental policy formulation by youth. The youth’s field-work identified about 30 different bio-diversity themes and general development challenges, and subsequently suggestions were made related to farming practices, but also to the need to preserve local culture and traditions. In view of the appreciation expressed by central and provincial representatives, evaluators are of the view that the project effectively contributed to improved consideration of local and biodiversity knowledge in local community development processes.
Evaluation Date
June 2014
LESSON

Lesson Learned: Empowerment of Women in India through Innovative Vocational Education and Training

The grantee in India expanded the definition of existing target indicators for women’s participation by adding a variety of measurement options, which made the reporting of project outcomes less pertinent, as it lacked clear responses to the project document’s initial results framework.
Project Partner
Amrita University (Amritapuri Campus)
Project Description
The project aimed to provide socially and economically impoverished women in India with the ability to participate in the democratic process and to strengthen their capacity to make decisions at individual, family and community levels. In addition to Computerized Vocational and Educational Training (CVET), which qualified beneficiaries for a wider range of employment opportunities and thus widen for them the scope of possibilities to achieve financial independence, Life Enrichment Education (LEE) activities, which comprised of video lectures and animated group discussions, complemented the women trainee’s entrepreneurial skills with democratic values and civic awareness, in order to transform them post-graduation into empowered participants of their local communities.
Evaluation Date
May 2014
Country
LESSON

Lesson Learned: Narrowing the Gender Gap in Flood Affected Areas of Pakistan

Targets were ambitious in some cases and not fully met. The attribution of results based on some of the indicators chosen was also difficult given the number of other factors that affected the outcomes. For example, impact data provided by the grantee showed a nine percent increase in the number of women in the project areas who registered for the Computerized National Identity Card during the project period. However attribution for this is difficult given the widespread voter education efforts that were done in Pakistan in the lead up to the 2013 elections.
Project Partner
Pattan Development Organization
Project Description
The objective of the project was to reduce gender disparity and gender-based violence in eight flood affected districts of Pakistan. Its intended outcomes were: increased awareness of gender issues; increased progress towards certain Millennium Development Goals (MDG 3: gender equality and empowerment of women; MDG 4: reduced child mortality; and, MDG 5: improved maternal health); and increased capacity of women to counter gender discrimination and to hold government accountable. The project objectives were directly relevant to the needs to strengthen gender rights and equity within Pakistan and especially within rural, marginalized flood prone areas The grantee took a rights based approach that integrated men as well as women into the project activities and structures. This increased project relevance for the communities and helped to ensure that the women were able to participate in these male dominated areas.
Evaluation Date
March 2014
Country