Skip to main content

Tools for knowledge

LESSON

Lesson Learned: Tunisia - Meta Evaluation Report

In extreme and exceptional cases such as radical currency fluctuations or organizational interruption, early communication by the grantee is critical for UNDEF to provide technical and institutional support in a timely and effective manner. This will allow to overcome challenges that could provide difficulties in the implementation of the project.
Project Partner
Various CSOs
Project Description
The Tunisia meta-evaluation of UNDEF-funded projects implemented between 2013 and 2021 shows positive trends at two principal levels: (1) with respect to Tunisia’s overall development context and needs; and (2) with respect to local democracy-building (sub-national, sub-regional, and in marginalized areas) via projects that commit to a participatory CSO-centric approach. Most successful UNDEF project strategies fall within two broad categories: (1) project designs based on regular participation by partners and stakeholders, especially when these are engaged in finetuning activities and their content; (2) participatory models connecting citizens, CSOs and local authorities (as seen in joint activity designs). Gender and youth elements are prioritized and integrated throughout the projects and within activities, albeit at different levels of effectiveness. A critical element of the meta-evaluation is the identification of synergies across projects, as well as trends that have slowed, stalled, or provided implementation challenges to projects, with recommendation to alleviate these in future. Coherence and Relevance To date (2013-2021), UNDEF has funded 17 projects that have buttressed Tunisia’s democratic transition by supporting government strategic priorities and aligning with broader democracy-assistance funding trends. UNDEF-funded projects have a clear CSO focus and stress participatory and dialogue-based project designs. UNDEF has a niche advantage of funding geographically diverse projects, implemented at the local level by smaller CSOs with solid areas of expertise and ability to work effectively within marginalized areas, where need is highest. At the time of implementation, and under the framework of the priorities defined by government-donor strategic plans, all projects addressed relevant and urgent democracy needs, and responded to the needs of target groups. UNDEF projects which were geographically diverse, with a significant focus on local communities and marginalized areas, were relevant. Effectiveness With nearly all projects facing contextual and institutional delays, effectiveness depended on three main factors: (1) the capacity, expertise, and issue-specific strength of the UNDEF’s grantees, (2) the adaptability of project design (elasticity) and clearly identified project objectives and activities, (3) as well as timely communication and consultation with all partners and stakeholders. Three trends can be highlighted. First, trainings were seen by most project participants as useful and successful but could sometimes have been more effective had they been clearly articulated around the other project components, especially advocacy, during the design phase, to better harness the newly acquired knowledge. Second, UNDEF’s grantees successfully identified a niche area of working directly with newly established municipalities on participative democracy and several projects were effective in achieving their objectives. Third, positive results were also obtained when well-defined methods, such as coaching and mentoring, or techniques for establishing new participatory budgeting processes were applied. Efficiency Efficiency varied widely among projects and was largely impacted by institutional delays and a continuing depreciation of the local currency. The increase in funds resulting from this depreciation missed opportunities in optimizing budget use and enhancing the projects’ general efficiency. Efficiency was neither improved nor impaired by low utilization rates or extensions. Nevertheless, and despite the limited amounts allocated to partnerships, the latter generally enhanced efficiency, especially in finding solutions to implementation and contextual issues. Impact We found highest impact at the CSO-level, where civil society was strengthened through its engagement with local authorities and citizen trainings, broadening of CSO networks, and expanding in geographic reach. UNDEF-funded projects have positively impacted citizen trust in local democracy by augmenting participation in local governance beyond elections. Activities that included participatory and dialogue-based elements across project designs showed positive effects, as did projects that work at multi-scalar levels or focused on niche-expert issues. Gender-specific activities also yielded positive impact. Sustainability Projects that supported long-term processes and mechanisms, that produce activities and materials adaptable over-time and in different geographic regions, have the highest potential for achieving sustainability. We found sustainability trends in participatory mechanisms at the local level especially in municipalities, among local partners who continued their partnership beyond the life of the UNDEF-grant pro-bono or with new funding, and in some platforms and materials that are adaptable over time. We also found sustainability among CSOs and partners that were able to secure new funding streams after the completion of UNDEF-grants and expanding their activities thematically and geographically. UNDEF-Added Value A critical value is that UNDEF-funded projects are not affected by Tunisia's polarized political context. The range of grantees shows that UNDEF works well with partners across political and ideological orientations. UNDEF-projects also complement larger development initiatives by working at the expert-local level, with a (self-evident) focus on marginalized areas where development need is highest. Conclusions & Recommendations The meta-evaluation concludes that UNDEF-funded projects carried out by knowledgeable grantees with technical expertise relevant to the scope of activities have demonstrated strongest project designs and problem-solving skills, enhanced by what this evaluation refers to as “project elasticity.” These qualities result in effective, efficient, coherent and context-relevant initiatives. Projects that build strategies to transfer ownership of processes to participants and stakeholders have the highest potential for effectiveness, impact, and sustainability. This evaluation proposes a set of recommendations around processes to further strengthen UNDEF-funded work in Tunisia in the future. UNDEF is at a competitive advantage to continue funding both local expert CSOs (e.g., capital-based), as well as smaller grassroots organizations. Recommendations for processes include on-going reviews of activities as they function coherently in project designs, and as these relate to contextual needs in the near future, in which Tunisia is moving towards democratic consolidation. Project implementation partnerships play an important role in varying degrees throughout all grants and are critical to the transfer of ownership and sustainability – recommendations specifically address this process and relationship. The evaluation also recommends a centralized platform of all UNDEF-funded materials, as these are useful for future project designs and contain critical information for future grantees.
Evaluation Date
May 2021
Country
LESSON

Lesson Learned: Tunisia - Meta Evaluation Report

In addition to UNDEF’s already existing procedures and practices, grantees should be encouraged to build deeper synergies between project components for coherence, and trust among participants and stakeholders through the application of specific, measurable, achievable, relevant and time-bound (SMART) criteria for their and partners’ activities. This is especially critical for projects in which grantees provide capacity development opportunities and sub-grants to local partners around project cycle management. This can alleviate risks related to potential delays in proposed timeframes, without compromising the overall timeline of the project and its objective.
Project Partner
Various CSOs
Project Description
The Tunisia meta-evaluation of UNDEF-funded projects implemented between 2013 and 2021 shows positive trends at two principal levels: (1) with respect to Tunisia’s overall development context and needs; and (2) with respect to local democracy-building (sub-national, sub-regional, and in marginalized areas) via projects that commit to a participatory CSO-centric approach. Most successful UNDEF project strategies fall within two broad categories: (1) project designs based on regular participation by partners and stakeholders, especially when these are engaged in finetuning activities and their content; (2) participatory models connecting citizens, CSOs and local authorities (as seen in joint activity designs). Gender and youth elements are prioritized and integrated throughout the projects and within activities, albeit at different levels of effectiveness. A critical element of the meta-evaluation is the identification of synergies across projects, as well as trends that have slowed, stalled, or provided implementation challenges to projects, with recommendation to alleviate these in future. Coherence and Relevance To date (2013-2021), UNDEF has funded 17 projects that have buttressed Tunisia’s democratic transition by supporting government strategic priorities and aligning with broader democracy-assistance funding trends. UNDEF-funded projects have a clear CSO focus and stress participatory and dialogue-based project designs. UNDEF has a niche advantage of funding geographically diverse projects, implemented at the local level by smaller CSOs with solid areas of expertise and ability to work effectively within marginalized areas, where need is highest. At the time of implementation, and under the framework of the priorities defined by government-donor strategic plans, all projects addressed relevant and urgent democracy needs, and responded to the needs of target groups. UNDEF projects which were geographically diverse, with a significant focus on local communities and marginalized areas, were relevant. Effectiveness With nearly all projects facing contextual and institutional delays, effectiveness depended on three main factors: (1) the capacity, expertise, and issue-specific strength of the UNDEF’s grantees, (2) the adaptability of project design (elasticity) and clearly identified project objectives and activities, (3) as well as timely communication and consultation with all partners and stakeholders. Three trends can be highlighted. First, trainings were seen by most project participants as useful and successful but could sometimes have been more effective had they been clearly articulated around the other project components, especially advocacy, during the design phase, to better harness the newly acquired knowledge. Second, UNDEF’s grantees successfully identified a niche area of working directly with newly established municipalities on participative democracy and several projects were effective in achieving their objectives. Third, positive results were also obtained when well-defined methods, such as coaching and mentoring, or techniques for establishing new participatory budgeting processes were applied. Efficiency Efficiency varied widely among projects and was largely impacted by institutional delays and a continuing depreciation of the local currency. The increase in funds resulting from this depreciation missed opportunities in optimizing budget use and enhancing the projects’ general efficiency. Efficiency was neither improved nor impaired by low utilization rates or extensions. Nevertheless, and despite the limited amounts allocated to partnerships, the latter generally enhanced efficiency, especially in finding solutions to implementation and contextual issues. Impact We found highest impact at the CSO-level, where civil society was strengthened through its engagement with local authorities and citizen trainings, broadening of CSO networks, and expanding in geographic reach. UNDEF-funded projects have positively impacted citizen trust in local democracy by augmenting participation in local governance beyond elections. Activities that included participatory and dialogue-based elements across project designs showed positive effects, as did projects that work at multi-scalar levels or focused on niche-expert issues. Gender-specific activities also yielded positive impact. Sustainability Projects that supported long-term processes and mechanisms, that produce activities and materials adaptable over-time and in different geographic regions, have the highest potential for achieving sustainability. We found sustainability trends in participatory mechanisms at the local level especially in municipalities, among local partners who continued their partnership beyond the life of the UNDEF-grant pro-bono or with new funding, and in some platforms and materials that are adaptable over time. We also found sustainability among CSOs and partners that were able to secure new funding streams after the completion of UNDEF-grants and expanding their activities thematically and geographically. UNDEF-Added Value A critical value is that UNDEF-funded projects are not affected by Tunisia's polarized political context. The range of grantees shows that UNDEF works well with partners across political and ideological orientations. UNDEF-projects also complement larger development initiatives by working at the expert-local level, with a (self-evident) focus on marginalized areas where development need is highest. Conclusions & Recommendations The meta-evaluation concludes that UNDEF-funded projects carried out by knowledgeable grantees with technical expertise relevant to the scope of activities have demonstrated strongest project designs and problem-solving skills, enhanced by what this evaluation refers to as “project elasticity.” These qualities result in effective, efficient, coherent and context-relevant initiatives. Projects that build strategies to transfer ownership of processes to participants and stakeholders have the highest potential for effectiveness, impact, and sustainability. This evaluation proposes a set of recommendations around processes to further strengthen UNDEF-funded work in Tunisia in the future. UNDEF is at a competitive advantage to continue funding both local expert CSOs (e.g., capital-based), as well as smaller grassroots organizations. Recommendations for processes include on-going reviews of activities as they function coherently in project designs, and as these relate to contextual needs in the near future, in which Tunisia is moving towards democratic consolidation. Project implementation partnerships play an important role in varying degrees throughout all grants and are critical to the transfer of ownership and sustainability – recommendations specifically address this process and relationship. The evaluation also recommends a centralized platform of all UNDEF-funded materials, as these are useful for future project designs and contain critical information for future grantees.
Evaluation Date
May 2021
Country
LESSON

Lesson Learned: Tunisia - Meta Evaluation Report

Reviewing the timing of activities before final approval of projects, especially for activities around electoral periods, is critical to the success of the project: (i) to ensure impact and sustainability of engaging with stakeholders such as new councilmembers, (ii) to constructively contribute to already-existing technical initiatives around electoral participation, and (iii) to avoid perceptions of political bias.
Project Partner
Various CSOs
Project Description
The Tunisia meta-evaluation of UNDEF-funded projects implemented between 2013 and 2021 shows positive trends at two principal levels: (1) with respect to Tunisia’s overall development context and needs; and (2) with respect to local democracy-building (sub-national, sub-regional, and in marginalized areas) via projects that commit to a participatory CSO-centric approach. Most successful UNDEF project strategies fall within two broad categories: (1) project designs based on regular participation by partners and stakeholders, especially when these are engaged in finetuning activities and their content; (2) participatory models connecting citizens, CSOs and local authorities (as seen in joint activity designs). Gender and youth elements are prioritized and integrated throughout the projects and within activities, albeit at different levels of effectiveness. A critical element of the meta-evaluation is the identification of synergies across projects, as well as trends that have slowed, stalled, or provided implementation challenges to projects, with recommendation to alleviate these in future. Coherence and Relevance To date (2013-2021), UNDEF has funded 17 projects that have buttressed Tunisia’s democratic transition by supporting government strategic priorities and aligning with broader democracy-assistance funding trends. UNDEF-funded projects have a clear CSO focus and stress participatory and dialogue-based project designs. UNDEF has a niche advantage of funding geographically diverse projects, implemented at the local level by smaller CSOs with solid areas of expertise and ability to work effectively within marginalized areas, where need is highest. At the time of implementation, and under the framework of the priorities defined by government-donor strategic plans, all projects addressed relevant and urgent democracy needs, and responded to the needs of target groups. UNDEF projects which were geographically diverse, with a significant focus on local communities and marginalized areas, were relevant. Effectiveness With nearly all projects facing contextual and institutional delays, effectiveness depended on three main factors: (1) the capacity, expertise, and issue-specific strength of the UNDEF’s grantees, (2) the adaptability of project design (elasticity) and clearly identified project objectives and activities, (3) as well as timely communication and consultation with all partners and stakeholders. Three trends can be highlighted. First, trainings were seen by most project participants as useful and successful but could sometimes have been more effective had they been clearly articulated around the other project components, especially advocacy, during the design phase, to better harness the newly acquired knowledge. Second, UNDEF’s grantees successfully identified a niche area of working directly with newly established municipalities on participative democracy and several projects were effective in achieving their objectives. Third, positive results were also obtained when well-defined methods, such as coaching and mentoring, or techniques for establishing new participatory budgeting processes were applied. Efficiency Efficiency varied widely among projects and was largely impacted by institutional delays and a continuing depreciation of the local currency. The increase in funds resulting from this depreciation missed opportunities in optimizing budget use and enhancing the projects’ general efficiency. Efficiency was neither improved nor impaired by low utilization rates or extensions. Nevertheless, and despite the limited amounts allocated to partnerships, the latter generally enhanced efficiency, especially in finding solutions to implementation and contextual issues. Impact We found highest impact at the CSO-level, where civil society was strengthened through its engagement with local authorities and citizen trainings, broadening of CSO networks, and expanding in geographic reach. UNDEF-funded projects have positively impacted citizen trust in local democracy by augmenting participation in local governance beyond elections. Activities that included participatory and dialogue-based elements across project designs showed positive effects, as did projects that work at multi-scalar levels or focused on niche-expert issues. Gender-specific activities also yielded positive impact. Sustainability Projects that supported long-term processes and mechanisms, that produce activities and materials adaptable over-time and in different geographic regions, have the highest potential for achieving sustainability. We found sustainability trends in participatory mechanisms at the local level especially in municipalities, among local partners who continued their partnership beyond the life of the UNDEF-grant pro-bono or with new funding, and in some platforms and materials that are adaptable over time. We also found sustainability among CSOs and partners that were able to secure new funding streams after the completion of UNDEF-grants and expanding their activities thematically and geographically. UNDEF-Added Value A critical value is that UNDEF-funded projects are not affected by Tunisia's polarized political context. The range of grantees shows that UNDEF works well with partners across political and ideological orientations. UNDEF-projects also complement larger development initiatives by working at the expert-local level, with a (self-evident) focus on marginalized areas where development need is highest. Conclusions & Recommendations The meta-evaluation concludes that UNDEF-funded projects carried out by knowledgeable grantees with technical expertise relevant to the scope of activities have demonstrated strongest project designs and problem-solving skills, enhanced by what this evaluation refers to as “project elasticity.” These qualities result in effective, efficient, coherent and context-relevant initiatives. Projects that build strategies to transfer ownership of processes to participants and stakeholders have the highest potential for effectiveness, impact, and sustainability. This evaluation proposes a set of recommendations around processes to further strengthen UNDEF-funded work in Tunisia in the future. UNDEF is at a competitive advantage to continue funding both local expert CSOs (e.g., capital-based), as well as smaller grassroots organizations. Recommendations for processes include on-going reviews of activities as they function coherently in project designs, and as these relate to contextual needs in the near future, in which Tunisia is moving towards democratic consolidation. Project implementation partnerships play an important role in varying degrees throughout all grants and are critical to the transfer of ownership and sustainability – recommendations specifically address this process and relationship. The evaluation also recommends a centralized platform of all UNDEF-funded materials, as these are useful for future project designs and contain critical information for future grantees.
Evaluation Date
May 2021
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

There was little incentive for the CSOs in China to invest in developing the student connection. The project made no financial provision to assist the partner CSOs, most of which were struggling to survive.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

Three of the problems encountered, which arose from mistaken assumptions about three of the principal set of participants in the project, were rather basic, suggesting gaps in the initial needs analysis and feasibility assessment conducted by the project team. The first concerned the primary beneficiaries, the young migrant workers, and a lack of fit between the character of planned project activities and their way-of-life. It was discovered that they had limited time availability and an unpredictable schedule of working hours. Given what is widely known about the conditions of work and living of migrant workers, this should not have been a surprise.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

The grantee may wish to consider including a mix of government-supported (or government-approved) partners, along with independent CSOs in its projects. It is also recommended that it consider cooperation with CSOs and local agencies with a social service orientation, injecting a rights-based agenda into a broader approach to meeting the needs of young migrant workers.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

In the sphere of social media, the grantee assisted the trainees in establishing micro-blog and instant messaging accounts with well-known service providers in China. A small number of the trainees, drawn from the ranks of the Focal Points, emerged as young labour leaders, playing important roles in organizing their colleagues to petition employers and local government on specific labour grievances, and, at times, mobilizing other YMWs to take part in strike or protest action.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

Student participants seem to have learned a great deal about the experience of migrant worker life in China. Around 30 students became thoroughly engaged and met frequently. Once the training was completed, the students who remained involved pursued two lines of activity: to work with CSO partners in support groups to assist workers groups with effective use of social media, and, secondly, to assist the grantee with running the web-site dedicated to young migrant workers.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

The project was built around the contribution that social media and E-Learning, through the project web-site, might make to connecting workers to each other and a wider world of knowledge, ideas and practical possibilities, to help them to change their lives for the better. Unfortunately, it was found that young workers were not familiar with computers, had limited access to them, and little time or inclination to work on E-Learning courses. Inexpensive smart phones are favoured by young migrant workers as their tool for communication. However, the phones are used for social purposes and entertainment and have limited capacity for downloading large files. This limited to a considerable degree the relevance of project strategy in this sphere.

Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country
LESSON

Lesson Learned: Empowering Vulnerable People through Internet: E-Learning Initiative for Young Migrant Workers in China

The project tried to do too much with too many beneficiaries in too many locations. A more focused project would have been both more efficient and more effective. For the most part, project resources were deployed well in support of the project plan. However, in retrospect, given the limited success of the E-Learning and social media components, as well as the limited duration of the engagement that the project had with most youth trainees, there are questions as to whether project resources were utilized in the most efficient way to support the designated beneficiaries.
Project Partner
ICO Institute for Social Agenda
Project Description
The project succeeded in meeting its targets in its final phase, including the development of 20 proposals and petitions by young migrant workers and CSOs working with them, concerning desired improvements in working and living conditions. Of these, eight described practical initiatives or small projects. Each of the eight was awarded a small grant to implement the plans proposed. While some students gained valuable experience, many of those involved lacked the commitment to taking an active role in support of the young migrant workers. Further, the role assigned to the students in “assisting young migrant workers using social media” was vague, and they lacked guidance on what to do and how to do it. In addition, the students, as well as the academic coordinators and the CSO representatives interviewed, all commented on the wide social gap between students and the young workers, which made communication difficult.
Evaluation Date
April 2015
Country