MaM relied on multiple tools built-in into the project to monitor activities and assess progress, allowing it to adjust implementation to new emerging elements. In addition to monitoring activities, three key research activities – an Impact Evaluation, a pilot study on mental health and psychosocial support, and post-activity Surveys – provided information about the impact and effectiveness of different activities.
Monitoring
The monitoring system compiled information from different data sources to report the project's progress. The primary data source was the Project Management (PM Tool), a custom-built web-based system where project teams completed specific reports on activities implemented, content produced, and media coverage received. The PM Tool also acted as a project library for all project information such as reports, case studies, guideline documents, and so on. The information gathered was compiled and reported to the different stakeholders through:
-
Dashboard tracking progress toward the results matrix indicators.
-
Country-specific monthly one-pagers.
-
Monthly and yearly reports for the donor highlighting activities in the field, content shared on social media profiles, and Volunteers' initiatives.
Impact Evaluation
Purpose: To assess the impact of a peer-to-peer awareness raising campaign on young people's knowledge, attitude, intention and perception towards irregular migration and safe alternatives to irregular migration in West Africa.
How was it implemented:
-
The research team created an experimental design with a cluster randomized control trial (cRCT) approach in which enumeration areas (EA) (clusters) in four countries – The Gambia, Guinea, Nigeria and Senegal - were randomly assigned to a treatment and control group. The treatment group received the intervention, i.e. MaM Volunteers held community outreach activities with them, while the control group did not. The study's data collection was scheduled before and after the implementation of activities.
-
The timeline of the study was the following:
-
Baseline data collection in the treatment and control areas.
-
Intervention, i.e. MaM community engagement activities in the treatment areas.
-
Follow-up activities in the treatment areas
-
Endline data collection in the treatment and control groups.
Pilot Study on Mental Health and Psychosocial Support
Purpose: To explore and identify possible effects of involvement in MaM on Volunteers' mental health and psychosocial well-being.
How was it implemented:
-
Study was designed using a mixed-methods approach:
-
Quantitative:
- 314 MaM Volunteers across seven countries participated in a questionnaire conducted four times over two years.
- IOM staff or hired enumerators, who had been trained and briefed, administered the questionnaire.
-
Qualitative:
- IOM staff facilitated 24 semi-structured in-depth interviews and two focus group discussions with Volunteers in Côte d'Ivoire.
Post Activity Surveys
Purpose: A monitoring activity that assessed the target audience's knowledge and intended behaviours of irregular migration following participation in a MaM on the ground activity.
How was it implemented:
-
Developed a strategy that included 500 surveys per country (of which 200 are female respondents) to be conducted with young people (18-30) who participated in community outreach and youth engagement activities throughout the project.
-
Developed a French and English questionnaire uploaded on IOM's CRM App.
-
The country offices implemented the surveys according to the following guidelines:
- BEFORE THE ACTIVITY: Select a variety of community engagement or youth outreach activities to conduct Post Activity Surveys. Focus on activities that communicate the risks of irregular migration and local opportunities.
- DURING THE ACTIVITY: Select the respondents RANDOMLY and arrange appointments for interviews.
- AFTER THE ACTIVITY: Conduct the survey at least 24 hours after the activity either in person or on the phone. IOM Staff, Volunteers or hired surveyors could conduct the surveys.
Tips on future implementation:
Involve MaM Volunteers in the design, implementation, analysis and dissemination of research activities. The earlier they are involved in the process, the more likely the research activity will be relevant to them and their peers.