*****
*****
Capacity development also known as capacity building or capacity strengthening, is an integral part of the NIPN approach. When capacity is weak or absent, a NIPN cannot function, deliver or be sustained. As the NIPN approach, and especially the step of ‘Formulating policy-relevant questions’, is new and requires a different way of working for policy decision makers and data analysts, capacity development is essential to implement the NIPN operational cycle. There is no one established way of building capacity. Rather, it is a continuous learning and change process which requires a variety of tools and methods, a flexible approach, and long-term investment. Frequently, capacity development efforts translate into one-off technical trainings but these will not lead to sustained improvements unless they are part of a broader long-term approach. A first step for a NIPN country team is to identify the capacities that are required for effective implementation of NIPN at each of the three levels (individual, organisational and systemic), and for each element of the NIPN operational cycle (question formulation, analysis of data and communication of findings). This is largely a theoretical exercise which can be carried out during the inception phase of a NIPN in country.*****
What are the capacities required for NIPN to function well in a country?
The NIPN Capacity Framework helps to understand the breadth of capacities required for the optimal implementation of a NIPN. These go beyond an individual’s capacity in terms of knowledge, skills and experience, and encompass organisational and systemic capacities. The three levels of capacities are inter-dependent. The physical capacities, tools (individual level) and infrastructure (organisational level), mentioned in the model below (Potter, 2004) encompass equipment such as computers or infrastructure such as training centers. These capacities have been included in the project formulation phase and will not be discussed in this guidance note that focuses on the development of human resource capacity.
A NIPN will focus most strongly on strengthening the internal capacities directly relevant to implementing NIPN (at individual and organisational levels). It is also important, however, to consider the external system, as weaknesses in the multisectoral nutrition system may become obstacles to the implementation of the NIPN operational cycle.
Based on: Potter, C and Brough, R. Systemic Capacity Building: A Hierarchy of Needs. Health Policy and Planning 2004;19:336-345.
*****
*****
A NIPN capacity matrix, which is derived from the NIPN Capacity Framework, is used to organise the capacities required in a logical way. It represents the ideal and a basis for identifying the capacity gaps. The aim is to generate a list of required capacities for each empty box.
When the process of filling out the tables for each of the levels of the Nutrition Capacity Matrix is complete, a comprehensive list of all capacity requirements for the smooth functioning of a NIPN has been compiled.
Functional or ‘soft’ skills are as important as technical skills and knowledge, so should be listed separately (see the text box below).
Starting at the individual level, take one box at a time and compile a list of capacities for each of the 3 steps of the NIPN operational framework by addressing the following questions:
*****
*****
Repeat the same process for the organizational level by addressing the following questions:
The organisational capacities are the same for all three elements of the NIPN operational cycle.
The below table provides examples of NIPN organisational capacity requirements but needs to be completed for each country context.
*****
*****
The systemic level refers to the national system or ‘enabling environment’ for nutrition. The systemic capacities are the same for all three elements of the NIPN operational cycle.
In most NIPN countries, a landscape analysis has already been completed to assess the national nutrition structures and system. This has either been done by the NIPN country team or entities such as the SUN Movement Networks. This landscape analysis can be used to identify where the system is functioning sub-optimally and requires to be strengthened. Though the main purpose of NIPN is not to strengthen the systemic nutrition capacity in a country, a NIPN may support other agencies that are doing so.
*****
How is existing capacity to implement NIPN assessed and gaps identified?
The objectives of a capacity gap analysis are to:
There is no single ‘right’ way of conducting a NIPN capacity gap analysis. The exact format of a capacity gap analysis for the purpose of NIPN will depend on the country context, time and resources available. Typically, it involves gathering and analysing qualitative data.
Some general principles that can be followed include:
*****
The SUN Movement has provided detailed guidance on how to conduct a nutrition capacity assessment and suggests a phased approach (see text box). Make use of the Capacity Development Framework presented in this Guidance Tool.
Two SUN Movement guidance documents have been produced to support countries to conduct nutrition capacity assessments. These assessments are focused on the systemic level, and are comprehensive assessments of the capacity to plan, coordinate, finance, implement and monitor nutrition programmes. Whilst this remit is much broader than is required for the purposes of a NIPN, the guidance provides some useful tips and sets out the three phases for carrying out an assessment.
Source: SUN UN Network. September 2016. Nutrition capacity assessment package – Part I – Guidance note & Part II – Tools and Resources.
*****
Capacity gap analysis requires a specific set of skills, expertise and time. It is advisable to seek external specialist technical assistance before embarking on the process.
In Ethiopia, for example, technical assistance was provided by IFPRI’s Head of Capacity Strengthening to guide the process of NIPN capacity gap assessment and analysis (see the case study on Ethiopia below). The REACH (Renewed Efforts Against Child Hunger and undernutrition) partnership has facilitators who focus on strengthening the capacity of national stakeholders and institutions and may provide a source of expertise in the countries in which they work. Other development partners may also be able to provide specialist technical assistance.
*****
It is good practice to adopt a number of different methods to gather and triangulate qualitative data and validate quantitative data e.g. questionnaires, workshops, on-line survey, and focus group discussions (see the Chad example and Ethiopia case study below).
Taking the form of a qualitative study, and supported by REACH, information was gathered using three methods:
- a desk review,
- key informant interviews and
- focus groups with representatives from government and the respective SUN networks.
The study focused on the functional capacities of the Permanent Technical Food and Nutrition Committee and the newly established food and nutrition committees in five regions – Guéra; Logone Occidental; Ouaddaï; Tandjilé; and Wadi Fari – looking at their respective capacity to plan, manage and coordinate nutrition actions. The assessment identified a series of capacity development needs, and documented strengths and achievements.
Source: SUN UN network
*****
The completed NIPN Capacity Matrix contains a checklist of capacities that can be transformed into questions to ask during a gap analysis. The table below includes examples of questions relevant to the first step of the NIPN operational cycle: Policy-relevant question formulation. Similar and additional questions need to be formulated for the other steps as well.
Large amounts of qualitative data can be difficult to analyse systematically. It is important to adopt some kind of system so that gaps can be identified. Examples of techniques that have been used are:
The final step of the capacity gap analysis is to prioritise areas for NIPN capacity development. It is essential to involve national stakeholders to ensure that they are fully on board with the final list of priority areas and types of actions being considered. This is best done through a series of consultations or a consultative workshop.
What is included in a country NIPN capacity development strategy and plan of action?
Again, there is no one ‘right’ way of setting out a NIPN capacity development strategy and plan of action. It will depend upon the findings of the nutrition capacity analysis and the particular country context.
Some general principles can be followed:
*****
It is important to focus on the priorities identified by stakeholders rather than produce a long ‘wish list’ that will be difficult to achieve. Furthermore, the focus should be on the organisations and individuals that are most critical for implementing a NIPN. Though a poorly functioning national nutrition system can present considerable challenges for the implementation of NIPN, others (government and development partners) working through initiatives such as the SUN Movement can take the lead on systemic capacity development, with support from the NIPN country team.
*****
Experience in NIPN countries has shown that there may be short-term capacity strengthening needs which can be addressed immediately. In Ethiopia, for example, the NIPN country team responded to immediate needs by organising three short training courses to develop skills in the statistical software STATA, in analysis of household survey data and in doing a literature review (see the Ethiopia case study on page 9).
It is vital that short-term capacity actions are linked to a longer-term strategy for a number of reasons. High staff turnover means that staff with skills and experience are continuously being replaced by staff who may not have the same skills and experience. Without on-going support and mentoring, the benefits of short-term efforts such as a one-off training can be lost. Longer-term strategies may include building NIPN related technical and functional skills into pre-service and in-service training of nutritionists and cadres working in nutrition-related sectors, such as food security, WASH, health, social security.
*****
Its aim is to create purpose-driven teams and organisations that effectively lead result-oriented nutrition change interventions.
Developing and integrating managerial – leadership skills with existing technical skills is a critical success factor in effectively implementing nutrition interventions, The idea is not new, but its application in multisectoral teams working in nutrition, is.
The programme creates awareness of leadership orientation, strengths and gaps, personal values and purpose and helps to develop amongst others communication, conflict management, decision making, and problem solving skills.
Source: https://www.africanutritionleadership.org/
Examples of capacity development opportunities for NIPN which are already in place include:
Knowledge ‘brokering’ ensures that knowledge commonly available to researchers or global experts is being shared with policy makers, planners and implementers across different types of local organisations. It is important in the context of NIPN because academics have access to global resources and skills (such as the ability to analyse complex data or policy questions, conduct literature reviews, link to global databases and knowledge) which can support and strengthen processes and decisions in the national multisectoral nutrition coordination system.
Examples of knowledge ‘brokering’ include:Seminars
In Ethiopia IFPRI / NIPN are organising monthly nutrition policy and research seminars which support informal capacity strengthening by bringing together researchers and policy-makers to:
- Disseminate existing research findings with the objective of promoting nutrition knowledge among decision makers.
- Promote interactions between decision makers and researchers.
These seminars have focused on themes such as Food Systems and Diets in Ethiopia and Nutrition Sensitive Agriculture.
Newsletters and websites
Circulating nutrition-related research findings to a broader audience can be done through newsletters, E mail updates and websites.
The European Union Delegation in Ethiopia circulates a weekly e-newsletter containing relevant nutrition-related articles. The newsletter is circulated to over 100 nutrition partners in Ethiopia as a means of broadening the nutrition knowledge base.
A similar approach has been taken by POSHAN (Partnerships and Opportunities to Strengthen and Harmonise Actions for Nutrition in India) led by IFPRI. Research Notes, which present a concise summary of research studies conducted by POSHAN and its partners, are available on the POSHAN website and help to extend access to the evidence base to a wider audience.
It is important to establish and M&E framework in the capacity development strategy so that progress can be fully monitored. An example based on the SUN Movement Nutrition Assessment Guidance 2016 is presented below.
The long-term goal of capacity development should be formulated as a learning or transformation process and should combine both technical and functional capacities.
The specific objectives are the changes to be achieved through a capacity development programme in the medium term. These are the changes at the outcome level.
Outcomes describe a specific change for individuals and organisations and are linked to outputs. Outcomes can be thought of not only in terms of new products and services but also in terms of facilitated processes (e.g. participatory process initiated/activated/expanded, collaboration increased among different organisations).
Focusing outputs on capacity development creates the foundation for sustainability of the intended results. To formulate outputs, the following questions can provide guidance: Whose capacity is developed? What capacity is developed? How do activities ensure that capacities are developed?
Activities are the modalities of the interventions, e.g. training and technical assistance.
Indicators are targets that show progress. When defining capacity development indicators, a distinction should be made between:
- Process indicators: Measure processes that have been facilitated so that dynamic changes are encouraged through implementation of participatory approaches (e.g. process through which stakeholders have been engaged in a NIPN).
- Product indicators: Measure concrete results that have been achieved (e.g. formulation of an answerable policy question).
*****
Costing the plan of action is an important step as it will help to take the most cost-effective decisions. For example, it may be much more cost-effective to provide on-going technical assistance and mentoring to a NIPN team involving 5 people, or an in-country training course on statistical tools for NIPN data analysis component and data analysts of the host organisation, than to fund one individual to complete a degree course.
*****
Using national survey data from DHS and MICS, a trend analysis can be used to estimate the Average Annual Reduction Rate of stunting (see section 3.6). The same method can be applied to other target indicators.
With this method, questions can be answered such as:
(Source: EU Action Plan on Nutrition)
This analysis carried out at global level shows that the current AARR is insufficient to achieve the 2025 target.
NIPN in Guatemala aimed to study progress based on the implementation of three consecutive national multisectoral nutrition strategies, and more specifically with regard to the budget allocation to nutrition over the past 12 years.
The results have been published in a full report and a brief and presented by SESAN (the Secretariat for Food and Nutrition Security) for discussion with national and sub-national government authorities, international cooperation and civil society partners, as well as with Congress.
It is being used to advocate – at the time of the 2019 elections – for better implementation of nutrition actions and, where appropriate, to consider adjustments to implementation or budget allocation.
It can be very useful to do a stakeholder analysis of the overall nutrition audience to better understand which actor has which attitude towards the project and how influential that person is.
Someone who is very positive and influential could become a champion for the project in the communication approach, whereas someone who is largely negative about the project’s approach, but also influential needs to be managed carefully and communication with this person should be geared towards changing her/his attitude from negative to neutral.
If a person with a negative attitude is perceived as having very limited to no influence, less efforts need to be made to communicate with him/her.
A stakeholder mapping is usually done along 2 dimensions: the level of interest in the topic/project (negative to positive) and the level of influence or power the stakeholder has in the target community (in the case of NIPN, the multisectoral nutrition system).
Visibility of a specific organisation, project or initiative can be created by using their logo and acknowledging their contribution in the different communication events that are being organised.
For instance during a launch event of NIPN in a country, the logo of the implementing organisations and the donors should be displayed, and if available the logo of the NIPN (either the global NIPN logo or the one which has been created specifically by the country NIPN).
The NIPN countries which receive funding from the European Union are requested to develop a visibility plan following specific EU guidelines.
Communication and visibility are not the same. Communication is about specific messages that one wishes to convey, to achieve a well-defined objectives, reaching specific target audiences, using appropriate communication channels and tools. A communication plan is more elaborate, but can include a specific chapter on how it intends to create visibility for the NIPN.
Creating a specific identity and branding for the NIPN, including the design of a logo and the use of consistent templates/formats for reports and presentations, is part of the visibility plan.
The parameters of the WHO UNICEF TEAM group of 2017 are now used as the reference.
Notes:
Special Note: there seem to be a missing data point in the example provided. The example to generate the AARR seems to be based on 8 data points (including 2005) while the table provides only 7 data points. When using the 7 data points, the coefficient equals -0.0669 (and not -0.06613) and AARR is still 6.4%.
Link:
http://apps.who.int/nutrition/landscape/report.aspx
Main features of the WHO NiLS country profiles:
The WHO NiLS country profiles contain the following sections:
Extract from the WHO NiLS country profile of Guatemala
Link:
http://countdown2030.org/country-and-regional-networks/country-profiles
Main features of the Countdown 2030 national profiles:
The Countdown 2030 national profile contains the following sections:
Extract from the Countdown 2030 national profile of the Republic of Côte d’Ivoire
Link:
https://globalnutritionreport.org/
Main features of the GNR national dashboard:
The GNR national dashboard contains the following sections:
Extract from the GNR national dashboard of Uganda
Link:
http://poshan.ifpri.info/category/publications/district-nutrition-profiles/
Main features of the POSHAN district dashboard:
The POSHAN district dashboard contains the following sections:
Extract from the POSHAN dashboard of the Bokaro district
National dashboards have been produced for the SUN countries. Sub-national dashboards are currently being produced, which are slightly different and designed to compare data across districts.
Main features of the SUN MEAL dashboard:
The SUN MEAL dashboard contains the following sections:
Extract of the SUN MEAL national dashboard for Lao PDR
Administrative sub-divisions differ across countries. For the purpose of this tool the following definitions are adopted:
“Region” is used as a generic term in the tool for “Sub-National Level 1”. The notable exception is Côte d’Ivoire where “Region” actually refers to “District”.
The underlying objective behind this question is to be able to improve targeting of the intervention.
This randomised controlled trial measured the impact of an intervention that was designed to reduce stunting.
Between 2010 and 2014, it was observed that:
Results from secondary analysis of Tubaramure, a food-assisted integrated health and nutrition programme in Burundi
(Source: Leroy J.L., Olney D., Ruel M., 2016. Tubaramure, a Food-Assisted Integrated Health and Nutrition Program in Burundi, Increases Maternal and Child Hemoglobin Concentrations and Reduces Anemia: A Theory-Based Cluster-Randomized Controlled Intervention Trial. The Journal of Nutrition, 146(8), 1601-1608, https://doi.org/10.3945/jn.115.227462.)
In the last two cases, an incorrect conclusion has been reached.
The characteristics of a potential confounder are as follows:
Example: Has investment in programme A led to reduced anaemia levels?
Possible factors confounding a conclusion regarding the impact of one intervention on anaemia levels could be, for instance:
Without controlling the data analysis for confounding factors, it is not possible to attribute the reduction of anaemia levels to the nutrition intervention.
This equity analysis of child feeding practices shows that some practices are more sensitive to the levels of incomes (minimum diet diversity) than others (early initiation of exclusive breastfeeding).
Equity analysis is useful to determine whether the progress achieved is benefiting all, and, in particular, the most vulnerable.
If most of the progress is only observed in households with higher incomes, this suggests that there may be a problem in the targeting or design of the interventions.
(Source: Global Nutrition Report)
Iron-folic acid supplements are delivered through health services. These combined data show that most districts with low levels of iron-folic acid supplements also have low ANC visits coverage, suggesting an issue with access to health services.
But the analysis also shows that quite a few districts with good ANC visits coverage also have a low coverage of iron-folic acid supplements, suggesting issues with delivery.
Further investigation is needed to provide better insights into what is needed to improve the coverage of iron-folic acid supplementation.
Source: POSHAN
A descriptive analysis looking at regional disparities shows that the three regions with high levels of stunting also have high levels of open defecation practices.
This can be a starting point to further investigate why open defecation is high in those three regions and whether other determinants are also showing high levels.
(Source: REACH, Example of Ghana MICS, 2011)
A National Food Assistance programme has been implemented in Mexico for decades.
In 1994, a descriptive analysis of the levels of incomes of the beneficiaries of the programme showed that the programme was not very effective at targeting the poorest households.
After active measures were taken, the same analysis showed that in 2000 a much greater proportion of the programme’s beneficiaries were indeed those with the lowest incomes.
Source: Levy, S. (2006). Progress against Poverty. Sustaining Mexico’s POP Programme. Washington, DC: Brookings Institution Press.
Between 1994 and 2000, the Government of Mexico improved the targeting of the Food Oriented Social Assistance programme:
This Venn diagram shows the population affected by one or more forms of malnutrition.
It is taken from the Global Nutrition Report, which analysed national level data.
Similar analysis can be carried out at sub-national level to show which regions are affected by which forms of malnutrition and what actions are needed.
It allows the issue of the double burden of malnutrition to be highlighted.
The same figure with the actual number of children affected by region can highlight where to invest.
(Source: Global Nutrition Report)
1. Why a data analysis plan?
“A data analysis plan helps you think through the data you will collect, what you will use it for, and how you will analyse it. Analysis planning can be an invaluable investment of time” (Center for Disease Control and Prevention, 2013)
The method for creating a data analysis plan in the context of a NIPN is not much different from the method used in a research context.
In the context of NIPN, the process should be simpler because:
The next section describes briefly the content of a data analysis plan focusing on what is a bit specific to the NIPN.
As general recommendations:
Recommended sources to read:
Center for Disease Control and Prevention (2013) Creating an analysis plan. Atlanta.
Simpson, S.H. Creating a data analysis plan: what to consider when choosing statistics for a study (2015).
2. What is a data analysis plan?
Main sections of a data analysis plan (based on CDC module):
3. Main question and sub-questions
At this stage, the policy relevant question (and, in some cases, its sub-questions) is already well defined (section 3.4, page 11).
Answering all the sub-questions will provide a full answer to the main question.
4. Dataset(s) to be used
The dataset(s) needed is (are) listed. In the context of the NIPN, particular attention may be needed on data management: as the dataset(s) may come from different sources and/or may not have been designed for the main question, there could be quite some work to be done to harmonise / append / clean the raw dataset(s).
5. Inclusion/exclusion criteria
In this section population subgroups, geographic scope, timeframe… are very precisely defined.
The definition of the data quality level is also required for the analysis.
Indeed, depending on the analysis, a more or less strict data quality level could be required.
This point is detailed in the Data Quality training module (section 3.3).
6. Variables to be used in the main analysis
In this section the exact variables/indicators to be used in the analysis must be defined.
For example, to analyse “obesity”, it needs to be defined whether the indicator is Body Mass Index (BMI) and if different categories of BMI will be used or the mean BMI or both.
In the context of NIPN, the harmonisation of the definition of indicators across datasets will be important.
7. Statistical methods and software to be used
Ensure coherence with section 4 of the guidance notes on data analysis.
Also, to provide only indisputable analysis (principle 3 section 3.4, page 4), make sure that the statistical method used is coherent with the datasets available and the data quality of these datasets. The choice of the statistical method is key to avoid over-interpretation of the data that could lead to misleading conclusions.
Does the NIPN team has the technical capacity to handle the statistical method and the software identified?
8. Table shells
Nothing specific to NIPN.
9. Estimation of time and resources
At this stage, a precise estimation of the time and resources needed to conduct the analysis should be made.
If this estimation lead to more time than the initial estimation made during the data analysis framework, you may adjust the question/s to be addressed first.
NIPN is unique in that it brings together and values multiple data sources shared by the various sectors that influence nutrition: health, agriculture, water, sanitation and hygiene, social protection, and education, among others.
Typical data that NIPN would use comes from:
This list is not meant to be exhaustive. Each country should explore the wealth of information available. The data landscape exercise is useful for this purpose (see section 3.1).
To estimate the consistency of population data, it is important to have a good estimation of the denominator used to calculate an indicator from routine data. To assess population data, they are compared to an external source.
The DQR gives an example comparing an estimate of population using government official data with UN estimation.
The external consistency of the indicator can be assessed comparing routine data and survey data for the same period of time and geographical level.
The tool can be also used to assess consistency between related indicators
Routine data consistency over time (Domain 2: Internal consistency of reported data) can be assessed using the DQR. Its uses the mean of the three preceding years for the indicator that is compared to the indicator value of the current year.
Routine data consistency over time (Domain 2: Internal consistency of reported data) can be assessed using the DQR. Its uses the mean of the three preceding year for the indicator that is compared to the indicator value of the current year.
Routine data consistency over time is assessed as part of the Internal Consistency domain. It uses the mean of the three preceding years for the indicator that is compared to the indicator value of the current year.
Use of this feature for nutrition indicators should be carefully studied as countries are currently making efforts to:
The identification of outliers is part of the Internal Consistency metric. To compute extreme outliers the tool compares, for a given year, the rate to the median value of the three preceding years. Thus when the value is greater than 3 standard deviations from the mean it is considered as an extreme outlier.
The WHO 2017 DQR offers different ways to display reporting completeness at district or national level : either in a table or a graph.
The table below presents some metrics included in the Data Quality Assurance Tool of Measure Evaluation (Measure Evaluation: The Data Quality Assurance Tool for Program-Level Indicators, 2007), which are not explicitly included in the WHO DQR.
The use of metrics depends on the objective of the tool and therefore of the assessment.
The WHO DQR propose four data quality domains that categorise the metrics. Some authors call these metrics attributes or dimensions to characterise data. The table below presents the four domains and their metrics of the WHO DQR 2017.
WHO DQR integrated into DHIS2 for countries implementing DHIS2 – 2019
Advantages:
Disadvantages:
Advantages:
Disadvantages:
Measure Evaluation DQA Tool – 2008 – Prototol 2: Data Verification
Advantages:
Disadvantages:
Measure Evaluation RDQA – 2009 – Checklist to assess program/project data quality
Advantages:
Disadvantages:
Measure Evaluation RDQA – 2010 – Checklist to assess program/project data quality
Advantages:
Disadvantages:
Measure Evaluation RDQA – 2015
Advantages:
Disadvantages:
Sources:
The NIPN may have the objective to use data from a MICS survey to study a particular region. A National Survey like a MICS has the primary objective to produce national figures. A study(1) concluded that “anthropometric data quality was highly variable both between and within survey sources and over time”. This is confirmed by interviews of experienced practitioners(2). Typically, data from a region with difficult access for logistic or security reasons can be of lower quality. The data quality of that region may be good enough to contribute to the production of a national figure but the NIPN may want to apply more stringent data quality criteria to study that region specifically.
References:
Health routine data are usually compiled with the objective to detect epidemic episodes. In low resources settings, routine data can be incomplete and can include measurement errors. However, analysed carefully, routine data may be good enough to observe medium term trends or seasonal trends of a particular condition.
November 15th, 2018
Recap
The NIPN team in Niger conducted a data mapping study between November 2017 and May 2018, during the start-up phase of the project, using an external consultant. The aim of the study was to carry out “an inventory and analysis of the information and data systems for nutrition in Niger”. The study was carried out by the INS (National Statistical Office), under the strategic direction of the High Commissioner to the 3N “Nigeriens Nourish Nigeriens” initiative. This interview highlights:
How did the study go? What were the main challenges encountered?
The structures to investigate were identified based on the institutions named as “responsible” or “collaborative” in the eight commitments of the National Policy for Nutrition Security (PNSN).
Questionnaires were given to the sectors, resulting in a significant loss of time. The best method is to meet with the institutions directly and carry out this mapping work with them. The necessary information was obtained after just two or three visits to each institution and only the institutions at the central level were investigated. This was a limiting factor because certain information, notably on the data quality monitoring mechanism, is available at sub-national level.
Due to the sheer volume of information collected, there was an enormous amount of simplifying and restructuring work to be done by the NIPN team. The ‘sector sheets’ were systematically created, consolidating the various elements.
This led again to considerable delays: instead of being finalised by the end of December 2017, the study was finalised in May 2018 and pushed forward until February 2019.
How did you use the results of the study?
Firstly, the study provided objective information about the available data from multiple sectors.
The results allowed us to draw up an initial list of indicators available in each sector in an Excel file.
The study also produced ‘Sector Sheets’ which outline:
Following the data mapping, it became apparent that there was an urgent need to put together a referential database of NIPN indicators. In fact, in Niger there is no existing framework providing an official list of the multi-sectoral indicators for nutrition. We are working to adopt nutrition-sensitive indicators in each sector. These indicators will serve as a basis for the NIPN platform.
Taking into account the institutions’ capacities, we decided to recruit a few ‘Sectoral Study Officers’ for four months.
The Sectoral Support Officers have access to clearly identified indicators and will have to ensure that the values for each indicator are collected (15 October 2018 – 15 February 2019), which is a necessary prerequisite for organising the data and building the ‘Nutrition Info’ module. The work of the Sectoral Support Officers will enable us to:
The ‘Sectoral Study Officers’ also make it possible to strengthen capacities in each sector and build relationships that will facilitate access to multi-sectoral data at a later stage.
The exercise is still vast and the scope of the exercise can be further reduced by considering the following:
1) The range of datasets to investigate
For example, Côte d’Ivoire decided to investigate the datasets managed by key sectors involved in nutrition (health, education, gender, social affairs, agriculture, animal resources, water, economy, finance & planning) and other agencies known for managing databases (National Agency for Rural Development, National Water Offices, etc.)
“Key sectors” are those involved in the Multi-sectoral Plan of Action for Nutrition. In some countries this list can be much more vast, including more than ten ministries. For the sake of the data landscape exercise, it is recommended to reduce the list of data providers to investigate to keep the exercise feasible. Other sectors could be investigated in a second stage using the experience of the first exercise.
2) The level of detail of information to collect for each dataset
NIPN teams can decide the level of detail necessary to collect for each dataset. One option is to request a detailed description of datasets only for some prioritised sectors.
The scope of the data landscape exercise can be reduced by looking at:
1) The number and range of indicators to investigate
There are several ways to decide the number and range of indicators to include in the matrix:
2) The level of detail of information to collect for each indicator
There are several options to consider when deciding the level of detail for each indicator, which include:
An information system is a system of interrelated components that work together for collecting, processing, storing and disseminating information amongst stakeholders/beneficiaries to support decision-making, coordination, control, analysis and visualisation (e.g. DHIS-2; National Statistics Office repository; DHS platform).
A dataset is a file that contains all the individual records of one specific survey (e.g. DHS survey in country “X” of 2005). A dataset can be available in one or more information systems. For example, the Niger DHS survey of 2012 can be found in the STATcompiler information system (DHS official platform) and in the information system of the National Statistical Office of Niger.
An indicator is calculated based on one or more variables from a dataset.
The same indicator can be found in different datasets but may or may not be comparable because:
ORIGINAL BROAD QUESTION: Is the budget allocation enough for each education intervention?
REFORMULATED BROAD QUESTION: Is the budget allocated to education sector as part of the National Nutrition Strategy equal to what is costed (planned), for each of the planned intervention and how do the provinces prioritize nutrition?
SUB-QUESTIONS:
REFORMULATION OF SUB-QUESTION 1:
ORIGINAL BROAD QUESTION: Why does the production of ’nutritious crops’ not increasing?
REFORMULATED BROAD QUESTION: What factors can explain that the production of ’nutritious crops’ are not increasing?
SUB-QUESTION:
REFORMULATION OF SUB-QUESTION:
ORIGINAL BROAD QUESTION: How can we improve the VAS coverage (national baseline being 38%)?
SUB-QUESTIONS:
REFORMULATION OF SUB-QUESTION:
Based on the SUN Movement Secretariat (SMS), 2015. The contribution of agriculture and social protection to improving nutrition; Scaling Up Nutrition in Practice. Geneva.
Developing more detailed impact pathways than the ones shown in this example, which highlight specific assumptions and specific relationships between activities, outputs and inputs, will allow the formulation of more specific and detailed questions to help identify bottlenecks, such as:
Have investments (input) in WASH interventions (activity) led to better access to WASH facilities (output), resulted in a reduction in % of children suffering from diarrhoea (outcome) and reduced child undernutrition (impact)?
1. Break the question down into more specific questions to better understand the intermediate steps of the impact pathway.
For example:
2. Unpack the question to identify the indicators, the relationship between the indicators and any assumptions, in order to generate more specific questions that can be answered by the data available.
For example:
3. Zoom in on a specific question and unpack it further.
For example:
At this stage, the team should have good knowledge of the various decision makers along the implementation chain. Focal points working in the respective sectors can help the NIPN team to identify them.
Decision makers are not necessarily limited to policy makers: programme planners and implementation officers are other actors along the implementation chain who are also making decisions to improve nutrition actions at their level.
Categorising the decisions makers, according to the administrative level at which they intervene and according to the type of decisions they can make, will help to assess the diversity of the NIPN stakeholders’ needs.
A further stakeholder mapping exercise will help to define the target audiences, the policy relevance of the questions to them, their level of interest and level of influence in the specific nutrition policy questions. This is important in order to fine-tune and align the ‘storyline’ of the findings with each target audience of decision makers (for an example of this exercise, see section 4.1, page 3).
Ultimately, the review process will give the NIPN team an initial idea of the decision makers’ priorities and the corresponding time frame on which the ‘questions-analysis-findings’ cycle should focus.
The initial selection of the priorities will be based on the information pulled together in the policy review, using the previous tips, and on the feedback from stakeholders.
At the same time, the team will need to decide at which administrative level the NIPN cycle is able or intends to strengthen the decision-making process. This will depend on the level of decentralisation of governance, the interests of policy makers at that level and the availability of data at sub-national level. The demand for information is likely to be higher at sub-national level, where capacity to use collected data is often sub-optimal and a feedback loop is often lacking. The sub-national dashboard can support analysis at the decentralised level as long as the process is initiated by decision makers’ interests and question formulation (see section 3.5).
This timeline can help to confirm the priorities of policy makers for the next 12-24 months and will help to identify possible windows of opportunity for influencing planning, formulation or evaluation cycles.
The fictional example below shows that policy makers in this country needed information in 2018 about the progress of implementation of the Multisectoral Plan of Action, phase II, and the probability of achieving the targets by 2020. The absence of a mid-term evaluation made this information need, to be filled by NIPN, more acute.
With an upcoming political transition in 2019, the new policy makers also needed information regarding ‘implementation progress’ to inform the formulation of new policy by 2020.
NOTE: The relationship between multisectoral and sectoral policies or plans can be presented visually in a similar way, to identify whether the latter offer an entry point to strategically support multisectoral efforts.
Prepare a visual presentation of the main multisectoral policies and plans in relation to the undernutrition trend and consider how the trend has evolved during the implementation period.
Do the same for those policies, programmes and/or changes in investment in nutrition that are believed to have been most relevant in previous years.
The priorities and interests of stakeholders will differ depending on the stage of the policy or plan:
Each stage represents a strategic opportunity to improve the next one if the corresponding information and evidence would be available to decision makers.
The assumption is that if the multisectoral policy, plan or programme is well designed, and if the interventions are implemented 1) according to planned coverage and 2) with the desired quality, an impact on the intended outcome should be seen.
Visualising the implementation period of the policy, plan or programme in relation to the undernutrition trend provides an initial idea of the probability of these assumptions being correct.
Work with the data analysts to draw a picture of the magnitude and trends of the undernutrition indicators: it is recommended that DHS and any other prevalence point from validated national surveys are used.
Draw two scenarios:
This exercise is to be carried out or repeated at the sub-national level (region, district) in which the NIPN is strategically interested. If data allow to do so, the NIPN cycle should support decentralised or sub-national decision-making as much as possible, and thus identify the relevant priority questions corresponding to that level.
Documents that can be reviewed during the desk study include:
The Nutrition Evaluation Platforms is an initiative of Johns Hopkins University in four African countries (Mali, Malawi, Mozambique and Tanzania) that was supported by the Government of Canada between 2014 and 2018.
Its objective is to equip government decision makers with the tools and skills needed to critically evaluate the state of maternal, newborn, and child health and nutrition in their countries, and support sound decision making. It is built through a cycle-based approach that progressively adds new types of data, analytical tools and communications skills, and disseminates findings to policy makers concerned with maternal and child health and nutrition.
NEP has been implementing a country-owned and government-led approach. It works with multiple national stakeholders concerned with maternal and child health, nutrition data and decision making, who all have an interest in improving health and nutrition and decreasing mortality outcomes.
To consult the NEP country experience, or to review the outputs generated and lessons learnt, you can consult the NEP website.
The Ethiopia NIPN country team is adopting a dual approach to building capacity by addressing immediate needs for NIPN specific capacity while developing a long term and systematic capacity strengthening strategy which supports the overall monitoring, evaluation and research agenda of the national nutrition program.
To develop Ethiopia’s long-term capacity to manage and maintain a NIPN, it is important to identify existing capacities as well as any additional capacities needed to sustain the NIPN approach in the country. A Capacity Needs Assessment (CNA) was launched in 2018 to explore capacity gaps related to evidence based policy making and the monitoring, evaluation and research agenda of the National Nutrition Program (NNP).
This process was initiated by a workshop, facilitated by the International Food Policy Research Institute (IFPRI), which brought together 36 nutrition monitoring and research experts from various sectors and institutions in October 2018. Most of the workshop participants play a role in the National Nutrition Monitoring, Evaluation and Research Steering Committee, which also has an advisory role for NIPN. The aims of the workshop were:
Workshop participants developed a framework, which included the ‘demand capacity’ for evidence by the policy makers as well as the ‘supply capacity’ of existing evidence, across three related levels (individual, organizational and systemic). As a result of this workshop an approach paper was developed, which guides the subsequent steps of this multisectoral process.
The next step is the actual assessment of the existing capacities and capacity needs, which was launched in the first trimester of 2019 through an elaborate multi-sectoral and multi-stakeholders participatory process. It included questionnaires, interviews and follow-up consultations with key stakeholders from different ministries, national institutions and universities responsible for collecting and monitoring data for nutrition, and for nutrition-related evaluation and research. Information was sought from over 20 national institutions, in addition to key informant interviews with multisectoral users of these data, including programmatic and policy decision makers.
The findings of the capacity need assessment will be used to develop a capacity strengthening strategy, which will be finalized in the second trimester of 2019. In the meantime, action is already underway to address immediate capacity needs within NIPN.
A number of activities were undertaken during the first year of NIPN implementation to address the immediate capacity needs at the individual, organizational and systemic level .These needs were identified through the experiences with the “Learning-by- Doing” demonstration project (see later), rapid capacity needs assessments by direct NIPN stakeholders and were initiated in advance of the NIPN capacity assessment workshop.
Different approaches have been used, including short training courses, ‘learning by doing’ and peer learning. Details of individual capacity development activities undertaken by Ethiopia in 2018 and 2019 are summarized in the table below.
Within EPHI a small, dedicated, team has been assigned to NIPN which collaborates with additional nutrition researchers from EPHI’s Food Science and Nutrition Directorate and other relevant directorates. Their capacity has been strengthened in project management, creating a common understanding of the NIPN approach, analytical and communication capacities and finally creating a better understanding of the different elements of a data repository.
In parallel to addressing short-term needs, the NIPN aims to address long term capacity requirements to manage and maintain a NIPN. Besides the research policy seminars and the multisectoral engagements, they also include:
Long term capacities are being strengthened by involving PhD students from local universities in the formal NIPN training courses. In addition, EPHI has a capacity building budget for staff linked to the NIPN analysis unit or the NIPN advisory committee to attend training (online or formal) in Ethiopia or overseas, which will lead to a certificate, diploma or master’s degree at an overseas university. EPHI can also hire local training institutes and subcontract local universities. There is also a small grant scheme to encourage and support the enrolment of about six staff involved in the NIPN to pursue a PhD programme to sustain capacities beyond the project timeframe. Two researchers have been identified and started their PhD programmes at Addis Ababa University in September 2018.
The Senior Technical and Policy Advisor and the National Research Officer at IFPRI are assigned to support the NIPN full time and they provide continuous support and on the job training for staff and organisations involved in NIPN. In addition, IFPRI provides needs based technical support, which covers a wide set of NIPN skills, including writing, communication and analytical skills. In 2019, a report writing mentor was assigned to provide temporary support to the team. In 2019, IFPRI also assigned a researcher to guide a specific analytical process for further analysis of existing data.
A set of guidance notes on different aspects of the NIPN approach have been prepared by the NIPN GSF. This guidance aims to facilitate a coherent approach to implementing the NIPN operational cycle. NIPN team members from EPHI as well as from other key partner’s institutions from the national nutrition Monitoring, Evaluation and Research Steering Committee participated in webinars as well as in an on-site country workshop on the content of the guidance notes. The NIPN team in Ethiopia will adapt the guidelines to the local context. The NIPN Global Support Facility (GSF) based in Europe also provides direct technical support to NIPN country teams.
While embarking into developing the capacity development strategy, the Ethiopia country case shows the importance of focusing on the bigger nutrition governance structure, national policies and programs in order to prevent overlap and ensure a sustainable system which supports the long-term objectives of NIPN:
Ethiopia is implementing the second phase of its National Nutrition Programme Phase II (NNP-II) 2016-2020. NNP-II is co-signed by 13 Ministries. It is governed by a multisectoral national coordination structure, consisting of the National Coordination Body at high political and decision-making level, and of the National Nutrition Technical Committee at technical and planning level.
NIPN in Ethiopia is established under the umbrella of the national multisectoral nutrition program and its governance system. It aims to generate knowledge and lessons learned to guide the implementation of NNP-II and support its contributing sectors.
NIPN is hosted by the Ethiopia Public Health Institute (EPHI) who is also the chair of the Monitoring, Evaluation and Research Steering Committee (M&E&R SC), one of the three high level thematic committees of the national multisectoral coordination structure. In addition, due to its multiple responsibilities, EPHI is closely linked to the National Nutrition Technical Committee and the National Nutrition Coordination Body.
Multisectoral coordination structure of the National Nutrition Programme (NNP) Phase II (2016-2020)
During the NIPN design phase, the M&E&R SC was identified as the best placed committee to take up the role of the Multisectoral Advisory Committee to NIPN, because its objectives are so closely aligned with the NIPN objectives. The committee aims to provide technical support and direction, to generate evidence and monitor progress, and to timely inform decision-making for successful implementation of the NNP-II. The members of the M&E&R SC represent all NNP-II signatory government ministries, as well as donors, civil society and research organisations. The SC has most of the MAC attributes: it has included many of the functions for NIPN into its TOR and will play the validation and the communication and dissemination functions; it is ideally placed to be the official relay between the NIPN and the national decision making level. It also presents the advantage of meeting most of the MAC core principles: being part of the existing multisectoral coordination structure overseeing the NNP-II implementation progress; ensuring regular participation of the government representatives of the NNP-II and having the ability to mobilise additional expertise through donors, civil society and research organisations’ participation.
Despite all these advantage, the steering committee has many members. While this steering committee has integrated NIPN advisory roles in its terms of reference, the NIPN also anticipates to create a dedicated NIPN MAC, which will be composed of a small group of selected advisors with high level decision making leverage and with close linkages with ministers. This dedicated MAC will be created in 2019 and it is expected to take up a selected set of NIPN specific activities.
Thus, the MAC follows a dual approach in Ethiopia as it relies on an existing committee, the M&E&R SC and a dedicated NIPN Advisory Committee.
Existing Terms of Reference defined the M&E&R SC membership and operational modalities prior to the NIPN. In addition to those, the M&E&R SC will take up the following MAC tasks:
In the NIPN inception period, the M&E&R Steering Committee has requested the NIPN team to explore further which activities should be carried out to further enhance stunting reduction. As a result, the team has started working on a NIPN demonstration project on WASH and nutrition.
EPHI is the chair of the M&E&R SC, with the Ethiopian Institute of Agricultural Research (EIAR) as co-chair.
The main advantage of embedding some of the functions of the MAC within this existing M&E&R SC lies in the fact that it is already a functioning and credible structure. The Committee’s Terms of Reference are formalized and all committee members have been officially assigned by their respective ministries and are well sensitized with respect to the current nutrition issues in the country and within their respective institutions. The SC is meeting on a regular basis, and many members have direct links to high-level decision makers. It is expected that the multisectoral character of the committee will facilitate data access across sectors, as members have a vested interested in responding to the policy questions taken up by NIPN.
Through its role as chair of the M&E&R SC and its role in the NNCT and the NNCB, EPHI is engaging on a continuous basis with a wide set of multisectoral nutrition stakeholders. It reports on NIPN to the highest nutrition governance structures, allowing for high-level political and decision-making leverage.
Finally, this set-up further promotes the multisectoral implementation of the NNP and facilitates the capacity building approach of NIPN, with motivated members of the M&E&R SC both contributing to the capacity need assessment process, as well as benefiting from the capacity building investments.
However, as the NIPN MAC will be functional only in 2019, it remains to be seen whether it will have the ability to create efficient working relationships with the M&E&R SC to work in complementarity and whether it will acquire the respectability to influence the higher decision making level.
Guatemala has strengthened and institutionalised its approach to food and nutrition security through a series of legal and policy frameworks for food security and nutrition. This process began in 2005 when a law was enacted that saw the establishment of the multisectoral coordination system, the National System for Food and Nutrition Security (SINASAN).
SESAN (Secretariat for Food and Nutrition Security) is the core structure of the multisectoral nutrition coordination system in the country, operating under the Guatemala Presidency, which also hosts a committee of all ministers as its decision-making body. SESAN is also in charge of overseeing and coordinating the implementation of the National Food and Nutrition Security Policy 2016-2020.
Organisational structure of the Guatemala National System for Food and Nutrition Security (SINASAN)
When NIPN was set up in 2017 it was positioned as a key vehicle to support SESAN in tracking and generating evidence on the implementation of Guatemala’s National Strategy to Prevent Chronic Malnutrition 2016-2020. The Strategy is aligned with the National Food and Nutrition Security Policy but it offers a more in-depth focus on stunting reduction. As such, NIPN strengthens the existing centralised information system, managed by SESAN, which relies on data from the information systems of different key ministries.
As the NIPN positioning was clarified, different options for the creation of the Multisectoral Advisory Committee (MAC) were considered during the six-month design phase of NIPN in 2017. The options were based on a thorough review of the national multisectoral coordination structures led by CATIE (Centro Agronómico Tropical de Investigación y Enseñanza), the implementing partner of the NIPN, which included a review of legal documents and interviews with key government and non-government counterparts. Considering the Guatemala specificities, stakeholders agreed that the MAC should support the existing system and thus be part of the existing food and nutrition security coordination structures.
The final decision was to link the MAC to the existing Inter-sectoral Technical Committee (or CTI). The CTI is a technical committee in which all ministries playing a role in food and nutrition security are represented. Though only formed by government representatives, its regulation allows calling upon ad hoc participation of development partners and civil society.
The choice for this option aligns with the core principles of the MAC: it is embedded into multisectoral coordination structures, the structure is formalised to ensure members’ continued participation, and it has the flexibility to invite ad hoc participation of experts outside the government.
In the legal statutes of the existing committee, CTI is allowed to “create any permanent and temporary committees that it deems necessary to fulfil its functions”. When committees are permanent or integrated “their nature, purpose and organisation must be specified, and the financial resources necessary for its operation shall be indicated”. The MAC is registered as a “Working Committee” under the CTI by law, thus ensuring its institutionalisation and sustainability.
The Multisectoral Advisory Committee’s main role is to “support, orient and provide technical inputs to any of the NIPN work streams aiming at strengthening the Centralised Information System for Food and Nutrition Security to fulfil its mandate of tracking progresses of implementation of the National Strategy to Prevent Chronic Malnutrition and understanding the evolution of chronic malnutrition in a coordinated and comprehension approach.”
Specific roles of the committee include:
The Committee is multisectoral and multi-stakeholder by nature: it is composed of representatives from the governmental institutions and all ministries who are part of the Food and Nutrition Security System, typically programme officers in charge of planning, monitoring and evaluation. The full Committee is chaired by the Head of the Planning, Monitoring and Evaluation Division of SESAN.
To operate with maximum efficiency, a core group has been constituted from representatives of the four key ministries and institutions responsible for the implementation of the National Strategy to Prevent Chronic Malnutrition: the Ministry of Public Health and Social Assistance; the Ministry of Agriculture, Livestock and Food; the Ministry of Social Development; and the agency in charge of supplying potable water.
The Committee will seek the active contribution and participation of representatives from civil society, the private sector and international development partners, since the law permits civil society and partners’ representation in and contribution to CTI committees.
The CTI not only provides oversight to the MAC but will also present its findings and recommendations to the decision-making committees of all ministers involved in food and nutrition security. Intermediary outputs and findings of the MAC will be shared with other technical coordination fora, such as the SUN platform, and civil society and donors coordination fora.
As all stakeholders in Guatemala felt it was crucial to formally embed the MAC in the existing food and nutrition security coordination structures, the first six months of the NIPN implementation phase focused on the institutionalisation process (October 2017 to March 2018). This elaborate process offered the MAC the legitimacy and authority to function effectively. The MAC will use the existing formal communication mechanisms between the technical and decision-making levels to create a data-driven policy dialogue. Though it is too early to have evidence, this set-up maximises the probability of influencing policy decisions and sustaining the policy dialogue beyond the duration of the project.
The current set-up does not come without challenges. The CTI structure is required to comply with government procedures to call upon meetings and thus may lack the flexibility and reactivity to respond in a timely manner to the NIPN’s needs. Mobilising the full committee, with its large number of government representatives, has proven to be challenging up to now. However, the constitution of the core group – with officially appointed representatives from the four key ministries – offers the flexibility to function in an agile and efficient manner. Since December 2018 the core group has met in specific instances including a first workshop to initiate the process of formulating policy questions.
The NIPN platform in Guatemala aims for replication at the sub-national level. SESAN has selected one department to study the cost-efficiency of setting up an NIPN platform at the decentralised level, including a departmental MAC.
In Guatemala, a Steering Committee provides clarity and transparency on plans and arrangements to the main NIPN partners. It comprises representatives of the EU Delegation, as the main donor supporting the NIPN; the Secretariat for Food and Nutrition Security (SESAN), as the government host for the NIPN; and CATIE (Centro Agronómico Tropical de Investigación y Enseñanza), as the organisation managing the grant and providing technical assistance.
The Steering Committee meets regularly (three times a year), meetings are well attended and comprise in-depth discussions on progress, barriers to progress and how to overcome them.
CATIE has assigned an experienced coordinator, an assistant and a financial administrator to manage NIPN. The CATIE team meets weekly to discuss progress and issues and are in regular (daily) contact with the government’s NIPN host, SESAN, about project implementation.
CATIE has developed an elaborate project management tool in Excel, which tracks goals, activities and spending, with a simple traffic light system to signal progress or issues to the Project Steering Committee.
Download the Excel project monitoring template from CATIE (available in Spanish only).
*****
You need to load content from reCAPTCHA to submit the form. Please note that doing so will share data with third-party providers.
More Information