Monitoring and evaluation Training for Extension

Monitoring and Evaluation

1. ENHANCING THE EVALUABILITY OF SUSTAINABLE DEVELOPMENT GOAL 2 ( SDG2 ): END HUNGER, ACHIEVE FOOD SECURITY AND IMPROVED NUTRITION AND PROMOTE SUSTAINABLE AGRICULTURE THEME 3: National M&E Systems and Data Availability-Building on the Progress Made and Addressing Existing Capacity Gaps REQUIREMENTS: The discussion will focus on the progress and current trends in building M&E capacities at the country level and on the understanding to what extend the improved data availability and the strengthened capacities for data analysis will contribute to the evaluability of SDG2 . It will also explore existing capacity gaps that need to be addressed in order to ensure evaluability of SDG2 . The discussion will benefit from short presentations of experiences of national governments in developing M&E systems and managing data , contributing to their own ability to monitor and assess progress on global commitment, such as the MDGs. OBJECTIVES OF THE SESSION: To provide a short overview of the state-of-art discussion with regard to the theme including a critical review of lessons learned about the availability of the MDGs. To discuss emerging issues and challenges with regard to the evaluability of the MDGs. To agree on recommendations for further actions by RBAs to enhance evaluability of the SDG2

2. ENHANCING THE EVALUABILITY OF SUSTAINABLE DEVELOPMENT GOAL 2 (SDG2): END HUNGER, ACHIEVE FOOD SECURITY AND IMPROVED NUTRITION AND PROMOTE SUSTAINABLE AGRICULTURE THEME 3: National M&E Systems and Data Availability-Building on the Progress Made and Addressing Existing Capacity Gaps Proceedings: Moderated discussion: Three discussants Duration: Presentation and Q&A: 15-20 minutes Proposed Focus of Malaysia’s Presentation: Malaysia’s experience in developing M&E systems and managing data; How Malaysia’s M&E system monitor and assess progress on global commitment, such as the SDGs; Critical success factors in ensuring/making M&E systems workable Abstract Malaysia has embarked on transforming its focus from output to outcome initiated an outcome as early as 2005 with the introduction of Outcome-Based-Approach, Outcome-Based-Budgeting and Outcome Evaluation. The transformation not only enhance productivity and reduce potential susceptibility to wastage, it also ease the evaluating process at national and global level. The combination of visionary player, efficient tools and workable templates helps the smooth integration at vertical as well as horizontal, hence, creating a M&E system in Malaysia. However, there are several critical success factors need to be considered in ensuring the integrations are it at their best. 2

3. Malaysia’s Experience in Institutionalising and Executing the National M&E Systems The Timely Transformation: Output to Outcome Orientation The Three Essential Elements: Players, Tools and Framework Linking Monitoring and Evaluation (M&E) to Sustainable Development Goal 2 ( SDG2 ) The Critical Success Factors in Addressing the Gaps Questions & Answers 3

4. The Timely Transformation : Output to Outcome Orientation Outcome-Based-Approach (OBA) (2010): National development planning based on results Outcome-Based-Budgeting (OBB) (2010): Preparing the resource requirements to drive the ministry results Outcome Evaluation (2005): Managing information for monitoring, evaluation and decision support system Outcome Evaluation (2005): Performance reporting and policy formulation 4

5. The Timely Transformation : Output to Outcome Orientation Developed OBB Conceptual Framework Awareness Programs Capacity Building (Trainers and RLs) Developed Initial Results Framework for all Ministries Continuous data quality refinement Focus on monitoring & performance reporting Initiate Centre of Excellence & evaluation cycle to be operational Budget preparation for 2016 to be fully OBB compliant Integrated performance monitoring & reporting to be Full implementation of OBB recommendations including full systems and institutions 2010 - 2011 2012-2013 2014 - 2015 2016 > OBB Policy Circular Roll out of OBB to all ministries (Parallel in 2012) Data validation & refinement Outcome-Based-Budgeting (OBB) 5

6. The Timely Transformation : Output to Outcome Orientation 2005 2006 2007 2007> DRAFTING ENFORCEMENT ROLLING ENHANCEMENT REPORTING/ REVIEWING Designing the Guideline Officiating the Development Program Evaluation Guideline Circular on August 24, 2005 . Enforcement/ application to all head of division Training sessions conducted through conferences, workshops, bilateral with ministries/ agencies. Pilot testing on program evaluation and reporting. Assessment reports (aggregated according to ministries) sent to Public Service Department. Performance Scorecard for all implementing agencies were issued and reported Evaluation results presented to stakeholders. Ministries/ Agencies/ Statutory Bodies embarked on the evaluation program by: Evaluating the completed projects to identify the outcome and impact. 2010-2012 Outcome Evaluation Module was developed and incorporated into the Project Monitoring System. Performance Scorecard Revising the Guideline Strategic collaboration Outcome Evaluation 6

7. POLICY INPUT OUTCOME ACTIVITIES OUPUT IMPACT RESULT CHAIN P LANNING I MPLEMENTATION E VALUATION FORMATIVE EVALUATION: MONITORING SUMMATIVE EVALUATION : OUTCOME/ IMPACT EVALUATION EPU JPM ICU JPM EPU JPM ICU JPM MOF AUDITOR GENERAL Overall Framework Result Based Management ( RBM ) Strengths: Embedded capacity building within the framework Evaluation exists at all stages of project management (PIE) Structured two-ways mapping (top>bottom & bottom>up) Key players are independent bodies POLICY EVALUATION : NEED ANALYSIS/ CAUSE & EFFECT ETC 7 Feedback to Planning The Timely Transformation : Output to Outcome Orientation

8. The Three Essential Elements : Players , Tools and Framework RULES AND REGULATION MONITORING ACTIVITY CENTRAL MONITORING PLATFORM MANAGEMENT INFORMATION SYSTEM PLANNING IMPLEMENTATION EVALUATION EPU Circular No 1/2009 : Outcome Based Approach (OBA) Budget screening KPI National Development Planning Council SPP II : Program/Project Submission Module Directive No 1 / 2010 Outcome Based Budgeting (OBB) SPA 3/2005 Physical progress Expenditure KPI Intervention National Action Council National Action Working Committee SPP II : Performance Monitoring (Physical and financial) Outcome evaluation Impact evaluation Policy evaluation KPI National Action Council Outcome Evaluation Working Committee SPPII : Outcome Evaluation Module CENTRAL DRIVERS EPU MOF ICU EPU MOF ICU ICU MOF AUDITOR GENERAL PSD Players Tools Framework

9. Linking Monitoring and Evaluation ( M&E) to SDG2 PROJECT & POLICY End hunger Food Security Improved nutrition Sustainable agriculture 9

10. Linking Monitoring and Evaluation ( M&E) to SDG2 PROJECT & POLICY End hunger Food Security Improved nutrition Sustainable agriculture What we do? What we aim? Proof? Example of Activities Poverty eradication programs Fiscal Interventions Control of Supply Act 1961 Price Standardization Program Income generation programs Healthcare & related programs Education & related programs Housing & related programs Agriculture & related programs Research, Development & Commercialization ( RDC ) in agriculture Example of proxy Indicators Incidence of poverty Primary school enrolments Rate of school drop-outs Consumable income House ownership Infant mortality rate SSL in agriculture Rate of commercialization Growth in a griculture sector Example of Goals/Outcomes Raising the income and wealth of B40 households Addressing the increasing cost of living Enhancing targeted support for undeserved communities (basic need and infra) Improving productivity and income of farmers, fishermen & smallholders Modernizing agriculture 10

11. National Thrust NKRA Outcome National Program Addressing Persistent Socioeconomic Inequalities Raising Living Standards of Low Income Households Raising the Income Generation Potential of Bottom 40 % Household National Poverty Eradication Program Ministerial KRA Outcome KPI Ministerial Activities Output Outcome KPI Ministerial Programs Outcome KPI KKLW KWPKB KPWKM KPM P rogram for Rural Housing Social Safety Scheme for Disable and Lower Income Group Program for Students (Low Income Familiy ) Integrated Development Program Program for Urban Housing Program for Urban Poor Integrated Economic Program for Urban Poor Assistance for Senior Citizens Housing Project Integrated Agriculture Project Housing Rental Assistance Training Allowance Assistance for Urban Poor Traders/ Entrepreneurs Tuition Voucher Scheme 11 Example: Linkages in Poverty Eradication Program

12. Questions & Answers [email protected] [email protected]