18.MR.KPI - WFP Country Strategic Plans and Evidence-based Evaluation

C2629.MR22.K18 - EVIDENCE BASED EVALUATION IN THE COUNTRY STRATEGIC PLANS

KPI NAME

Percentage of draft country strategic plans which refer explicitly to evaluation evidence

NEW OR EXISTING KPI

Update of an existing KPI

INDICATOR CODE

C2629.MR22.K18

RESPONSIBLE DIVISION

OEV

MR OUTPUT

2.2. Programme operations support

PURPOSE

The purpose of this KPI is to measure the extent to which evaluation findings, conclusions and recommendations inform the development of Country Strategic Plans (CSPs), including Interim Country Strategic Plans (ICSPs), prior to OEV’s review and comments as part of the Programme Review and Approval Process (PRP)

CALCULATION FORMULA

Result KPI = (Number of WFP draft I/CSPs commented by OEV in the reference year which refer explicitly to evaluation evidence / Number of WFP draft I/CSPs commented by OEV in the reference year) X 100

CALCULATION STEPS

1. Identify Draft CSPs/ICSPs:

• Include only Draft CSPs/ICSPs documents submitted to the  PRP for comments

• Exclude other PRP documents such as budget revisions of CSPs/ICSPs, as well as new draft t-ICSP, LEO, and Trust Fund

2. Determine Reference Year:

• Use the year when the draft CSP/ICSP is posted in the strategic PRP (s-PRP) stage

• Do not use the year the CSP/ICSP is formally approved

3. Check for Explicit Reference to Evaluation Evidence:

• Review the draft CSPs/ICSPs document to assess the extent to which evaluative evidence has been used. All evaluation types are considered (e.g., policy evaluations, strategic evaluations, CSP evaluation, decentralized evaluation, impact evaluation, corporate emergency evaluation, inter-agency humanitarian evaluation, system-wide evaluations, joint evaluations, summaries of evaluation evidence)

• Exclude drafts CSPs/ICSPs that do not use evaluative evidence

DATA SOURCE

Data is available from the list of draft CSPs submitted to the PRP for comments in a given year extracted from "System for Programme Approval (SPA) PLUS"

DATA COLLECTION METHOD

Data is collected from qualitative review of draft CSPs submitted to the PRP for comments to identify explicit references to evaluative evidence. Results of this qualitative review are consolidated by OEV

AUTOMATION

N/A

BASELINE VALUE

100%

ASSUMPTIONS

Country office staff involved in CSP design leverage evaluation evidence for the purpose of CSP development

LIMITATIONS

This KPI assumes that draft Country Strategic Plans (CSPs) systematically reference evaluation evidence. However, in some instances, although some aspects of the CSP design have been informed by evaluative evidence, they may not be explicitly described as such in the CSP document (notably due to stringent word limits). Furthermore, this indicator focuses on new CSPs and does not consider extension in time of existing CSPs. This may limit the KPI’s ability to consistently measure integration of evaluation findings

REVIEW FREQUENCY

Quarterly

QCPR INDICATOR

False

UN COMMON/ COMPLEMENTARY INDICATOR

False

IS THE KPI A UN COMMON OR COMPLEMENTARY INDICATOR

N/A

CONTRIBUTING AGENCIES

N/A

POINT OF CONTACT

wfp.performanceplanning@wfp.org