Program Monitoring and Evaluation

For more than 8 years, FMP has been deeply engaged in program monitoring and evaluation, particularly with respect to new human resources systems being implemented across the Federal landscape. We have not only designed and developed, but also applied and refined, evaluation approaches for Alternative Personnel Systems (APS), including Demonstration Projects. In addition, we have used more broad-based program monitoring techniques such as the Balanced Scorecard. More recently, FMP supported OPM by developing the methodology and approach, conducting assessments, and preparing reports for OPM’s evaluation of the new DoD and DHS HR systems. A product of that work, the OPM APS Assessment Framework, has now become the standard approach to evaluation of future Demonstration Projects.

Specific services we offer include:

• Developing evaluation models, methodologies and approaches. Examples are:
• A modified intervention-impact evaluation model using a quasi-experimental design and a non-equivalent comparison (control) group.
• An organizational effectiveness model intended to assess any impact of the HR system changes on mission accomplishment, productivity or customer service.
• A cost analysis model to measure any cost impacts of the HR system changes so that they may be compared to benefits achieved.
• A Balanced Scorecard approach, looking more broadly at program outcomes compared to performance objectives.
• Developing data collection plans with specific data sources and methods of collecting both for baseline and subsequent reporting and analysis.
• Developing data analysis plans describing the descriptive and inferential statistics to be used for each specific personnel system change.
• Designing and conducting employee attitude surveys and focus groups.
• Modifying and applying the OPM APS Assessment Framework to individual agency APS, including Demonstration projects.
• Conducting data analysis and reporting on all of the above
• Assisting in agency liaison with OPM or other oversight agencies with regard to program evaluation

Click here for selected case studies in program monitoring and evaluation.