Program Evaluation: EERE Resource Documents

Listed below are evaluation resource documents for the Office of Energy Efficiency and Renewable Energy (EERE).

(1) Guide for Conducting Benefit-Cost Evaluation of Realized Impacts of Public R&D Programs. 2011 Revised Working Draft.
Prepared by: Rosalie Ruegg (TIA Consulting Inc.) and Gretchen Jordan (Sandia National Laboratories)

This document provides guidance for evaluators who conduct impact assessments to determine the "realized" economic benefits and costs, energy, environmental benefits, and other impacts of the EERE R&D programs. The retrospective approach described in this guide is based on realized results only and the extent they can be attributed to the efforts of an R&D program. While it has been prepared specifically to guide retrospective benefit-cost evaluation of EERE R&D programs, this guide may be used for similar analysis of other public R&D organizations.

(2) Overview of Evaluation Methods for R&D Programs. 2007.
Prepared by: Rosalie Ruegg and Gretchen Jordan (Sandia National Laboratories)

This booklet introduces managers to a variety of methods for evaluating R&D programs. It provides an overview of 14 evaluation methods that have proven useful to R&D program managers in federal agencies. Each method is briefly defined, its uses are explained, its limitations are listed, examples of successful use by other R&D managers are provided and references are given.

(3) Impact Evaluation Framework for Technology Deployment Programs: An approach for quantifying retrospective energy savings, clean energy advances, and market effects. 2007. (Main Report).
Prepared by: John H. Reed (Innovologie LLC), Gretchen Jordan (Sandia National Laboratories) and Edward Vine (Lawrence Berkeley National Laboratory)

This document describes a framework for evaluating the retrospective impact of technology deployment programs. Program managers and evaluators in federal, state, and local governments and in public entities and institutions are increasingly accountable for delivering and demonstrating results of their programs. The impact framework assists program managers and evaluators to develop and implement better and more cost effective evaluations. The seven step process, the generic templates, the generic evaluation questions, and the evaluation designs that make up the framework can be used to develop powerful and meaningful impact evaluations to refine programs, increase program effectiveness, make the tough decisions to drop ineffective program elements, and to develop credible evidence that communicates the value of the program to stakeholders. An important focus of the framework is increasing understanding of the linkages between program outputs and short term and long term outcomes (impacts). It simplifies and enriches the process of describing and developing measures of target audience response to program outputs, designing sound evaluations, and taking credit for all effects that are attributable to the program. Created for the EERE, the framework can be applied to most deployment programs in a broad array of disciplines.

(4) Impact Evaluation Framework for Technology Deployment Programs: An approach for quantifying retrospective energy savings, clean energy advances, and market effects. (An Overview and Example). 2007.
Prepared by: John H. Reed (Innovologie LLC), Gretchen Jordan (Sandia National Laboratories) and Edward Vine (Lawrence Berkeley National Laboratory)

This is a twelve page overview and an application example for the larger report "Impact Evaluation Framework for Technology Deployment Programs: An approach for quantifying retrospective energy savings, clean energy advances, and market effects.

(5) EERE Peer Review Guide. 2004.
Prepared by: Sam Baldwin (DOE), Jim Daley (DOE), Jeff Dowd (DOE), David Howell (DOE), John Ryan (DOE), Alan Schroeder (DOE), Frank Wilkins (DOE), and Gretchen Jordan (Sandia National Laboratories)

The peer review guide describes steps to plan, design, and implement external peer reviews. This guide provides managers and staff with guidance in establishing a formal in-progress peer review that provides intellectually fair expert evaluation of EERE R&D and supporting business administration programs.

(6) "Value of Program Evaluation" Case Study Series: Sponsored by DOE

(7) A Proposed Methodology to Determine the Leverage Impacts of Technology Deployment Programs. 2008.
Prepared by James L. Wolf for the U.S. Department of Energy, Washington, D.C.

This report describes a methodology developed for leverage estimation that is relevant and useful to technology deployment programs in EERE. The methodology recommended is intended to be helpful to the development of new standards concerning the calculation of leverage that would be deemed valid and defensible not only within EERE, but also across all technology deployment programs in the public sector, generally.

(8) Stage Gate Review: