The federal government spends less than one-tenth of a penny, out of every dollar invested in education programs, to evaluate those programs. That ratio is far lower than other fields, and it means that policymakers often lack basic evidence on how to spend taxpayer resources wisely to improve education.
This paper outlines why and how the U.S. Department of Education could leverage a 1% investment in evaluation—a penny on the dollar—to develop and implement a comprehensive evaluation system. Such a system could significantly increase the impact and cost-effectiveness of federal investment in education, and build the knowledge base to help teachers and school leaders solve chronic education problems it funds.
In May 2014, Results for America (RFA) issued its third federal Investing in What Works Index, which highlighted the extent to which the U.S. Department of Education and other federal agencies are building the infrastructure needed to use evidence and evaluation in budget, policy, and management decisions (RFA 2014). The Department scored well on the index, but it has plenty of room for improvement, starting with investing 1% of funds in rigorous, independent evaluations.
This paper makes eight recommendations for how the Department could use evaluation funding to build the knowledge base and improve its programs:
- Use scientifically rigorous methods to evaluate programs and build a cumulative evidence base.
- Focus program evaluations on finding what works—where, when, how, and under what circumstances—rather than a thumbs-up or thumbs-down verdict on the entire program.
- Pay attention to needs and timing constraints of the end users of evaluation results.
- Invest in capacity building and infrastructure to disseminate, explain, translate, communicate, and use program evaluation results.
- Revise federal rules to maximize the use and impact of program evaluations.
- Incentivize the use of cost-effective and evidence-based educational evaluations and educational programs.
- Establish a Chief Evaluation Officer at the U.S. Department of Education.
- Fund the right kinds of evaluations.
Each recommendation on its own would be helpful, but taken together they constitute a comprehensive and robust program evaluation and knowledge building system. By investing just a penny on the dollar and using it to play Moneyball, the Department of Education can create a game changing dynamic of evidence based continuous improvement focused on, and able to improve education outcomes for, all our nation’s children.
Download the full report, available here in pdf.
Read more in our coverage of Dr. Balfanz’ commentary in EdWeek September 2014.