Energy Conservation Research of California's Utilities: A Meta-Evaluation
White, L. T., Archer, D., Aronson, E., Condelli, L., Curbow, B., McLeod, B., Pettigrew, T. F., & Yates, S. (1984). Energy conservation research of California's utilities: A meta-evaluation. Evaluation Review, 8, 2, 167-186.
More than 200 evaluations of energy conservation programs conducted by California's 4 major utilities between 1977 and 1980 are reviewed and critiqued. In general, the evaluations were conducted in the marketing research tradition, were formative (rather than summative), and were dominated by nonexperimental surveys. Major threats to validity included failure to consider secular economic and attitudinal trends, inadequate prior explication of key constructs, lack of random assignment, lack of appropriate comparison groups, overreliance on attitudes and self-reported behaviors as indices of conservation, and multiple unprotected statistical comparisons. Alternative evaluation techniques designed to reduce validity threats are presented, and a sample of the utilities' more recent work is assessed. (20 ref)
