On Balance: Evaluating Security Projects Using Benefit-Cost, Risk, and Decision Analysis
Applying benefit-cost analysis to homeland security regulations and related applications is difficult, in part due to issues in measuring security or risk avoided (Roberts, 2019; Farrow and Shapiro, 2009). The Office of University Programs within the Department of Homeland Security (DHS) asked our team of benefit-cost, decision, and risk analysts to evaluate changes in their security practices based on DHS funded research and development (R&D) projects over the last 15 years. Initial results have been published in von Winterfeldt, et al. (2019) with additional submissions planned for peer reviewed journals.
While DHS sought a monetized benefit-cost analysis based on case studies, early scoping of the project left the way open for multi-criteria decision analysis, cost-effectiveness, and qualitative analysis. Our team developed new ways to modify and implement standard models and, somewhat to our surprise, found that benefit-cost analyses were possible in almost all cases. Along the way, we learned a lot about the power of basic benefit-cost analysis, but also learned lessons about baselines, context, and using sparse data with sensitivity and uncertainty analysis.


The
Confronting Inequality