Statistical Procedure Using an Expert Panel for Procurement of Emerging Transportation Technologies

Abstract

State departments of transportation (DOTs) rely on established standards and open and competitive bidding to procure materials and technologies. This process hinders the implementation of new technologies until such standards are developed. A time lag occurs between the commercial introduction and implementation of new technologies, often delaying deployment of safety and cost improvement items by many years. One solution to this time lag is to prequalify products and technologies and use competitive bidding for procurement. The task is to develop a workable prequalification procedure that will satisfy acceptable standards of fairness. A procedure is proposed and is illustrated with a case study. The procedure uses an expert panel performing blind evaluations of prospective products and technologies. A longitudinal repeated measures design on two factors was developed. Pass-fail criteria were established. Evaluation test questions and a measurement scale were developed. Analysis-of-variance models were used for two rating response variables and a ranking response variable. Model assumptions were checked and departures were noted. The DOT involved in the study will use the procedure as a prototype for future testing of new technologies.