Inadequate Reporting of Analytical Characteristics of Biomarkers Used in Clinical Research: A Threat to Interpretation and Replication of Study Findings

Abstract

Abstract BACKGROUND Analytical characteristics of methods to measure biomarkers determine how well the methods measure what they claim to measure. Transparent reporting of analytical characteristics allows readers to assess the validity and generalizability of clinical studies in which biomarkers are used. Our aims were to assess the reporting of analytical characteristics of biomarkers used in clinical research and to evaluate the extent of reported characterization procedures for assay precision. METHODS We searched 5 medical journals (Annals of Internal Medicine, JAMA: The Journal of the American Medical Association, The Lancet, The New England Journal of Medicine, and PLOS Medicine) over a 10-year period for the term “biomarker” in the full-text field. We included studies in which biomarkers were used for inclusion/exclusion of study participants, for patient classification, or as a study outcome. We tabulated the frequencies of reporting of 11 key analytical characteristics (such as analytical accuracy of test results) in the included studies. RESULTS A total of 544 studies and 1299 biomarker uses met the inclusion criteria. No information on analytical characteristics was reported for 67% of the biomarkers. For 65 biomarkers (3%), ≥4 characteristics were reported (range, 4–8). The manufacturer of the measurement procedure could not be determined for 688 (53%) of the 1299 biomarkers. The extent of assessments of assay imprecision, when reported, did not meet expectations for clinical use of biomarkers. CONCLUSIONS Reporting of the analytical performance of biomarker measurements is variable and often absent from published clinical studies. We suggest that readers need fuller reporting of analytical characteristics to interpret study results, assess generalizability of conclusions, and compare results among clinical studies.