A Cross-Sectional Study Based on Forty Systematic Reviews of Foods with Function Claims (FFC) in Japan: Quality Assessment Using AMSTAR 2

Abstract

Background: The Foods with Function Claims (FFC) was introduced in Japan in April 2015 to make more products available that are labeled with health functions. The products’ functionality of function claims must be explained by scientific evidence presented in systematic reviews (SRs), but the quality of recent SRs is unclear. This study assessed the quality of SRs in the FFC registered on the Consumer Affairs Agency (CAA) website in Japan. Methods: We searched the database from 1 April to 31 October 2022. Confidence in the methodological quality of each SR was evaluated by the AMSTAR 2 checklist. Results: Forty SRs were randomly extracted on the basis of the eligibility criteria and recruitment procedures. Overall confidence was rated as “high” (N = 0, 0%), “moderate” (N = 0, 0%), “low” (N = 2, 5%), or “critically low” (N = 38, 95%). The mean AMSTAR 2 score was 51.1% (SD 12.1%; range 19–73%). Among the 40 SRs, the number of critical domain deficiencies was 4 in 7.5% of SRs, 3 in 52.5% of SRs, 2 in 35% of SRs, and 1 in 5% of SRs. Registering the review’s protocol and comprehensive search strategies were particularly common deficiencies. Additionally, the risk of bias (RoB) was insufficiently considered. Conclusion: Overall, the methodological quality of the SRs based on the FFC, introduced eight years earlier, was very poor. This was especially true in the interpretation and discussion of critical domains, which had many deficiencies in terms of protocol registration, a comprehensive literature search strategy, and accounting for the RoB.