J Dent. 2024 Oct 04. pii: S0300-5712(24)00563-3. [Epub ahead of print] 105393
AIM: Open science, a set of principles and practices, aims to make scientific research more accessible and accountable, benefiting scientists and society. This study evaluated whether adopting open science practices (OSPs) correlates with higher citation rates and Altmetric scores.
METHODS: A random sample of randomised clinical trials (RCTs) on dental caries published between 2000 and 2022 was selected. A systematic PubMed search identified relevant RCTs, and data on OSPs - study registration, open methodology, open software, open scripts, open analysis plan, open data, open peer review, and open access (OA) - were manually collected by two independent assessors. The Robot Reviewer tool automatically evaluated the risk of bias (RoB). Outcomes included the total number of citations and the Altmetric Attention Score. Associations between OSPs, RoB, and other explanatory variables with the outcomes were assessed using binomial negative regression analysis, and expressed as Incidence Rate Ratio (IRR; α =.05).
RESULTS: In total, 323 papers were analysed. At least one OSP was adopted in 57.5% (n=186) of the articles, dropping to 39.6% (n=128) without OA. Papers with protocol registration (IRR: 1.45; 95% CI: 1.15, 1.82) and OA publication (IRR: 1.24; 95% CI: 1.01, 1.53) had higher citation rates. Conversely, papers in full OA journals had fewer citations (IRR: 0.67; 95% CI: 0.52, 0.87). After adjusting for RoB, low-risk studies showed higher citation rates (IRR: 1.48; 95% CI: 1.14, 1.91), while OA lost significance. For Altmetric scores, registered and OA manuscripts showed higher scores (IRR: 3.74; 95% CI: 2.00, 7.01; IRR: 1.69; 95% CI: 1.04, 2.75), with registration remaining significant after adjusting for RoB and impact factor (IRR: 3.71; 95% CI: 1.97-6.99).
CONCLUSION: The adoption of OSPs demonstrated a partial correlation with citation rates and Altmetric scores in RCTs on dental caries; however, these effects are complex and seem more related to the journal's impact factor.
CLINICAL SIGNIFICANCE: The citations and the attention to clinical trials in dentistry, which could drive clinical decision-making and the elaboration of policies and recommendations, seem to be driven more by the journal's prestige than by the adoption of OSPs.
Keywords: Altmetric; number of citations; open science; research integrity