Abstract
Background Bibliometric and Altmetric analyses provide important but alternative perspectives regarding research article impact. This study aimed to establish whether Altmetric Score (AS) was associated with citation rate, independent of bibliometrics.
Method Citations for a previously reported cohort of 100 most cited articles associated with the keyword “Surgery” (2018, Powell et al), were collected and a three-year interval Citation Gain (iCG) evaluated. Previous citation count, Citation Rate Index (CRI), AS, five-year Impact Factor, and Oxford Centre for Evidence Based Medicine (OCEBM) levels were used to classify citation rate prospect.
Results During follow-up, the median iCG was 161 (IQR 83–281), with 73 and 62 articles receiving an increase in CRI and AS, respectively. Median CRI and AS increase were 2.8 (−0.1–7.7) and 3 (0–4), respectively. Receiver-Operator-Characteristic (ROC) analysis revealed that CRI (AUC 0.86 (95% CI 0.79–0.93), p<0.001) and AS (Area Under Curve (AUC) 0.65 (95% CI 0.55–0.76), p=0.008) were associated with higher iCG. AS critical threshold ≥ 2.0 was associated with better iCG when dichotomised at iCG median (OR=4.94, 95% CI 1.99–12.26, p=0.001) and iCG Upper Quartile (UQ, OR=4.13, 95% CI 1.60–10.66, p=0.003). Multivariable analysis identified that only CRI was independently associated with iCG when dichotomised at the median (OR 18.22, 95% CI 6.70–49.55, p<0.001) and UQ (OR 19.30, 95% CI 4.23–88.15, p<0.001).
Conclusion Citation Rate Indices and Altmetric Scores are important predictors of interval Citation Gain, and better at predicting future citations than the historical and established Impact Factor and OCEBM quality of evidence descriptors.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
OP James was supported by a Joint Surgical Research Fellowship from the Royal College of Surgeons England and Health Education and Improvement Wales
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
If raw data is required, requests can be made to the corresponding author.