bims-skolko Biomed News
on Scholarly communication
Issue of 2023–12–24
35 papers selected by
Thomas Krichel, Open Library Society



  1. BMJ Glob Health. 2023 Dec 21. pii: e013111. [Epub ahead of print]8(12):
      
    Keywords:  Public Health
    DOI:  https://doi.org/10.1136/bmjgh-2023-013111
  2. Malays Orthop J. 2023 Nov;17(3): 1-4
      Artificial intelligence (AI)-assisted technologies are here to stay and cannot be ignored. These tools are able to generate highly-realistic human-like text and perform a wide range of useful language tasks with a wide range of applications. They have the potential to expedite innovation in health care and can aid in promoting equity and diversity in research by overcoming language barriers. When using these AI tools, authors must take responsibility for the output and originality of their work, as publishers expect all content to be generated by human authors unless there is a declaration to the contrary. Authors must disclose how AI tools have been used, and ensure appropriate attribution of all the text, images, and audio-visual material. The responsible use of AI language models and transparent reporting of how these tools were used in the creation of information and publication are vital to promote and protect the credibility and integrity of medical research, and trust in medical knowledge. Educating postgraduate and undergraduate students, researchers and authors on the applications and best usage of AI-assisted technologies, together with the importance of critical thinking, integrity and strict adherence to ethical principles, are key steps that need to be undertaken.
    DOI:  https://doi.org/10.5704/MOJ.2311.001
  3. Asian J Psychiatr. 2023 Dec 03. pii: S1876-2018(23)00411-2. [Epub ahead of print]91 103854
      
    Keywords:  Academic publishing; Journal; Nepotism; Scientific research
    DOI:  https://doi.org/10.1016/j.ajp.2023.103854
  4. Arthroscopy. 2024 Jan;pii: S0749-8063(23)00804-6. [Epub ahead of print]40(1): 1-2
      New Year brings a new catchline: Practice-Changing Innovation. Publishing groundbreaking research and inventive techniques that translate to improvements in patient care is an ultimate goal.
    DOI:  https://doi.org/10.1016/j.arthro.2023.10.002
  5. Nature. 2023 Dec 21.
      
    Keywords:  Authorship; Careers; Publishing; Technology
    DOI:  https://doi.org/10.1038/d41586-023-04160-6
  6. Nature. 2023 Dec;624(7992): 523
      
    Keywords:  Ethics; Funding; Publishing
    DOI:  https://doi.org/10.1038/d41586-023-04056-5
  7. J Sex Med. 2023 Dec 20. pii: qdad152. [Epub ahead of print]
       BACKGROUND: While female urologists are known to publish at less frequency than their male peers, The Journal of Sexual Medicine was reported to have among the highest growth in female authorship from 2002 to 2020 in urology journals.
    AIM: We sought to assess the frequency of female authorship in sexual medicine journals worldwide and the factors that affect this, including the blinded/unblinded review process.
    METHODS: Eleven sexual medicine journals were assessed for geographic location, peer review method, and SCImago Journal Rank citation index (a metric of citation frequency and prestige). Journals were grouped into top, middle, and bottom quartiles based on metric score. Web of Science was used to access the publications' first, second, last, and corresponding authors from the past 5 years. An internet search or Gender-API.com was used to determine the gender identities of authors. Univariate and multivariable logistic regression models were performed.
    OUTCOMES: Outcomes included the likelihood of female authorship (first, second, last, and corresponding) based on journal location and ranking, the clustering of female authors, the journal's peer review process, and the frequency of female editorial board members.
    RESULTS: Overall, 8938 publications were identified. Women represented 30.7%, 31.3%, 21.3%, and 18.7% of the first, second, last, and corresponding authors, respectively; gender was unable to be assessed for 2.6%, 17.2%, 7.3%, and 2.7%. On univariate analysis, journals from North America, in the top quartile, and with a double-blind review process were more likely to have female authors (P < .001). On multivariate analysis, articles were more likely to have a female first author if they had a double-blind peer review process (odds ratio [OR], 1.20; 95% CI, 1.02-1.40), a female second author (OR, 2.54; 95% CI, 2.26-2.85), or a female corresponding author (OR, 7.80; 95% CI, 6.69-9.10).
    CLINICAL IMPLICATIONS: Gender-concordant mentoring and universal double-blind manuscript review processes may minimize the impact of gender bias and increase female authorship rates, in turn producing more diverse research.
    STRENGTHS AND LIMITATIONS: This is the first study assessing female authorship in sexual medicine journals. Limitations include not assessing every author listed on articles and being unable to determine gender identities for some authors.
    CONCLUSION: Female authorship rates are higher than reported rates of practicing female urologists but still lower than their male peers. Female authors were more likely to be published in journals with double-blind peer review processes and when publishing with additional female authors.
    Keywords:  female authorship; publications; sexual medicine; urology
    DOI:  https://doi.org/10.1093/jsxmed/qdad152
  8. Br J Pain. 2023 Oct;17(5): 426-427
      Recently in the Journal, Amanda Williams described her experience of raising concerns about a group of trials with "untrustworthy data". We were inspired by the work of Williams and colleagues to examine these and other trials by the same research group. Similar to Williams, we found that the patterns of reported data differed from the patterns expected to arise from valid randomisation. We also identified a high proportion of reported baseline p-values for categorial variables that differed from independently calculated p-values. We reported these findings to the affected journals but none of the concerns were addressed and no action will be taken about the majority. Despite the large number of unresolved concerns about these trials, readers will be unaware of the issues, which seems entirely unsatisfactory.
    Keywords:  Musculoskeletal pain; journal responses; publication integrity; randomised trials; retraction
    DOI:  https://doi.org/10.1177/20494637231198757
  9. Nature. 2023 Dec 22.
      
    Keywords:  Publishing; Scientific community; Sociology
    DOI:  https://doi.org/10.1038/d41586-023-03474-9
  10. J ISAKOS. 2023 Dec;pii: S2059-7754(23)00613-2. [Epub ahead of print]8(6): 393-395
      
    DOI:  https://doi.org/10.1016/j.jisako.2023.12.001
  11. J Nurs Scholarsh. 2023 Dec 20.
       INTRODUCTION: The output of scholarly publications in scientific literature has increased exponentially in recent years. This increase in literature has been accompanied by an increase in retractions. Although some of these may be attributed to publishing errors, many are the result of unsavory research practices. The purposes of this study were to identify the number of retracted articles in nursing and reasons for the retractions, analyze the retraction notices, and determine the length of time for an article in nursing to be retracted.
    DESIGN: This was an exploratory study.
    METHODS: A search of PubMed/MEDLINE, the Cumulative Index to Nursing and Allied Health Literature, and Retraction Watch databases was conducted to identify retracted articles in nursing and their retraction notices.
    RESULTS: Between 1997 and 2022, 123 articles published in the nursing literature were retracted. Ten different reasons for retraction were used to categorize these articles with one-third of the retractions (n = 37, 30.1%) not specifying a reason. Sixty-eight percent (n = 77) were retracted because of an actual or a potential ethical concern: duplicate publication, data issues, plagiarism, authorship issues, and copyright.
    CONCLUSION: Nurses rely on nursing-specific scholarly literature as evidence for clinical decisions. The findings demonstrated that retractions are increasing within published nursing literature. In addition, it was evident that retraction notices do not prevent previously published work from being cited. This study addressed a gap in knowledge about article retractions specific to nursing.
    Keywords:  COPE guidelines; duplicate publication; plagiarism; publishing; research integrity; retraction of publication; scientific misconduct
    DOI:  https://doi.org/10.1111/jnu.12952
  12. J Pathol Inform. 2023 ;14 100342
      AI Chat Bots such as ChatGPT are revolutionizing our AI capabilities, especially in text generation, to help expedite many tasks, but they introduce new dilemmas. The detection of AI-generated text has become a subject of great debate considering the AI text detector's known and unexpected limitations. Thus far, much research in this area has focused on the detection of AI-generated text; however, the goal of this study was to evaluate the opposite scenario, an AI-text detection tool's ability to discriminate human-generated text. Thousands of abstracts from several of the most well-known scientific journals were used to test the predictive capabilities of these detection tools, assessing abstracts from 1980 to 2023. We found that the AI text detector erroneously identified up to 8% of the known real abstracts as AI-generated text. This further highlights the current limitations of such detection tools and argues for novel detectors or combined approaches that can address this shortcoming and minimize its unanticipated consequences as we navigate this new AI landscape.
    Keywords:  Chat-GPT; GPT; Generative AI; Human-generated; LLM; Large Language Model; Machine learning; Text detection
    DOI:  https://doi.org/10.1016/j.jpi.2023.100342
  13. Cureus. 2023 Nov;15(11): e49019
      Background Natural language processing models are increasingly used in scientific research, and their ability to perform various tasks in the research process is rapidly advancing. This study aims to investigate whether Generative Pre-trained Transformer 4 (GPT-4) is equal to humans in writing introduction sections for scientific articles. Methods This randomized non-inferiority study was reported according to the Consolidated Standards of Reporting Trials for non-inferiority trials and artificial intelligence (AI) guidelines. GPT-4 was instructed to synthesize 18 introduction sections based on the aim of previously published studies, and these sections were compared to the human-written introductions already published in a medical journal. Eight blinded assessors randomly evaluated the introduction sections using 1-10 Likert scales. Results There was no significant difference between GPT-4 and human introductions regarding publishability and content quality. GPT-4 had one point significantly better scores in readability, which was considered a non-relevant difference. The majority of assessors (59%) preferred GPT-4, while 33% preferred human-written introductions. Based on Lix and Flesch-Kincaid scores, GPT-4 introductions were 10 and two points higher, respectively, indicating that the sentences were longer and had longer words. Conclusion GPT-4 was found to be equal to humans in writing introductions regarding publishability, readability, and content quality. The majority of assessors preferred GPT-4 introductions and less than half could determine which were written by GPT-4 or humans. These findings suggest that GPT-4 can be a useful tool for writing introduction sections, and further studies should evaluate its ability to write other parts of scientific articles.
    Keywords:  artificial intelligence and writing; artificial intelligence in medicine; chatbot; chatgpt; gpt-4; natural language processing
    DOI:  https://doi.org/10.7759/cureus.49019
  14. Cureus. 2023 Nov;15(11): e49166
       BACKGROUND: ChatGPT (OpenAI Incorporated, Mission District, San Francisco, United States) is an artificial intelligence (AI)-based language model that generates human-resembling texts. This AI-generated literary work is comprehensible and contextually relevant and it is really difficult to differentiate from human-written content. ChatGPT has risen in popularity lately and is widely utilized in scholarly manuscript drafting. The aim of this study is to identify if 1) human reviewers can differentiate between AI-generated and human-written abstracts and 2) AI detectors are currently reliable in detecting AI-generated abstracts.
    METHODS: Seven blinded reviewers were asked to read 21 abstracts and differentiate which were AI-generated and which were human-written. The first group consisted of three orthopaedic residents with limited research experience (OR). The second group included three orthopaedic professors with extensive research experience (OP). The seventh reviewer was a non-orthopaedic doctor and acted as a control in terms of expertise. All abstracts were scanned by a plagiarism detector program. The performance of detecting AI-generated abstracts of two different AI detectors was also analyzed. A structured interview was conducted at the end of the survey in order to evaluate the decision-making process utilized by each reviewer.
    RESULTS: The OR group managed to identify correctly 34.9% of the abstracts' authorship and the OP group 31.7%. The non-orthopaedic control identified correctly 76.2%. All AI-generated abstracts were 100% unique (0% plagiarism). The first AI detector managed to identify correctly only 9/21 (42.9%) of the abstracts' authors, whereas the second AI detector identified 14/21 (66.6%).
    CONCLUSION: Inability to correctly identify AI-generated context poses a significant scientific risk as "false" abstracts can end up in scientific conferences or publications. Neither expertise nor research background was shown to have any meaningful impact on the predictive outcome. Focus on statistical data presentation may help the differentiation process. Further research is warranted in order to highlight which elements could help reveal an AI-generated abstract.
    Keywords:  ai detector; artificial intelligence; chatgpt; identification; orthopaedic abstracts; reviewers
    DOI:  https://doi.org/10.7759/cureus.49166
  15. Nature. 2023 Dec;624(7992): 523
      
    Keywords:  Ethics; Machine learning
    DOI:  https://doi.org/10.1038/d41586-023-04055-6
  16. Malays Fam Physician. 2023 ;18 68
      
    Keywords:  Artificial intelligence; Biomedical research; Delusions; Hallucinations; Medical writing
    DOI:  https://doi.org/10.51866/lte.527
  17. Malays Fam Physician. 2023 ;18 69
      
    Keywords:  Authorship; ChatGPT; Writing
    DOI:  https://doi.org/10.51866/lte.483
  18. Account Res. 2023 Dec 20. 1-21
      When a research group has multiple retracted publications and/or research misconduct by a member is evident, there is a risk that its other publications are unreliable, so a comprehensive assessment of the group's publications is advisable. We analyzed the comprehensiveness of assessment of the integrity of 300 publications by a research group with numerous retractions and known research misconduct, for 292 of which we raised concerns to publishers and academic institutions between 3/2013 and 2/2020. By 4/2023, 91 (30%) publications had not been assessed by either publisher or academic institution. Publishers had assessed 185 (63%) publications. The 4 academic institutions had assessed 5/36 (14%), 56/216 (26%), 30/50 (60%) and 40/66 (61%) publications. Unprompted assessments, those undertaken without our notification of concerns, occurred for 24 (8%) publications, 3 (1%) by publishers and 21 (7%) by academic institutions. Among 32 journals with ≥2 affected publications, no unprompted assessments of the remaining publication(s) occurred after notification of concerns about the index publication(s). Publishers retracted 58/84 (69%) publications which institutions also assessed and decided needed no editorial action. These analyses demonstrate the failure of publishers and institutions to comprehensively and spontaneously determine the integrity of publications in a setting of known misconduct and multiple retractions.
    Keywords:  Publication integrity; assessment; journals; retraction; universities
    DOI:  https://doi.org/10.1080/08989621.2023.2295996
  19. Nature. 2023 Dec;624(7992): 474
      
    Keywords:  Authorship; Publishing; Research data; Scientific community
    DOI:  https://doi.org/10.1038/d41586-023-04021-2
  20. Account Res. 2023 Dec 18. 1-29
      The "publish or perish" approach has become an integral part of an academic's life when seeking positions, striving for promotions, or competing for funding. This approach often hinges on journal-based metrics which push researchers to seek publication in journals indexed in the Web of Science. Due to the pressure to publish a certain number of publications in journals indexed in the Web of Science, researchers might attempt to find a journal with a lower impact factor, i.e., less popular and visible journals in the scientific community. Even more concerning is the fact that researchers might publish their results in predatory journals. This paper analyzes the consequence of introducing a journal indicators-based academic evaluation by analyzing productivity and publication patterns of researchers. Moreover, this paper investigates the correlation between journal-based academic evaluation rules and researchers' ethics. The analysis is based on bibliometric data collected from the Web of Science database. The case study subject is the Serbian research landscape before and after the introduction of a journal metrics-based academic evaluation.
    Keywords:  Academic evaluation rules; ethics; journal selection; publication patterns; publish or perish
    DOI:  https://doi.org/10.1080/08989621.2023.2295415
  21. Nurs Womens Health. 2023 Dec 13. pii: S1751-4851(23)00251-9. [Epub ahead of print]
      Publication of doctor of nursing practice scholarly projects is an important way to disseminate clinically relevant scholarship to support evidence-based practice.
    DOI:  https://doi.org/10.1016/j.nwh.2023.11.006
  22. Healthcare (Basel). 2023 Dec 16. pii: 3180. [Epub ahead of print]11(24):
      This study aimed to evaluate the reporting quality of randomized clinical trials (RCTs) in periodontology. Three leading periodontology journals, the Journal of Periodontology (JOP), the Journal of Clinical Periodontology (JOCP), and the Journal of Periodontal Research (JOPR), were selected for this investigation. The RCTs were identified by manually searching for human trial articles published in these three journals. Two authors independently conducted the literature search, and a pre-piloted extraction sheet was used to screen the potential RCTs. The CONSORT checklist guidelines were employed to calculate the score value. Intra-examiner reliability was assessed by scoring a random sample of 10% of the papers in a second round conducted by the first examiner three months after the initial data collection. A search of abstracts published over a five-year period yielded 176 articles that reported RCTs, accounting for 11.7% of all articles published in the three journals. The highest number of RCTs was published in 2020, and more than half of the included RCTs (51%) originated from Europe. Many of the analyzed RCTs inadequately reported almost half of the items on the CONSORT checklist. Furthermore, univariate analysis revealed significant associations between certain factors and the overall CONSORT score, such as publication in JOP (p = 0.048), publication year of 2019 (p = 0.041) and 2021 (p = 0.042), first author from North America (p = 0.016), and RCTs with more than six authors (p = 0.042). Clinical trial research in periodontics has made significant progress in the past five years. However, there is room for improvement in adhering to the CONSORT guidelines.
    Keywords:  CONSORT; RCTs; periodontology; quality reporting
    DOI:  https://doi.org/10.3390/healthcare11243180
  23. Stem Cell Reports. 2023 Dec 11. pii: S2213-6711(23)00455-1. [Epub ahead of print]
      In 2021, the International Society for Stem Cell Research (ISSCR) released updated guidelines that included human embryo research guidance. Requiring ethics statements in publications using human embryos is one way to verify adherence to these guidelines. A review of top-tier biomedical journal requirements identified only one publisher that requires a human embryo statement. A review of articles using human embryos from top-tier biomedical journals found that all contain some form of ethics statement, but they differ in content and location. Requiring ethics statements with specific elements could improve transparency and adherence to research guidelines.
    DOI:  https://doi.org/10.1016/j.stemcr.2023.11.006
  24. Arch Rheumatol. 2023 Dec;38(4): 611-619
       Objectives: This study aimed to analyze the research, publication activities, and perspectives on clinical practices of rheumatology practitioners during the coronavirus disease 2019 (COVID-19) pandemic.
    Materials and methods: The survey-based cross-sectional study was designed online and included 24 closed-ended questions. After performing a pilot test and validation of survey, it was conducted among clinicians between September 2021 and December 2021.
    Results: One-hundred fifteen clinicians (54 males, 61 females; 78.1% in rheumatology practice for at least five years) responded to the survey. The respondents indicated that they worked in coronavirus-related departments, comprising inpatient service (50.4%), consultancy (42.6%), and outpatient clinic (27.8%). Around 40% of clinicians stated they spent less time on scientific research (43.1%) and clinical learning activities (43.2%), while almost the same proportion of them spent more (41.1% and 45.0%, respectively). This study revealed that 53.5% published at least one paper covering mostly COVID-19 in the scientific citation index (SCI) or SCI-expanded (SCI-E) indexed journals. However, nearly half of them did not have any papers published in the SCI/SCI-E (46.5%) or non-SCI/SCI-E indexed (44.6%) journals. Regarding the perspectives of clinicians about clinical practices, they considered fewer biological (57.0%) and nonbiological (55.0%) drug usage, reported fewer outpatient clinic visits (88.2%), more newly diagnosed rheumatic diseases (62.5%), and more disease exacerbations (31.2%). Most of the clinicians (range, 76.2 to 86.3%) thought they accurately managed their patients during the COVID-19 pandemic.
    Conclusion: Clinicians published mostly coronavirus-related papers in the pandemic era, and in the self-assessment, clinicians thought that they correctly manage their patients. In addition, this study reflected the frequency of academic publications and clinicians' work routines during the pandemic.
    Keywords:  Academic publications; COVID-19; pandemic; perspective; rheumatology.
    DOI:  https://doi.org/10.46497/ArchRheumatol.2023.9957
  25. Malays Orthop J. 2023 Nov;17(3): 97-98
      
    DOI:  https://doi.org/10.5704/MOJ.2311.016
  26. J Pediatr Orthop. 2023 Dec 22.
       BACKGROUND: Podcasts have become increasingly utilized in medical education over the past decade, especially in orthopaedic surgery. Compared with more traditional learning tools, podcasts are easily accessible, free, and capable of use while multitasking. Despite these apparent benefits, the effectiveness of podcasts as a dissemination tool for emerging peer-reviewed literature is not well understood. The Peds Ortho Podcast is the official podcast of Pediatric Orthopedic Society of North America that highlights recently published peer-reviewed articles through author interviews and executive summaries of featured articles. The purpose of this study was to compare the distribution of the Peds Ortho Podcast to traditional media by comparing electronic access statistics between the podcast episodes and the journal articles they summarize.
    METHODS: Podcast episodes were reviewed to catalog the abstracts and articles discussed therein. Because podcasts and articles utilize different electronic metrics to track distribution, we established a common metric of an "access," which we defined as an "intent to consume the media." For articles, we defined an "access" as the largest value of a publisher's online metrics, be it abstract views, full text views, or article downloads. For podcast episodes, we defined an "access" as any play >0 seconds. Access data were analyzed using independent samples t test and analyses of variance.
    RESULTS: Eighty episodes of the Peds Ortho Podcast have featured 333 published, peer-reviewed articles to date, with 303 included in the final analysis with available article metrics. There were significantly more mean electronic accesses per podcast episode than featured articles (1236 vs. 482, P<0.001). Podcast consumption greatly varies in the first 30 days following episode release; however, recent episodes have a substantial proportion of accesses soon after publication.
    CONCLUSIONS: Given that podcast electronic access is greater than traditional media, podcasts appear to be a valuable tool for health care providers and trainees. Podcasts serve a complementary role to traditional media by quickly disseminating main points and raising awareness of emerging research.
    DOI:  https://doi.org/10.1097/BPO.0000000000002606
  27. R Soc Open Sci. 2023 Jul;10(7): 230206
      Replacing traditional journals with a more modern solution is not a new idea. Here, we propose ways to overcome the social dilemma underlying the decades of inaction. Any solution needs to not only resolve the current problems but also be capable of preventing takeover by corporations: it needs to replace traditional journals with a decentralized, resilient, evolvable network that is interconnected by open standards and open-source norms under the governance of the scholarly community. It needs to replace the monopolies connected to journals with a genuine, functioning and well-regulated market. In this new market, substitutable service providers compete and innovate according to the conditions of the scholarly community, avoiding sustained vendor lock-in. Therefore, a standards body needs to form under the governance of the scholarly community to allow the development of open scholarly infrastructures servicing the entire research workflow. We propose a redirection of money from legacy publishers to the new network by funding bodies broadening their minimal infrastructure requirements at recipient institutions to include modern infrastructure components replacing and complementing journal functionalities. Such updated eligibility criteria by funding agencies would help realign the financial incentives for recipient institutions with public and scholarly interest.
    Keywords:  affordability; functionality‌; infrastructure; publishing; replicability; scholarly
    DOI:  https://doi.org/10.1098/rsos.230206