bims-evares Biomed News
on Evaluation of research
Issue of 2020‒02‒23
twenty papers selected by
Thomas Krichel
Open Library Society


  1. J Clin Aesthet Dermatol. 2020 Jan;13(1): 12-17
    Nestor MS, Fischer D, Arnold D, Berman B, Del Rosso JQ.
      Clinical and experimental literature search has changed significantly over the past few decades, and with it, the way in which we value information. Today, our need for immediate access to relevant and specific literature, regardless of specialty, has led to a growing demand for open access to publications. The Journal Impact Factor (JIF) has been a long-time standard for representing the quality or "prestige" of a journal, but it appears to be losing its relevance. Here, we define the JIF and deconstruct its validity as a modern measure of a journal's quality, discuss the current models of academic publication, including their advantages and shortcomings, and discuss the benefits and shortcomings of a variety of open-access models, including costs to the author. We have quantified a nonsubscribed physician's access to full articles associated with dermatologic disease and aesthetics cited on PubMed. For some of the most common dermatology conditions, 23.1 percent of citations (ranging from 17.2% for melasma to 31.9% for malignant melanoma) were available as free full articles, and for aesthetic procedures, 18.9 percent of citations (ranging from 11.9% for laser hair removal to 27.9% for botulinum toxin) were available as free full articles. Finally, we discuss existing alternative metrics for measuring journal impact and propose the adoption of a superior publishing model, one that satisfies modern day standards of scholarly knowledge pursuit and dissemination of scholarly publications for dermatology and all of medical science.
    Keywords:  IF; JIF; Journal impact factor; OA bronze; OA gold; OA green; hybrid gold; hybrid model; impact factor; open access; open-access; publishing
  2. Biochem Med (Zagreb). 2020 Feb 15. 30(1): 010708
    Njire Braticevic M, Babic I, Abramovic I, Jokic A, Horvat M.
      Introduction: First impression on potential readers is created by the title; therefore, authors should give importance to the title structure. The aim of this study was to establish whether articles created by a smaller number of authors and with shorter, descriptive or declarative titles gain more citations and whether article title length and number of authors correlate to the number of citations.Material and methods: A cross-sectional study on article citation data for 30 scientific journals published in 2016 in Medical Laboratory Technology field according to Web of Science database was conducted. The type of article, type of title, as well as number of words in the title and number of authors was recorded.
    Results: In the group of original articles (N = 2623), articles with declarative titles (N = 336, 13%) showed statistically higher number of citations in multiple comparison analysis when compared to descriptive titles (P < 0.001). No correlation was found between number of citations and title word count (r = 0.07, P < 0.001) nor between number of citations and number of authors in group of original articles (r = 0.09, P < 0.001). Original articles with descriptive titles longer than 15 words or with more than six authors are cited more (P = 0.005 and P < 0.001, respectively).
    Conclusion: Based on results of our study, titles do matter. Therefore, authors of original articles might want to consider including their findings in the title and having longer titles.
    Keywords:  bibliometrics; cross-sectional studies; medical laboratory technology; publications
    DOI:  https://doi.org/10.11613/BM.2020.010708
  3. Environ Sci Pollut Res Int. 2020 Feb 20.
    Zhang Y, Li C, Ji X, Yun C, Wang M, Luo X.
      As a cost-effective, environmentally friendly remediation technology, phytoremediation is defined as the use of green plants to remove pollutants from the environment or render them harmless and has been applied to a variety of contaminated sites throughout the world. There is a prominent phenomenon in which publications about phytoremediation increase each year and involve an increasing number of subject categories. This paper adopts the scientometric analysis method to assess the current state and explore the trends of phytoremediation research based on the bibliographic records retrieved from the Web of Science Core Collection (WoSCC). The results of this paper clearly answer the following questions. (1) What are the publishing characteristics of research on the topic of phytoremediation? What are the characteristics of academic collaboration in phytoremediation research? (2) What are the characteristics and development trends of phytoremediation research? (3) What are the hotspots and frontiers of phytoremediation research? Overall, the research method provides a new approach for the assessment of the performance of phytoremediation research. These results may help new researchers quickly integrate into the field of phytoremediation, as they can easily grasp the frontiers of phytoremediation research and obtain more valuable scientific information. This study also provides references for the follow-up research of relevant researchers.
    Keywords:  Bacterial endophyte; Burst detection; Co-cited analysis; Co-occurrence analysis; Commercial application; Exogenous additions; Toxic metal remediation
    DOI:  https://doi.org/10.1007/s11356-020-07646-2
  4. Acta Radiol. 2020 Feb 19. 284185120902391
    Baek S, Yoon DY, Lim KJ, Hong JH, Moon JY, Seo YL, Yun EJ.
      
    Keywords:  Nuclear medicine; altmetrics; citation; research
    DOI:  https://doi.org/10.1177/0284185120902391
  5. Braz J Phys Ther. 2020 Feb 07. pii: S1413-3555(19)30664-1. [Epub ahead of print]
    Araujo AC, Gonzalez GZ, Nascimento DP, Costa LOP.
      STUDY DESIGN: Cross-sectional study.BACKGROUND: Although Altmetric has been widely used by researchers to monitor the audience of their articles, there are no studies that have analysed factors associated with Altmetric score for systematic reviews and clinical practice guidelines.
    OBJECTIVES: 1) To analyse factors that could be associated with Altmetric scores for low back pain systematic reviews and clinical practice guidelines. 2) To describe the characteristics of these articles and their Altmetric scores.
    METHODS: We searched for all low back pain systematic reviews and guidelines indexed on the Physiotherapy Evidence Database published between 2015 and 2017. We extracted data related to the published paper, the publishing journal, and Altmetric scores.
    RESULTS: A total of 66 systematic reviews and 5 guidelines were included. The variable impact factor (independent variable) was associated with Altmetric mentioned score (dependent variable) with a β coefficient of 15.4 (95% CI: 0.97, 29.7) ajusted to all remaining variables. The variable number of citations normalized by year of publication (independent variable) was associated with Altmetric reader score (dependent variable) with a β coefficient of 6.4 (95% CI: 4.03, 8.72) ajusted to all remaining variables. We also found that the majority of the systematic reviews and guidelines were published in English, had a descriptive title, were published as open access, included multicenter studies, and had media release generated by the publishing journal.
    CONCLUSION: Metrics related to the number of citations, such as the impact factor are associated with Altmetric scores.
    Keywords:  Altmetric; Clinical practice guidelines; Low back pain; Social impact; Systematic reviews
    DOI:  https://doi.org/10.1016/j.bjpt.2020.01.002
  6. An Pediatr (Barc). 2020 Feb 14. pii: S1695-4033(20)30011-4. [Epub ahead of print]
    Alonso-Arroyo A, González de Dios J, Calvo C, Calduch-Losa Á, Aleixandre-Benavent R.
      INTRODUCTION: The purpose of this paper is twofold. On the one hand, to identify and characterise the production, citation, impact and collaboration indicators of the Pediatrics area of the Journal Citation Reports, and on the other hand, to place the journal Anales de Pediatría in the context of the Spanish journals of another twenty areas and medical specialties.MATERIAL AND METHOD: The sources of information used to obtain the indicators were Science Citation Index-Expanded, Journal Citation Reports, and Scimago Journal & Country Rank. A regression analysis was performed to determine the correlation between the citation and other variables.
    RESULTS: Pediatrics ranked 8th in scientific production during the period 2009-2018. In citations per journal it ranks 17th, and the average citations per article approaches 27, occupying, in this case, the 18th position. Below Pediatrics are Emergency Medicine, Rehabilitation, and Primary Health Care. There are no citations for 12.47% of the articles. The average impact factor places the area in 18th place and its h index was 197, reaching 14th position, and standing above seven other areas. The percentage of works carried out with international collaboration was 17.71%, above Primary Health Care (12.88%), Oncology (16.37%), and Emergency Medicine (17.03%). Among the Spanish journals, Anales de Pediatría was the fourth most productive journal, and occupied an intermediate position in terms of the number of citations.
    CONCLUSIONS: The indicators of citation and impact of the Pediatrics area tend to be above areas such as Emergency Medicine, Primary Health Care, Dentistry, Oral Surgery & Medicine, and Rehabilitation. Professional practice outside large hospitals, together with poor funding, as well as the low number of clinical trials due to the ethical requirements imposed on studies with children, may be the causes that result in moderate citation and impact indicators.
    Keywords:  Anales de Pediatría; Bibliometrics; Bibliometría; Citación; Citation; Colaboración científica; Impacto científico; Pediatrics; Pediatría; Scientific collaboration; Scientific impact
    DOI:  https://doi.org/10.1016/j.anpedi.2019.12.009
  7. Biomed Res Int. 2020 ;2020 1836471
    Kim YJ, Kim Y, Kim JE, Kim YH, Yoon DY, Bae JS.
      Background: As the average life expectancy continues to increase, interest in cognitive impairment is increasing. Nowadays, as social media expands its reach, academic research is spreading through social media, changing the way and speed by which research is propagated and also who consumes this content. Therefore, using Altmetric, a new web-based set of metrics that analyzes the impact of content on social media platforms, we investigated the characteristics of influential research articles on the topic of cognitive impairment in social media.Methods: An Altmetric Explorer search was performed on May 25, 2018, to extract the following information: (i) journal name, (ii) journal impact factor (IF), (iii) year of publication, (iv) article topic, (v) article type, and (vi) cognitive impairment subtype.
    Results: The journal "Neurology" was the most cited journal for cognitive impairment articles shared on social media. Among the various types of cognitive impairment, most articles were related to dementia (all subtypes), Alzheimer's disease, and aging. The most common article type was original scientific paper, especially cohort study. The most popular topic was the identification of protective or risk factors for cognitive impairment.
    Conclusion: The characteristics of articles with a high Altmetric Attention Score were somewhat different from those of articles with a high number of traditional citations. Social media had the disadvantage that it was difficult to verify the authenticity of the primary source in question, but the advantage was that it could immediately determine the trends regarding how information about that source was being shared and consumed. Therefore, it may be advisable to use Altmetric analysis in combination with traditional methods of evaluating the research articles to understand the dissemination of scientific research and to direct future research.
    DOI:  https://doi.org/10.1155/2020/1836471
  8. Zhonghua Liu Xing Bing Xue Za Zhi. 2020 Jan 10. 41(1): 115-119
    Ma HY, Ao YK, Liu WB, Cao GW.
      Objective: To retrospectively analyze the application trend of cohort study in the field of liver cancer in past 27 years and to look forward to the future development trend. Methods: Chinese and English papers reporting the cohort studies of liver cancer conducted in the mainland of China since 1991 were included. The literature management software was used to analyze the publication time, institution, type and objective of the studies and the follow-up performance. Statistical analysis was carried out by using SPSS 21.0. Results: The number and quality of the papers reporting liver cancer-related cohort studies increased significantly in past 27 years and a core English journal group of this field has formed. The average annual growth rates of Chinese and English papers published were 20.4% and 35.2% respectively. About 52.3% of the Chinese papers and 73.5% of the English papers were published in past five years and the quality of these papers was high. The Chinese papers published on Chinese core journals accounted for 49.2%, and the English papers published on SCI periodicals (IF>3) accounted for 47.3%. For the study objective, those published on the domestic journals mainly focused on the pathogenesis of hepatoma (41.5%), studies with large sample size was the common form. The SCI studies mainly focused on the prognosis of liver cancer (40.7%). High-quality SCI papers are more interested in the studies of prognosis, and survival analysis was the common form. Conclusions: The application of cohort study in the field of liver cancer gradually increased in China. Large-scale study and prognosis analysis were conducted commonly. However, it is necessary to further improve the researchers' understanding of cohort study, improve the follow-up quality, and increase the application of scientific evaluation methods, such as survival analysis, for the better solving of clinical problems.
    Keywords:  Bibliometrics; Cohort study; Epidemiology; Neoplasm, liver
    DOI:  https://doi.org/10.3760/cma.j.issn.0254-6450.2020.01.021
  9. Clin Toxicol (Phila). 2020 Feb 18. 1-4
    Glatstein M, Katz A, Taylor N, Werthein J, Zandberg E, Hoyte C.
      Introduction: Scientific conferences are useful in disseminating medical research and advancing the medical and scientific fields. An important measure of the success of such conferences is the proportion of research that is published in peer-reviewed journals. The conversion rates for toxicology abstracts to full-text publications at previous North American toxicology meetings were low. No study has assessed the publication rate from the 2013 North American Congress of Clinical Toxicology (NACCT) conference.Methods: We reviewed 316 abstracts presented at the 2013 NACCT Conference. We searched the PubMed, EMBASE, and Medline databases using the authors' names and keywords, through September 2019. We then identified and excluded cases and case reports to reanalyze the data.Results: Thirty-three of 316 abstracts (10.4%) subsequently appeared in 17 different peer-reviewed journals, led by Clinical Toxicology (13 out of 33, 3%). Leading countries of origin for abstract submission were the USA (285), Canada (9), and the UK (8). Excluding case reports, 25 out of 207 abstracts (12.0%) achieved publication in peer-reviewed journals.Conclusions: Fewer than one in eight abstracts reached publication within six years of the 2013 NACCT meeting, even after accounting for and excluding case reports. This rate is lower than in other specialty medical societies.
    Keywords:  Conference; abstracts; publications; toxicology
    DOI:  https://doi.org/10.1080/15563650.2020.1721005
  10. Urology. 2020 Feb 14. pii: S0090-4295(20)30173-4. [Epub ahead of print]
    Rickard M, Hannick JH, Blais AS, Wang J, Santos JD, Lorenzo AJ.
      OBJECTIVE: To review the literature of 5 pediatric urology topics and conduct gender based and forecasting analyses of first and corresponding authors.METHODS: A PubMed search was performed for hypospadias, hydronephrosis (HN), vesicoureteral reflux (VUR), bladder and bowel dysfunction (BBD), and cryptorchidism (UDT) over three decades from 1990-2019. The 50 most relevant "best match" papers from each decade were extracted by topic. Author gender, specialty and advanced degrees, along with journal and publication variables were collected. Forecasting analyses were conducted through the Holt-Winters method.
    RESULTS: Among 750 papers analyzed, 78% of corresponding and 70% of first authors were male. A significant upward trend was observed for female-authored publications in both first and corresponding positions over time (p<0.01). Forecasting analyses predicted a continuing upward trend for female corresponding (55%) and first authors (83%) by 2049. Most studies originated from pediatric urology (59%), followed by pediatric surgery (9%) and endocrinology/genetics (5%). Papers focused in The Journal of Urology (30%) with the majority originating from the US (38%). Most were retrospective (44%) and discussed medical (54%) versus surgical management (20%).
    CONCLUSIONS: The majority of pediatric urology literature has been generated by male authors. A persistent, rising trend in female authorship across all examined pediatric urology topics was noted. These encouraging findings are projected to continue to increase in the future, suggesting a movement towards equal and fair gender representation in authorship in pediatric urology.
    Keywords:  academics; gender; publishing; surgery
    DOI:  https://doi.org/10.1016/j.urology.2020.01.037
  11. Transl Behav Med. 2020 Feb 17. pii: ibaa009. [Epub ahead of print]
    Irwin ML, Lowry D, Neuhouser ML, Ligibel J, Schmitz K, Patterson RE, Colditz G, Li F, Nebeling L.
      Energy imbalance increases cancer burden by increasing cancer risk and mortality. Training early career investigators on conducting impactful energy balance and cancer research is needed. We developed a Transdisciplinary Research in Energetics and Cancer (TREC) Training Program for early career investigators. This analysis examined program satisfaction, knowledge gained, publications, and awards among Year 1 participants (i.e., fellows). The program consists of an in-person course, followed by 1 year of mentorship. Faculty and fellows completed precourse and postcourse surveys. Following the mentorship period, we surveyed fellows for TREC-related research productivity, including publications and grant funding attributed to the program. Twenty fellows were accepted into the program: 3 basic, 7 clinical, and 10 population scientists. Sixteen fellows were junior faculty and four were postdoctoral fellows. The course included ~50 lectures, small group sessions, and faculty-fellow sessions. 96.7% of attendees rated the course in the highest categories of "good/very good." Knowledge significantly improved in 37 of 39 research competencies (94.8%). In the 18 months following the course, fellows published 25 manuscripts, with 3 published in journals with impact factor ≥10. Nineteen grants were funded to TREC fellows (i.e., 7 National Institutes of Health awards, 2 American Cancer Society [ACS] awards, and 10 foundation/pilot awards), and 7 fellows received career promotions. The program's impact will be defined by the degree to which TREC fellows produce discoveries that could improve the health of populations at risk for and/or surviving cancer. Upon the conclusion of our fifth year in 2021, we will publicly disseminate the program material.
    Keywords:  Cancer; Career development; Diet; Exercise; Mentoring; Mortality; Obesity; Physical activity; Recurrence; Survival; Weight
    DOI:  https://doi.org/10.1093/tbm/ibaa009
  12. Proc Natl Acad Sci U S A. 2020 Feb 18. pii: 201914221. [Epub ahead of print]
    Huang J, Gates AJ, Sinatra R, Barabási AL.
      There is extensive, yet fragmented, evidence of gender differences in academia suggesting that women are underrepresented in most scientific disciplines and publish fewer articles throughout a career, and their work acquires fewer citations. Here, we offer a comprehensive picture of longitudinal gender differences in performance through a bibliometric analysis of academic publishing careers by reconstructing the complete publication history of over 1.5 million gender-identified authors whose publishing career ended between 1955 and 2010, covering 83 countries and 13 disciplines. We find that, paradoxically, the increase of participation of women in science over the past 60 years was accompanied by an increase of gender differences in both productivity and impact. Most surprisingly, though, we uncover two gender invariants, finding that men and women publish at a comparable annual rate and have equivalent career-wise impact for the same size body of work. Finally, we demonstrate that differences in publishing career lengths and dropout rates explain a large portion of the reported career-wise differences in productivity and impact, although productivity differences still remain. This comprehensive picture of gender inequality in academia can help rephrase the conversation around the sustainability of women's careers in academia, with important consequences for institutions and policy makers.
    Keywords:  STEM; gender inequality; science of science; scientific careers
    DOI:  https://doi.org/10.1073/pnas.1914221117
  13. Stereotact Funct Neurosurg. 2020 Feb 19. 1-7
    Sarica C, Kucuk F, Ozen A, Aksu Sayman O.
      BACKGROUND: The quality of a scientific meeting can be quantified by the rate of full publications arising from the presented abstracts and the impact factor of the journals in which the studies were published.OBJECTIVES: The aim of this study was to investigate the publication rates of presentations from the 2013 World Society for Stereotactic and Functional Neurosurgery (WSSFN) quadrennial meeting.
    METHODS: Scopus and PubMed databases were searched for the authors of the presentations to identify full publications arising from the relevant abstracts. Author and content matching were used to match an abstract with a full publication. Mann-Whitney U and Kruskal-Wallis tests were used for statistical analysis.
    RESULTS: In total, 77% (57/74), 56% (44/79), and 50% (79/157) of the paper, flash, and poster presentations, respectively, have been published, with an overall publication rate of 58% (180/310). Articles received a total of 5,227 citations, with an average of 29 ± 64.1 citations per article. The first authors who published their studies had a significantly higher h-index than those who did not publish (p = 0.003). The most preferred journals for publication were Journal of Neurosurgery, Acta Neurochirurgica, and Stereotactic and Functional Neurosurgery. The majority of the articles (117/180 [65%]) were published in a quartile 1 or 2 journal. The average journal impact factor (JIF) was 4.5 for all presentations, and 7.8 for paper session presentations. Studies presented in paper sessions were published in significantly higher-impact factor journals than those presented in poster sessions (p < 0.001).
    CONCLUSIONS: The WSSFN Congress had a relatively high overall publication rate (58%) compared to both other neurosurgical congresses and congresses in other scientific fields. The average JIF of 7.8 is a reflection of the high quality and high impact of the paper session presentations.
    Keywords:  Abstract; Impact factor; Publication rate; Quadrennial meeting; World Society for Stereotactic and Functional Neurosurgery
    DOI:  https://doi.org/10.1159/000505703
  14. Int J Cancer. 2020 Feb 22.
    González-Alvarez J, Sos-Peña R.
      Despite recent advances, gender inequality persists in many scientific fields, including medicine. Thus far, no study has extensively analyzed the gender composition of contemporary researchers in the oncology field. We examined 40 oncological journals (Web of Science, ONCOLOGY category) with different impact factors (Q1-Q4) and extracted all the articles and reviews published during 2015-17, in order to identify the gender of their authors. Our data showed that women represent about 38% of all the authorships, both in articles and reviews. In relative terms, women are overrepresented as first authors of articles (43.8%), and clearly underrepresented as last or senior authors (<30%). This double pattern, also observed in other medical fields, suggests that age, or more specifically, seniority, may play some role in the gender composition of cancer researchers. Examining the pattern of collaboration, an interesting finding was observed: the articles signed by a woman in the first or in the last position roughly showed gender parity in the byline. We found also some differences in the content of the articles depending on which gender occupies the first and last positions of the authorships. This article is protected by copyright. All rights reserved.
    Keywords:  cancer; gender; oncology; women
    DOI:  https://doi.org/10.1002/ijc.32938
  15. J Eur Acad Dermatol Venereol. 2020 Feb 20.
    Wang Y, Zhang H, Fang R, Tang K, Sun Q.
      BACKGROUND: Many articles in rosacea have been published. Bibliometric analysis is helpful to determine the most influential studies in a specific field.OBJECTIVE: To identify the top 100 most cited articles in rosacea using the bibliometric analysis method.
    METHODS: We searched in the Web of Science database on November 20th, 2019. Articles were listed in descending order by their total citations. The top 100 most cited articles in rosacea were identified and analyzed.
    RESULTS: The top 100 most cited articles were published between 1971 and 2015. The largest number of articles were published in a single interval in 2011-2015. The average annual citations were constantly ascending, and the total citations were positively correlated with annual citations. The 100 articles were classified into different research focuses: treatment (35%), pathogenesis (27%), clinical features and diagnosis (14%), pathophysiology (6%), associated diseases (4%), epidemiology (3%) and others (11%). 19 articles were randomized controlled trials (RCT), 14 focused on the association between rosacea and Demodex, and five focused on the association between rosacea and Helicobacter pylori. 25 publications focused on a specific subtype of rosacea, mainly papulopustular and ocular rosacea. The 100 articles were published in 32 journals. 79 different first corresponding authors were from 20 different countries, mostly in North America and Europe. Steinhoff. M from University of California published the most articles as the corresponding author.
    CONCLUSIONS: This study identified the top 100 most cited articles in rosacea and analyzed their bibliometric characteristics, which may pave the way for further research.
    Keywords:  Web of Science; bibliometric analysis; citation; rosacea
    DOI:  https://doi.org/10.1111/jdv.16305
  16. Int J Environ Res Public Health. 2020 Feb 17. pii: E1277. [Epub ahead of print]17(4):
    Sun J, Zhou Z, Huang J, Li G.
      In recent years, many researchers have investigated the association between air pollution and children. However, there has been little research to provide a macroscopic overview in this field. The aim of this study is to characterize the scientific production around the world in this area and map the trends. The relevant literature was searched from 1999 to 2018. To guarantee the quality of the literature, we combined the PubMed and WoS databases. The built-in statistics tools of the Web of Science website were used to display the trend of articles published by year and the distribution of journals. By CiteSpace (5.5.R2), the reference co-citation and burst keywords were extracted. In total, 15,999 target English documents were obtained. We summarized the characteristics of published documents, of research institutes' cooperation, and of the contents. As part of a research hotspot, ten clusters are presented, four popular topics are elaborated. Twenty-four burst words were obtained and analyzed. China has received more attention in recent years. Researchers in this field could carry out more cohorts' studies and fine particulate matter is one good air pollution index. Household air pollution exposure and children's lung function should be paid more attention.
    Keywords:  air pollution; bibliometric study; children; research trend
    DOI:  https://doi.org/10.3390/ijerph17041277
  17. Acta Physiol (Oxf). 2020 Feb 18. e13456
    Persson PB.
      How to best measure journal performance remains a controversial issue. Routinely, the impact factor of the journal is taken, although this measure was never designed to reflect journal performance. The impact factor was developed as a tool for librarians in academia to sort out, which of the many very different journals may best suit the demands of their readers. As the annual impact factors are released in the middle of the year, we cannot yet share this value with you. However, our estimates indicate a similarly high impact factor as for the most recent years.
    DOI:  https://doi.org/10.1111/apha.13456