bims-evares Biomed News
on Evaluation of research
Issue of 2019‒04‒28
fourteen papers selected by
Thomas Krichel
Open Library Society

  1. Elife. 2019 Apr 24. pii: e45133. [Epub ahead of print]8
    Abdill RJ, Blekhman R.
      The growth of preprints in the life sciences has been reported widely and is driving policy changes for journals and funders, but little quantitative information has been published about preprint usage. Here, we report how we collected and analyzed data on all 37,648 preprints uploaded to, the largest biology-focused preprint server, in its first five years. The rate of preprint uploads to bioRxiv continues to grow (exceeding 2,100 in October 2018), as does the number of downloads (1.1 million in October 2018). We also find that two-thirds of preprints posted before 2017 were later published in peer-reviewed journals, and find a relationship between the number of downloads a preprint has received and the impact factor of the journal in which it is published. We also describe, a web application that provides multiple ways to interact with preprint metadata.
    Keywords:  none
  2. Nat Biomed Eng. 2018 Jan;2(1): 1
  3. Nat Hum Behav. 2017 Nov;1(11): 791-796
    Nielsen MW, Andersen JP, Schiebinger L, Schneider JW.
      Gender and sex analysis is increasingly recognized as a key factor in creating better medical research and health care 1-7 . Using a sample of more than 1.5 million medical research papers, our study examined the potential link between women's participation in medical science and attention to gender-related and sex-related factors in disease-specific research. Adjusting for variations across countries, disease topics and medical research areas, we compared the participation of women authors in studies that do and do not involve gender and sex analysis. Overall, our results show a robust positive correlation between women's authorship and the likelihood of a study including gender and sex analysis. These findings corroborate discussions of how women's participation in medical science links to research outcomes, and show the mutual benefits of promoting both the scientific advancement of women and the integration of gender and sex analysis into medical research.
  4. PLoS One. 2019 ;14(4): e0216128
    Holman L, Morandin C.
      Evidence suggests that women in academia are hindered by conscious and unconscious biases, and often feel excluded from formal and informal opportunities for research collaboration. In addition to ensuring fairness and helping to redress gender imbalance in the academic workforce, increasing women's access to collaboration could help scientific progress by drawing on more of the available human capital. Here, we test whether researchers tend to collaborate with same-gendered colleagues, using more stringent methods and a larger dataset than in past work. Our results reaffirm that researchers co-publish with colleagues of the same gender more often than expected by chance, and show that this 'gender homophily' is slightly stronger today than it was 10 years ago. Contrary to our expectations, we found no evidence that homophily is driven mostly by senior academics, and no evidence that homophily is stronger in fields where women are in the minority. Interestingly, journals with a high impact factor for their discipline tended to have comparatively low homophily, as predicted if mixed-gender teams produce better research. We discuss some potential causes of gender homophily in science.
  5. Scand J Psychol. 2019 Apr 21.
    Smith PK, Berkkun F.
      Empirical articles on school bullying need to give contextual details of the study, including on participants (number, age, gender), the country in which data was gathered, and the year in which it was gathered. We argue that these are important aspects of information, and that country and year of data collection cannot be inferred unambiguously unless they are explicitly stated. We report an analysis of contextual information on a sample of 201 articles, from 1976 to 2015, on school bullying. The great majority of studies gave information on number and age of participants, and most on gender balance. Most also gave explicit information on the country in which data was gathered. However only about one quarter of articles gave information on the date (year) in which data was gathered. For those that did, the average gap from data gathering to publication was 4 years, with a range of 1 to 11 years. We argue that the date of data collection is an important historical aspect, as many societal changes, even over a period of a few years, can impact on prevalence and nature of bullying. We recommend that besides participant and country information, year of data collection is routinely given in empirical articles on school bullying.
    Keywords:  Bully; country; history; victim; year
  6. J Vasc Surg. 2019 May;pii: S0741-5214(18)32249-3. [Epub ahead of print]69(5): 1559-1565
    Cheng TW, Farber A, Rajani RR, Jones DW, Flynn D, Rybin D, Doros G, Kalish JA, Meltzer AJ, Siracuse JJ.
      OBJECTIVE: Advancement in academic medicine is multifactorial. Our objectives were to characterize academic appointments in vascular surgery and to investigate what factors, particularly publications, influenced academic appointment.METHODS: Academic vascular surgeons at Accreditation Council for Graduate Medical Education vascular training programs or at primary sites of U.S. allopathic medical schools were included. Those with qualified titles, such as "adjunct" or a "clinical" prefix, were excluded. Sex, education, region, board certification, and affiliation details were recorded. Web of Science was queried for publication details and h-index. The h-index is a "personal impact factor" defined as "x" number of publications cited at least "x" number of times. After surgeons' information was deidentified, univariate and multivariable analyses were completed for academic appointment and appointment as division chief.
    RESULTS: There were 642 vascular surgeons who met criteria: 297 (46.3%) assistant professors, 150 (23.4%) associate professors, and 195 (30.4%) professors. There were 96 (15%) division chiefs and 10 (1.6%) chairs of surgery, and 83.2% were male. Surgeons worked in the Northeast (33.5%), Southern (32.6%), Central (20.1%), and Western (13.9%) United States. The mean (±standard deviation) number of publications was 13.7 ± 15.4 for assistant professors, 33.9 ± 28.8 for associate professors, and 86.8 ± 63.6 for professors (P < .001). Mean number of first or last author publications was 5.3 ± 6.4 for assistant professors, 12.2 ± 12.7 for associate professors, and 38.7 ± 35.3 for professors (P < .001). Mean h-index was 5.9 ± 5.4 for assistant professors, 12 ± 7.7 for associate professors, and 24.9 ± 12.6 for professors (P < .001). In multivariable analysis, vascular surgery board certification (adjusted odds ratio [OR], 6.08; 95% confidence interval [CI], 1.15-32.2; P = .03), academic appointment at a public medical school (OR, 1.99; 95% CI, 1.18-3.37; P = .01), years since medical school graduation (OR, 1.13; 95% CI, 1.09-1.18; P < .001, per year), and number of publications (OR, 1.05; 95% CI, 1.03-1.06; P < .001, per publication) were independently associated with associate professor. Factors independently associated with professor were years since medical school graduation (OR, 1.18; 95% CI, 1.12-1.24; P < .001, per year) and number of first or last author publications (OR, 1.05; 95% CI, 1.02-1.09; P = .003, per publication). Appointment as division chief was independently associated with h-index (OR, 1.04; 95% CI, 1.01-1.08; P = .016, per point).
    CONCLUSIONS: Total number of publications was independently associated with associate professor, with number of first or last author publications particularly important for professor. The h-index was not independently associated with academic appointment, but it was for appointment as division chief. This study provides relevant data for promotional guidance in academic vascular surgery.
    Keywords:  Academic; Bibliometric; Publication; Vascular surgery; h-Index
  7. J R Army Med Corps. 2019 Apr 20. pii: jramc-2019-001188. [Epub ahead of print]
    Şenel E.
      OBJECTIVES: Scientometrics is a popular statistical discipline providing data relevant to publication patterns and trends in a certain academic field. There are no scientometric analyses of publications produced in military medicine literature. The present study aims to perform a holistic analysis of military medicine literature.METHODS: All data of this study were collected from the Web of Science Core Collection. All indexed documents between 1978 and 2017 were included. Countries, authors, institutions, citations and keywords relevant to the military medicine literature were comprehensively analysed. An infomap revealing global productivity and infographics of scientometric networks were generated.
    RESULTS: A total of 48 240 published items were found, 82.29% of which were original articles. USA, covering 56.66% of all literature dominated the military medicine field followed by the UK, China, Canada and Israel. We found that 18 of 20 most productive institutions in the world were from USA and the US Department of Defense was the most contributing institution in the literature with 9664 documents. The most used keywords over a 40-year period were 'military', 'veterans', 'posttraumatic stress disorder' and 'military personnel'. A scientometric network of keywords showed a complicated 'starburst pattern'.
    CONCLUSION: All most contributing countries except Turkey, China and Israel were developed nations. Only one institution (Tel Aviv University) from developing countries was noted in the list of 20 most productive institutions. The researchers from developing and the least developed countries should be encouraged and supported to carry out novel studies on military medicine.
    Keywords:  bibliometrics; military medicine; publication patterns; publication trends; scientometrics
  8. Cureus. 2019 Feb 13. 11(2): e4067
    Sawyer T, Rovera EJ.
      Introduction  In November 2013, the International Pediatric Simulation Society (IPSS) launched a channel on We performed the following analysis to examine the use of the channel, the reach of its publications, and their impact within the medical literature. Methods  The IPSS Cureus channel's Administrative Dashboard was used to collect data on manuscript type, manuscript submission date, publication date, total views, and total downloads for each article from publication date through December 31, 2018. Web of Science and Google Scholar were used to determine which channel publications had been cited during the study period, and those citations were reviewed to develop an estimate of the global reach of the publications. Results A total of 15 articles were published via the IPSS Cureus channel from April 18, 2014 to December 31, 2018, with a mean time between submission and publication of 46 days. These articles have been viewed an average of 736 times per article. The PDF download rate averaged 446 per article. These 15 articles have been cited a total of 37 times, averaging 2.5 citations per article. The sources for those citations were published in English (29), Spanish (4), Portuguese (2), Arabic (1), and Ukrainian (1). Conclusion Publications on the IPSS Cureus channel have a clear impact, in terms of the number of views, number of downloads, citation counts, and global reach. The channel also offers a rapid publication cycle. Further education in the pediatric simulation community on the use of the channel and promotion of the benefits of this resource for scholarships are warranted.
    Keywords:  bibliometrics; pediatric simulation; pediatrics; professional development; scholarship; scientometrics; simulation
  9. Can J Occup Ther. 2019 Apr 25. 8417419831453
    Brown T, Gutman SA.
      BACKGROUND.: The use of bibliometrics to evaluate the quality and impact of refereed journals has increased along with access to electronic databases and citation counts.PURPOSE.: This analysis compared and contrasted the range of publication metrics available for English-language occupational therapy journals.
    METHOD.: Bibliometric data were sourced for 23 English-language occupational therapy journals, including data from the Journal Citation Reports (JCR) 2- and 5-year impact factor, JCR Immediacy Index, Eigenfactor Score, Article Influence Score, Scopus Source Normalized Impact per Paper, SCImago Journal Rank (SJR) score, and ResearchGate journal impact score. H-indexes for journals were also sourced.
    FINDINGS.: The American Journal of Occupational Therapy had the highest publication metrics. SJR-based scores included a larger number of journals, whereas JCR-based metrics were more restrictive in the number of journals included.
    IMPLICATIONS.: Multiple metrics should be used to comprehensively understand occupational therapy journal performance.
    Keywords:  Bibliometrics; Bibliométrie; Classement des revues; Facteur d’impact; Impact factor; Journal ranks; Mesure de l’influence d’une revue; Publication metrics; Quality scores; Scores de qualité
  10. Int Endod J. 2019 Apr 22.
    Ahmad P, Dummer PMH, Chaudhry A, Rashid U, Saif S, Asif JA.
      AIM: To identify and analyse the main features of the top 100 most-cited randomized controlled trials, systematic reviews, and meta-analyses published in endodontic journals from 1961 to 2018.METHODOLOGY: The Clarivate Analytics' Web of Science 'All Databases' was used to search and analyse the 100 most frequently cited randomized controlled trials, systematic reviews, and meta-analyses having "randomized", "randomised", "randomized controlled", "randomised controlled", "randomized controlled trial", "randomized controlled trials", "clinical trial", "systematic", "systematic review", "meta-analysis", and "meta-analyses" in the title section. The "International Endodontic Journal", "Journal of Endodontics", "Oral Surgery Oral Medicine Oral Pathology Oral Radiology and Endodontology", "Australian Endodontic Journal", "Endodontics & Dental Traumatology", "Endo-Endodontic Practice Today", and "European Endodontic Journal" were included in the publication name section. After ranking the articles in a descending order based on their citation counts, each article was cross-matched with the citation counts in Elsevier's Scopus and Google Scholar. The articles were analysed and information on citation counts, citation density, year of publication, contributing authors, institutions, and countries, journal of publication, study design, topic of the article and keywords was extracted.
    RESULTS: The citation counts of the 100 most-cited articles varied from 235 to 20 (Web of Science), 276 to 17 (Scopus), and 696 to 1 (Google Scholar). The year in which the top 100 articles were published was 2010 (n=13). Among 373 authors, the greatest number of articles was associated with three individuals namely Reader A (n=5), Beck M (n=5), and Kvist T (n=5). Most of the articles originated from the United States (n=24) with the greatest contribution from Ohio State University (USA) (n=5). Randomized controlled trials were the most frequent study design (n=45) followed by systematic reviews (n=30) with outcome studies of root canal treatment being the major topic (n=35). The Journal of Endodontics published the largest number of included articles (n=70) followed by the International Endodontic Journal (n=27). Among 259 unique keywords, meta-analysis (n=23) and systematic review (n=23) were the most frequently used.
    CONCLUSION: This study has revealed that year of publication had no obvious impact on citation count. The bibliometric analysis highlighted the quantity and quality of research as well as the evolution of scientific advancements made in the field of Endodontology over time. Articles before 1996, that is prior to the CONSORT statement that encouraged authors to include specific terms in the title and keywords, may not have been included in this electronic search. This article is protected by copyright. All rights reserved.
    Keywords:  Citations; Endodontics; Meta-analyses; Randomized controlled trials; Systematic reviews
  11. Rheumatol Int. 2019 Apr 25.
    Zhao X, Chen J, Pan Y, Feng H, Meng B, Meng Y.
      The current study was to investigate the quantity and quality of researches in the field of ankylosing spondylitis, and to reveal the characteristics of worldwide productivity on this disease. This was a bibliometric study on ankylosing spondylitis using Web of Science. The numbers of papers, citations, research output normalized by population and gross domestic product, and the main active countries were analyzed. A total number of 7239 papers were published between 2008 and 2017. The yearly number of papers published during this period showed a significant increase (p < 0.001). North America, West Europe and East Asia were the main regions for AS papers. High-income countries contributed the greatest proportion of papers (70.49%). The research productivity from middle- and low-income countries was low (29.45%; 0.06%). The United States was the country with the greatest contributions between 2008 and 2017 (12.47%), followed by China (12.17%), Turkey (8.34%), Germany (7.82%), and the United Kingdom (5.97%). Significantly positive correlations were proved between the number of papers and population/gross domestic product (p < 0.05). From 2013, the number of AS publications by the authors from China exceeded those from the United States. However, China had far less total citations (7219 vs. 22,043) and average citations (8.19 vs. 24.41) than the United States. Denmark had the greatest productivity when normalized by population, followed by Norway, and Netherlands. When normalized by gross domestic product, Denmark led the top list, followed by Netherlands, and Greece. Papers from Australia showed the highest average citation (32.64), followed by Netherlands (31.63), and Germany (26.88). The current study showed a noticeable growth in global research output on ankylosing spondylitis between 2008 and 2017. High-income countries especially the United States had the greatest contributions. The contributions from middle- and low-income countries were considerably small. The number of papers published by countries was positively associated with their population and gross domestic product. Although China had exceeded the United States in the quantity of yearly AS publications, the quality of papers from China was lower compared to the United States. European countries may have better performance relative to their population and economic size.
    Keywords:  Ankylosing spondylitis; Bibliometric analysis; Publications; Web of science
  12. Environ Sci Pollut Res Int. 2019 Apr 26.
    Lin H, Zhu Y, Ahmad N, Han Q.
      Brownfields have attracted increasing attentions from both researchers and practitioners. However, few studies have attempted to make a comprehensive and quantitative review on this topic. This study conducted a scientometric review on the brownfield research from 1995 to 2017 using CiteSpace. The knowledge structure, hot topics, research trends, and gaps were analyzed based on the co-author, co-word, co-citation, and clusters analysis. Six hundred thirty articles from the Web of Science core collection database were selected as the research samples. Results revealed that the research focus has changed from soil remediation technologies to sustainable regeneration methods. The most vital development in brownfield research occurred in the USA, England, Canada, Germany, and China. "Brownfield," "heavy metal," "remediation," "redevelopment," and "sustainability" were the most frequently used keywords. Whereas "management" and "biodiversity" received citation bursts in recent years. Existing researches mainly concentrated on subject categories of environmental sciences ecology, environmental sciences, engineering, environmental studies, engineering environmental, and urban studies. Sustainable regeneration, urban brownfields' regeneration, mental distribution, coal-mine brownfield, and ecosystem service were the identified co-citation clusters and represented the hot topics and emerging trends. The research gaps can serve as a motivation to research on the next generation of brownfields to support the sustainable development. This study provides researchers and practitioners an extensive and intensive understanding of the salient research themes and trends of brownfields' research worldwide.
    Keywords:  Brownfields; CiteSpace; Research trends; Scientometric; Visualization; Web of Science
  13. J Oral Pathol Med. 2019 Apr 21.
    Yang X, Liu W.
      We read with interest the recent article (jop12683) by Foy et al. [1] entitled "Bibliometric analysis of a century of research on oral erythroplakia and leukoplakia". We congratulate the authors on conducting the first bibliometric analysis on oral erythroplakia and leukoplakia (OEL). The leading journals, authors and countries contributing to the research on OEL were analyzed. Yet, the interest was unfortunately not sustained through the reading for several concerned reasons. To begin with, we arguably provide specific comments on the article. Given these comments, we then focus on the analysis of study topics, study designs, and level of Evidence-Based Medicine (EBM) of the top-cited articles on OEL to add unaddressed information. This article is protected by copyright. All rights reserved.
  14. Front Surg. 2019 ;6 18
    Kaper NM, Ramakers GGJ, Aarts MCJ, van der Heijden GJMG.
      Background: We wanted to asses and characterize the volume of Otolaryngology publications on clinical research, published in major journals. Methods and Material: To assess volume and study type of clinical research in Otolaryngology we performed a literature search in high impact factor journals. We included 10 high impact factor Otolaryngology journals and 20 high impact factor medical journals outside this field (2011). We extracted original publications and systematic reviews from 2010. Publications were classified according to their research question, that is therapy, diagnosis, prognosis or etiology. Results: From Otolaryngology journals (impact factor 1.8 to 2.8) we identified 694 (46%) publications on original observations and 27 (2%) systematic reviews. From selected medical journals (impact factor 6.0 to 101.8) 122 (2%) publications related to Otolaryngology, 102 (83%) were on original observations and 2 (0.04%) systematic reviews. The most common category was therapy (40%). Conclusion: Half of publications in Otolaryngology concerns clinical research, which is higher than other specialties. In medical journals outside the field of Otolaryngology, a small proportion (2%) of publications is related to Otolaryngology. Striking is that systematic reviews, which are considered high level evidence, make up for only 2% of publications. We must ensure an increase of clinical research for optimizing medical practice.
    Keywords:  diagnosis; etiology; evidence-based medicine; evidence-based practice; impact factor; otolaryngology; prognosis; therapy