bims-evares Biomed news
on Evaluation of research
Issue of 2019‒01‒13
eleven papers selected by
Thomas Krichel
Open Library Society


  1. Front Bioeng Biotechnol. 2018 ;6 198
    Dozmorov MG.
      Modern research is increasingly data-driven and reliant on bioinformatics software. Publication is a common way of introducing new software, but not all bioinformatics tools get published. Giving there are competing tools, it is important not merely to find the appropriate software, but have a metric for judging its usefulness. Journal's impact factor has been shown to be a poor predictor of software popularity; consequently, focusing on publications in high-impact journals limits user's choices in finding useful bioinformatics tools. Free and open source software repositories on popular code sharing platforms such as GitHub provide another venue to follow the latest bioinformatics trends. The open source component of GitHub allows users to bookmark and copy repositories that are most useful to them. This Perspective aims to demonstrate the utility of GitHub "stars," "watchers," and "forks" (GitHub statistics) as a measure of software impact. We compiled lists of impactful bioinformatics software and analyzed commonly used impact metrics and GitHub statistics of 50 genomics-oriented bioinformatics tools. We present examples of community-selected best bioinformatics resources and show that GitHub statistics are distinct from the journal's impact factor (JIF), citation counts, and alternative metrics (Altmetrics, CiteScore) in capturing the level of community attention. We suggest the use of GitHub statistics as an unbiased measure of the usability of bioinformatics software complementing the traditional impact metrics.
    Keywords:  altmetrics; bioinformatics; github; impact factor; software
    DOI:  https://doi.org/10.3389/fbioe.2018.00198
  2. Eur Radiol. 2019 Jan 09.
    Sundermann B.
      This Editorial Comment refers to the article "Citation Bias in Imaging Research: Are studies with higher diagnostic accuracy estimates cited more often?" by Frank RA, Sharifabadi AD, Salameh JP et al, Eur Radiol. 2018 Nov 15. https://doi.org/10.1007/s00330-018-5801-8 [1].
    DOI:  https://doi.org/10.1007/s00330-018-5974-1
  3. Adicciones. 2018 Dec 20. 0(0): 1150
    Castelló-Cogollos L, Bueno Cañigral FJ, Valderrama Zurián JC.
      The present study aims to reveal the structure of positions in the field of addiction through the analysis of doctoral theses read in Spain. The source consulted for the selection of the theses was TESEO. Searching for the keywords drug abuse, alcoholism, drug effects and drug addiction treatment during the period 1976-2017 produced 728 theses. The most productive period is 2013-2017, with 208 (28.6%) doctoral theses. The overall rate of publication is increasing, but in the period 2003-2007 output decreased significantly to 5.2% of the total. The university contributing the most theses is the University of Valencia. The academic who has supervised the most theses is Alfonso Velasco Martín, and Emilio Ambrosio Flores is the researcher who has participated most on examining committees. The analysis of the participants in the doctoral thesis process shows a gradual increase of women in authorship, in thesis supervision and as examiners. In terms of subject, the most frequently treated aspects are those related to psychology, pharmacology and medical sciences.The analysis of doctoral theses on substance abuse provides an overview of the structure and the most influential participants in this area. Increasing public concern and the creation of specific groups and research units are reflected in the growth of scientific output.
    DOI:  https://doi.org/10.20882/adicciones.1150
  4. Int J Spine Surg. 2018 Dec;12(6): 713-717
    Bovonratwet P, Webb ML, Ondeck NT, Shultz BN, McLynn RP, Cui JJ, Grauer JN.
      Background: Although publication rates from multiple orthopedic research conferences have been published in the literature, the publication rates of abstracts presented at the Lumbar Spine Research Society (LSRS) meetings have never been reported. The purpose of this study is to evaluate the publication rates from the LSRS annual meeting years 2008-2012 and then to compare those rates with that of other spine research society meetings.Methods: Podium presentations from 2008 to 2012 and poster presentations from 2010 to 2012 were reviewed. For each presentation, a PubMed search was performed to determine if a full-text publication existed. χ2 tests were used to compare LSRS publication rates to those of other spine meetings. In addition, impact of published articles was evaluated by average citation count and average journal impact factor.
    Results: From 2008 to 2012, a total of 332 podium and poster presentations were identified. The overall publication rate was 55.1% (183/332). For podium presentations, this was greatest in 2012 (66.0%) and lowest in 2008 (51.5%). For poster presentations, this was greatest in 2012 (53.6%) and lowest in 2010 (25.0%). The publication rate of presentations is statistically greater than the publication rates of Eurospine (37.8%, P < .001), North American Spine Society (40.0%, P < .001), The International Society for the Study of the Lumbar Spine (45.0%, P = .012), and the Scoliosis Research Society (47.0%, P = .042) but not statistically different than that of Cervical Spine Research Society (65.7%, P = .059). In addition, the average citation count per published article categorized by year ranged from 13 to 31. The average journal impact factor of published articles categorized by year ranged from 2.31 to 2.55.
    Conclusions: While LSRS is a relatively young society, these findings point to the high quality of presentations at this scientific meeting. These findings speak to the scientific rigor of presentations at LSRS.
    Clinical Relevance: This study helps clinicians and scientists gauge the quality of a research meeting and make informed choices on which gatherings to attend.
    Keywords:  Lumbar Spine Research Society; annual meeting; podium; posters; publication rate
    DOI:  https://doi.org/10.14444/5089
  5. Acta Haematol. 2019 Jan 07. 141(2): 68-78
    Iqbal U, Rehan A, Akmal M, Jamali M, Iqbal A, Khan BA, Wasif KU, Rivera E, Khan M.
      BACKGROUND: Bibliometric analyses are a tool employed by researchers and funding agencies to establish the most important areas of research in a particular field, and to determine which foci need increased research attention. Such analyses have been published in a variety of clinical specialties; however, a detailed literature search showed that no such study has been done for "myeloid neoplasms." In order to bridge this gap, we conducted a citation analysis of the 100 most influential articles on myeloid neoplasms.METHODS: Two independent researchers extracted relevant articles from the Scopus database. These articles were then ranked in descending order of citations and a list of the top 100 original articles was made. A further, more detailed list was created containing significant discriminating characteristics.
    RESULTS: The top cited articles were published over a period of 47 years, with most of them being published in the 5-year interval of 2001-2005. The citations ranged from 636 to 4,039. The articles originated from 28 different countries. Most of the articles were published in high-impact journals.
    CONCLUSION: Our analysis sheds light on the quality of work and driving trends, listing the most cited and impactful guideline articles within this field and aiding clinicians.
    Keywords:  Acute myelogenous leukemia; Bibliometrics; Citation classics; Leukemia; Neoplasms
    DOI:  https://doi.org/10.1159/000493251
  6. Environ Sci Pollut Res Int. 2019 Jan 07.
    Li X, Du J, Long H.
      Green behavior is an important part of the study of green development. To promote green development, it is necessary to engage in further innovation on the basis of lessons from international advancements in green behavior. To clarify the spatial and temporal distribution characteristics of international researchers in the study of green behavior, the research focus, and the research frontiers, a visual analysis was performed on 22,114 articles cited in the SSCI and SCI-EXPANDED databases from 2000 to 2017. This analysis was based on bibliometrics and mapping knowledge domain (MKD) analysis with CiteSpace 5.3.R4, a scientific and technological text-mining and visualization software. The results show that international green behavior research has the following main characteristics. First, a positive correlation was found between the number of papers and time. Second, research is highly valued by researchers in the natural sciences, such as ecology. The USA is involved in major research efforts and maintains a high level of cooperation with other countries and regions. International cooperation among institutions needs to be strengthened. The co-cited journals are primarily academic journals in the natural sciences. Third, research hotspots mainly focus on the theory of planned behavior (TPB), consumers, attitudes, performance, and environment, all of which evolve according to the phase path of "germination-growth." Fourth, the research frontier issues are largely related to management science and environmental science, and the research objects and methods will become increasingly complex and interdisciplinary over time.
    Keywords:  Bibliometrics; CiteSpace; Green behavior; Mapping knowledge domain; Visualization
    DOI:  https://doi.org/10.1007/s11356-018-04090-1
  7. Iran J Nurs Midwifery Res. 2019 Jan-Feb;24(1):24(1): 11-17
    Pournia Y.
      Background: The ability to comprehend a text depends primarily on the knowledge about its words. This study investigated the most frequent words in high impact factor (IF) English nursing journals.Materials and Methods: This corpus-based study was conducted on the articles of 13 English nursing journals with an IF of over 0.7 from November 2014 to September 2016. After the typographical errors were corrected and the tokens (running words) in each journal were equalized, the tokens were analyzed using the Range software. Finally, a word list was extracted from the final 2851 articles and 8196,953 tokens to reach the optimal 98% vocabulary coverage.
    Results: A word list consisting of 1081 word families and 3175 word types with 5.24% coverage was extracted, which fulfilled the 98% vocabulary coverage. In other words, the coverage of the 1081 word-family list (5.24%), the coverage of the 1st 3000 English word families (87.55%), proper names, marginal words, compound words, and abbreviations related to the software (3.29%), and the coverage of the new proper names (1.13%), new compounds (0.02%), new abbreviations (0.72%), and letter-number combinations (0.05%) totaled 98%.
    Conclusions: By learning the 1st 3000 English word families and the 1081 word families introduced in this study, a nursing student can comprehend the texts of articles in high IF nursing journals without any considerable help from other resources.
    Keywords:  Journal impact factor; nursing; vocabulary
    DOI:  https://doi.org/10.4103/ijnmr.IJNMR_190_17
  8. FEMS Microbiol Lett. 2019 Jan 09.
    Dehdarirad T, Sotudeh H, Freer J.
      Amongst health-related scientific disciplines, microbiology appears to play a vital role in creating a sustainable future with respect to health, the environment, and a bio-based economy. Microbiology research covers a wide range of different disciplines and addresses many important global issues. This study aimed to identify topics being addressed within the last five years (2012-2016) in the field of microbiology worldwide and to compare them in terms of three different indicators: Gross domestic product (GDP), Human Development index (HDI) and Infectious Disease Vulnerability Index (IDVI). The data set of this study comprised 167,874 articles and reviews from 2012 to 2016, which were extracted from the Web of Science Medline. To identify and visualize the topics addressed during the studied period, VOSviewer was used. The construction and visualization of the term map was done based on 5,918 MESH subject headings. The methodology and procedures employed included Kruskal-Wallis test and two-sample proportion test. Overall, our study showed that the field of microbiology has focused on six different topics during 2012-16. The papers written with the collaboration of countries with low socio-economic status and high vulnerability to infectious diseases, mainly addressed topics related to the primary needs of people such as food safety, the prevention and control of infectious diseases, food and energy poverty. In contrast, papers written with the collaboration of countries with high socio-economic development status and less vulnerability to infectious diseases mainly focused on big data, alternative methods to animal experiments.
    DOI:  https://doi.org/10.1093/femsle/fnz004
  9. Ir J Med Sci. 2019 Jan 09.
    Palacios-Marqués AM, Carratala-Munuera C, Martínez-Escoriza JC, Gil-Guillen VF, Lopez-Pineda A, Quesada JA, Orozco-Beltrán D.
      BACKGROUND: Randomised clinical trials are considered to be the most reliable study design for assessing the efficacy and safety of health interventions.AIMS: To analyse worldwide obstetrics research carried out through randomised clinical trials, from 2002 to 2013.
    METHODS: A bibliometric analysis was performed. Publications on obstetrics that were published journals indexed in the MEDLINE database from 2002 to 2013 were analysed. The major medical subject headings used in the search were obstetrics, pregnancy complications and obstetrics surgical procedures. The main study outcome was index of research productivity.
    RESULTS: Our study search strategy yielded a total of 142,659 articles and 9967 clinical trials. The growth rate of scientific production in obstetrics during this period was 55.43% (n = 5094). The growth rate of production of randomised clinical trials in this specialty, meanwhile, was 97.84% (n = 544). Most of the identified authors (n = 22,622, 71.21%) published only one paper during the study period. Patterns of co-authorship among the 20 most productive authors were identified. After applying Bradford's law, six journals in the nucleus (the most prolific journals) were found. Of all the clinical trials in obstetrics published between 2002 and 2013, 10.3% were published in journals belonging to categories other than Obstetrics and Gynecology. The most common research topic in 2002 and 2013 was the use of analgesia and anesthesia in obstetrics.
    CONCLUSIONS: Total scientific production rate in obstetrics increased from 2002 to 2013, especially randomised clinical trials. However, randomised clinical trials continue to represent a small proportion of total production.
    Keywords:  Bibliometrics; Gynaecology; Obstetrics; Randomised clinical trials
    DOI:  https://doi.org/10.1007/s11845-018-1954-3
  10. Am J Disaster Med. 2018 Summer;13(3):pii: ajdm.2018.0298. [Epub ahead of print]13(3): 169-179
    Relvas LM, de Oliveira AP.
      INTRODUCTION: A burn disaster is defined by a mass casualty involving a large number of severely burned victims. Several countries have been confronted with these mass casualties and have developed national burn practice guidelines. This study presents a comprehensive review of the literature related to the benefits and conditions required for the introduction of a burn plan and identify successful strategies in Europe to apply in Portugal.METHODS: This study uses a scoping review approach, following the "five stages framework" suggested by Arksey and O'Malley (2005). A literature search strategy was designed to identify the relevant publications from three medical databases (PubMed/Medline, ScienceDirect, Scopus). Studies meeting our inclusion criteria were analyzed in detail. Data analysis included a descriptive summary and a thematic analysis.
    RESULTS: The research revealed that since 2000, 67 articles have been published on the subject. Of these 67 articles, only eight refer to burn plans in Europe. The papers which were included and reviewed were descriptive studies (N = 2), research paper (N = 2), reviews (N = 3), and an editorial (N = 1). Countries with published articles were Switzerland, Sweden, the Netherlands, and the United Kingdom.
    CONCLUSIONS: The research has shown a gap in the planning for major burn disasters in Europe. Although it is a very specific issue, and many times the approach to major disasters is carried out in a generalist way, the truth is that a burn disaster entails particularities that justify its unique approach. Since year 2000, only eight articles have been published in Europe and there are few publications showing intervention plans already tested and validated on the ground. In Portugal, there were no articles published that approaches this problem, making the rational of this work.
    DOI:  https://doi.org/10.5055/ajdm.2018.0298
  11. Medicine (Baltimore). 2019 Jan;98(2): e14067
    Jiang Y, Hu R, Zhu G.
      PURPOSE: The infection is an essential problem in the clinical practice in orthopedics. The bibliometric analysis was conducted to evaluate the top 100 cited articles on infection in orthopaedics.METHODS: The Web of Science (WoS) Core Database was comprehensively searched from 1975 to 2017, and the literature search was limited in Science Citation Index Expanded (SCI-E). The subject terms included "infection", "infectious", and "infect*". All retrieved articles were filtrated by selecting the subspecialty of "Orthopedics". The searching results were listed by citation times to identify the top 100 cited articles. Significant information was elicited, including the authors, journals, countries, institutions, published year, and types of publication.
    RESULTS: A significant increase was observed in the number of annual publications focusing on infection in orthopedics worldwide. Each of the top 100 cited articles was cited more than 150 times. Total citation times was positively associated with citation times in 2016 (P <.01) and mean citation times per year (P <.01). Conversely, age of the article was negatively associated with citation times in 2016 (P <.01) and mean citation times per year (P <.01). Besides, citation times in 2016 was positively related to mean citation times per year (P <.01). The United States was the most productive country, surgery was the most popular subspecialty and Journal of Bone and Joint Surgery American Volume was the most popular journal.
    CONCLUSION: Infection in orthopaedics has attracted more and more researchers' concern. As for the top 100 cited articles, there were significant relationships among total citation times, citation times in 2016 and mean citation times per year as well as age of the article. The United States was the most productive country, surgery was the most popular subspecialty and Journal of Bone and Joint Surgery American Volume was the most popular journal.
    DOI:  https://doi.org/10.1097/MD.0000000000014067