bims-librar Biomed News
on Biomedical librarianship
Issue of 2023‒11‒12
forty papers selected by
Thomas Krichel, Open Library Society



  1. Database (Oxford). 2023 Nov 04. pii: baad070. [Epub ahead of print]2023
      The US National Library of Medicine has created and maintained the PubMed® database, a collection of over 33.8 million records that contain citations and abstracts from the biomedical and life sciences literature. This database is an important resource for researchers and information service providers alike. As part of our work related to the creation of an author graph for coronaviruses, we encountered several data quality issues with records from a curated subset of the PubMed database called MEDLINE. We provide a data quality assessment for records selected from the MEDLINE database and report on several issues ranging from parsing issues (e.g. character encodings and schema definition weaknesses) to low scores for identifiers against several data quality metrics (e.g. completeness, validity and uniqueness). Database URL  https://pubmed.ncbi.nlm.nih.gov.
    DOI:  https://doi.org/10.1093/database/baad070
  2. J Med Libr Assoc. 2023 Oct 02. 111(4): 835-836
      The Doctor of Nursing Practice (DNP) project collection is a group of approximately 120 DNP projects archived between 2017 and 2022 in Health Sciences Research Commons (HSRC), the health sciences institutional repository (IR) for the George Washington University. Our project focused on expanding avenues for the dissemination of DNP projects beyond our Digital Commons IR by integrating this content into the library's instances of Ex Libris Alma and Primo VE. By utilizing the Ex Libris Repository type import profile rather than the OAI-PMH feed, we identified enhanced opportunities for content discovery while likewise retaining better control over individual item records.
    Keywords:  Institutional Repositories; Metadata
    DOI:  https://doi.org/10.5195/jmla.2023.1624
  3. J Med Libr Assoc. 2023 Oct 02. 111(4): 839-843
      Meta-research is a bourgeoning field studying topics with significant relevance to health sciences librarianship, such as research reproducibility, peer review, and open access. As a discipline that studies research itself and the practices of researchers, meta-research spans disciplines and encompasses a broad spectrum of topics and methods. The breadth of meta-research presents a significant challenge for identifying published meta-research studies. Introducing a subject heading for meta-research in the controlled vocabularies of literature databases has the potential to increase the visibility of meta-research, further advance the field, and expand its impact on research practices. Given the relatively recent designation of meta-research as a field and its expanding use as a term, now is the time to develop appropriate indexing vocabulary. We seek to call attention to the value of meta-research for health sciences librarianship, describe the challenges of identifying meta-research literature with currently available key terms, and highlight the need to establish controlled vocabulary specific to meta-research.
    Keywords:  Meta-research; indexing; research on research
    DOI:  https://doi.org/10.5195/jmla.2023.1758
  4. J Med Libr Assoc. 2023 Oct 02. 111(4): 829-830
      Beginning in 2012, the Virtual Projects section of the Journal of the Medical Library Association has provided an opportunity for library leaders and technology experts to share with others how new technologies are being adopted by health sciences libraries. From educational purposes to online tools that enhance library services or access to resources, the Virtual Projects section brings technology use examples to the forefront. Virtual Projects highlighted in this year's section include new ways to use virtual reality for library instruction, podcasting to share important health care messages with the Latino Community, enhancing findability by using options in a library management system, and developing a research profiling system. After a hiatus due to publishing changes in 2022, 2023 will bring some major changes for the section. The new publication issue for future Virtual Projects sections will be January and the call for submissions and Virtual Projects deadline will now take place in June and July.
    DOI:  https://doi.org/10.5195/jmla.2023.1824
  5. J Med Libr Assoc. 2023 Oct 02. 111(4): 811-818
      Background: In 2020 the Health Science Center Libraries (HSCL) at the University of Florida collaborated with the Okeechobee County Public library (OCPL) on their plan to install Little Free Libraries (LFLs) within their community. It was agreed that the HSCL would provide consumer health-related materials for the Little Free Libraries and training with the goal of improving health literacy, precision medicine, and increasing rural access to consumer health materials and services.Case Presentation: Using census data, the County Health Improvement Plan, and OCPL circulation data the team identified minority population groups, potential accessibility issues, and local consumer health information needs and barriers to select appropriate resources. Additionally, partnerships were created with the local Health Department, Parks and Recreation services, the Rotary Club, and other local organizations to make the project a success. A total of 424 books were selected for the LFLs and 40 unique online resources were selected, printed, and shipped to OCPL to be used during LFL reference sessions. Technology was purchased to assist OCPL with their planned community health reference outreach sessions. HSCL created and provided online training on facilitating consumer health outreach, conducting health information reference services, and promoting community engagement for OCPL.
    Discussion: LFLs have become an important resource for lower-income rural families in Okeechobee. There are 7 LFLs in Okeechobee County, with a goal of eventually establishing 15 total to provide vital health resources and books. Over 2,456 items have been circulated among the 7 LFLs since May 2020. Overall, the project has been successful with positive feedback received from the community and with OCPL planning to continue to expand the project.
    Keywords:  Community Engagement; Community Outreach; Consumer Health; Health Literacy; Health Sciences Libraries; Public Libraries
    DOI:  https://doi.org/10.5195/jmla.2023.1585
  6. J Med Libr Assoc. 2023 Oct 02. 111(4): 823-828
      Background: Medical students must develop self-directed information-seeking skills while they are learning vast amounts of foundational and clinical skills. Students will use different resources for different phases of their training. Information literacy training provided to students will be more impactful when it is embedded into courses or assignments that mimic real-world scenarios. The retention of these skills is also improved by early and frequent instruction sessions, paired with formative feedback from librarian-educators.Case Presentation: Librarians received student responses to an information literacy question during two cycles of a Grand Rounds activity. Data were analyzed as follows: sources were grouped according to resource type and assessed for quality, and search terms were aggregated and analyzed to determine frequency of use. A librarian-educator presented the compiled data, making suggestions for improving searching and clarifying expectations for how to improve their resource choices for a second Grand Rounds session. Comparing the M2 Grand Rounds case to the M1 case of the same cohort, the frequency of evidence summary and diagnostic tool use increased and the frequency of search engine, textbook/lecture material, and journal article/database use decreased.
    Discussion: In the real-world application of back-to-back Georgetown University's Medical Center Grand Rounds exercises, librarian-led instruction on clinical-specific resources appears to be correlated with an improvement in medical students' searching behavior. This trend supports the argument that introducing students early to librarian-led education on clinical-specific resources, and providing feedback on their searches, improves students' information-seeking behavior.
    Keywords:  Medical students; information literacy; information seeking; searching behavior; self-directed learning
    DOI:  https://doi.org/10.5195/jmla.2023.1771
  7. J Med Libr Assoc. 2023 Oct 02. 111(4): 774-782
      Objective: Systematic reviews and other evidence synthesis projects require systematic search methods. Search systems require several essential attributes to support systematic searching; however, many systems used in evidence synthesis fail to meet one or more of these requirements. I undertook a qualitative study to examine the effects of these limitations on systematic searching and how searchers select information sources for evidence synthesis projects.Methods: Qualitative data were collected from interviews with twelve systematic searchers. Data were analyzed using reflexive thematic analysis.
    Results: I used thematic analysis to identify two key themes relating to search systems: systems shape search processes, and systematic searching occurs within the information market. Many systems required for systematic reviews, in particular sources of unpublished studies, are not designed for systematic searching. Participants described various workarounds for the limitations they encounter in these systems. Economic factors influence searchers' selection of sources to search, as well as the degree to which vendors prioritize these users.
    Conclusion: Interviews with systematic searchers suggest priorities for improving search systems, and barriers to improvement that must be overcome. Vendors must understand the unique requirements of systematic searching and recognize systematic searchers as a distinct group of users. Better interfaces and improved functionality will result in more efficient evidence synthesis.
    Keywords:  Systematic reviews; bibliographic databases; expert searching; information retrieval; librarians; qualitative research; search engine; thematic analysis; usability; user experience
    DOI:  https://doi.org/10.5195/jmla.2023.1647
  8. J Med Libr Assoc. 2023 Oct 02. 111(4): 837-838
      The Faculty Collaboration Database (FCD) is a researcher profiling system that promotes collaboration for the Medical College of Wisconsin and its research partners through the Clinical and Translational Science Institute of Southeast Wisconsin (CTSI). Those institutions include Children's Wisconsin, Froedtert Hospital, Marquette University, Milwaukee School of Engineering, University of Wisconsin Milwaukee, Milwaukee VA Medical Center, and Versiti.
    Keywords:  Academic Research; Biomedical Research; Clinical Research; Curriculum Vitae; Librarian Collaboration
    DOI:  https://doi.org/10.5195/jmla.2023.1622
  9. J Med Libr Assoc. 2023 Oct 02. 111(4): 802-810
      Objective: Many health sciences librarians enter the profession without specific health sciences training. Some LIS programs have health sciences courses or tracks, but health sciences training within an LIS program is only one path to entering health sciences librarianship. To develop a map of pathways into health sciences librarianship, an immersion session at the Medical Library Association conference in 2022 asked health sciences librarians to share how they entered the profession.Methods: The immersion session was structured in three parts: facilitator introductions, small group discussions, and a whole group summary discussion. Guided by questions from the facilitators, small groups discussed what pathways currently exist, how to promote existing pathways, what new pathways should be created, and how to develop and promote pathways that make the profession more equitable, diverse, and inclusive.
    Results: Through in-the-moment thematic analysis of the small group discussions, the following emerged as key pathways: library school education; internships and practica; the Library and Information Science (LIS) pipeline; on-thejob training; mentoring; self-teaching/hands-on learning; and continuing education. Themes of equity, diversity, and inclusion arose throughout the session, especially in the concluding whole group discussion.
    Conclusion: Small group discussions in a conference immersion session showed the value of community building in a profession that has multiple pathways for entrance, highlighting the importance of unearthing hidden knowledge about avenues for exploring and enhancing career pathways. The article seeks to address barriers to entry into the profession and adds to the literature on strengthening the field of health sciences librarianship.
    Keywords:  Career Development; Continuing Education; Diversity and Inclusion in Libraries; Health sciences librarianship; Internships; LIS programs; Library Staffing; Training; mentoring; self-teaching
    DOI:  https://doi.org/10.5195/jmla.2023.1645
  10. J Med Libr Assoc. 2023 Oct 02. 111(4): 792-801
      Objective: The application of structural equation modeling (SEM), a statistical modeling tool for scale construction and development, is becoming increasingly popular in the health sciences librarianship and information science research. This study explores the application of SEM to health science libraries by describing the development and validation of a modified LibQUAL scale within an Iranian health sciences library setting.Methods: A literature search was performed across several information sources to identify candidate items to be included in the primary questionnaire. After translation, linguistic validation, and a pilot study, two cross-sectional studies were performed. SEM modeling framework was used for the assessment of the reliability and validity of the modified LibQUAL scale. The internal consistency of the scale was evaluated by measuring Cronbach's alpha coefficient and composite reliability. Exploratory and confirmatory factor analyses were used for the evaluation of the construct validity of the scale. Smart-PLS software was used for statistical modeling.
    Results: Composite reliability and Cronbach's alpha coefficient for each scale ranged between 0.90 and 0.95, indicating adequate internal consistency with the LibQUAL scale. Confirmatory factor analysis confirmed the three-factor model of the LibQUAL scale. The convergent validity of the scale was supported, as the average variances extracted for all proposed factors were above 0.50. The discriminant validity was also confirmed using Fornel and Larcker and Heterotrait-Monotrait Ratio (HTMT) methods.
    Conclusion: Evaluation of psychometric properties of the translated and locally modified LibQUAL in the Persian language indicated adequate reliability, factorial validity, and stability of this instrument for Iranian health sciences libraries.
    Keywords:  Consumer services; Health sciences libraries; Instrument validity and reliability; LibQUAL; Psychometric evaluation; Quality; Scale development
    DOI:  https://doi.org/10.5195/jmla.2023.1348
  11. J Gen Intern Med. 2023 Nov 08.
      BACKGROUND: Most health information does not meet the health literacy needs of our communities. Writing health information in plain language is time-consuming but the release of tools like ChatGPT may make it easier to produce reliable plain language health information.OBJECTIVE: To investigate the capacity for ChatGPT to produce plain language versions of health texts.
    DESIGN: Observational study of 26 health texts from reputable websites.
    METHODS: ChatGPT was prompted to 'rewrite the text for people with low literacy'. Researchers captured three revised versions of each original text.
    MAIN MEASURES: Objective health literacy assessment, including Simple Measure of Gobbledygook (SMOG), proportion of the text that contains complex language (%), number of instances of passive voice and subjective ratings of key messages retained (%).
    KEY RESULTS: On average, original texts were written at grade 12.8 (SD = 2.2) and revised to grade 11.0 (SD = 1.2), p < 0.001. Original texts were on average 22.8% complex (SD = 7.5%) compared to 14.4% (SD = 5.6%) in revised texts, p < 0.001. Original texts had on average 4.7 instances (SD = 3.2) of passive text compared to 1.7 (SD = 1.2) in revised texts, p < 0.001. On average 80% of key messages were retained (SD = 15.0). The more complex original texts showed more improvements than less complex original texts. For example, when original texts were ≥ grade 13, revised versions improved by an average 3.3 grades (SD = 2.2), p < 0.001. Simpler original texts (< grade 11) improved by an average 0.5 grades (SD = 1.4), p < 0.001.
    CONCLUSIONS: This study used multiple objective assessments of health literacy to demonstrate that ChatGPT can simplify health information while retaining most key messages. However, the revised texts typically did not meet health literacy targets for grade reading score, and improvements were marginal for texts that were already relatively simple.
    Keywords:  ChatGPT; health communication; health literacy; patient education
    DOI:  https://doi.org/10.1007/s11606-023-08469-w
  12. J Med Libr Assoc. 2023 Oct 02. 111(4): 831-832
      Spanish speaking healthcare providers, JUNTOS Center for Advancing Latino Health, and a medical librarian partnered to create a podcast on essential health topics relevant to the Latinx community. The podcasts were recorded in Spanish and included Spanish supplementary consumer health information from credible resources such as MedlinePlus en Espanol. The podcasts covered important topics about COVID-19 such as vaccines, clinical trials, and social distancing. It also includes other relevant topics that are affecting the Latinx community.
    Keywords:  COVID-19; Collaboration; Consumer Health; Latinx; Outreach; Spanish; community engagement; podcast
    DOI:  https://doi.org/10.5195/jmla.2023.1653
  13. J Pediatr Hematol Oncol Nurs. 2023 Nov 05. 27527530231190370
      Background: Online healthcare information is often used by pediatric oncology nurse educators in low- and middle-income countries (LMICs) for teaching clinical nurses as part of their initial orientation or continuing education. Access to peer-reviewed nursing journals via paid subscriptions or sub-specialty nursing textbooks in these settings is rare. This project identified and evaluated websites appropriate for pediatric oncology nurse educators in LMICs for teaching staff nurses, and for clinical staff nurses engaging in self-directed learning. Method: A strategic Google search for childhood cancer websites and an appropriate scoring tool was conducted. The Currency, Relevance, Authority, Accuracy, and Purpose Test, along with a previously published scoring rubric that was further adapted by the authors for pediatric oncology were used. Pediatric content, language options, and reading levels were appraised. Results: Of 86 identified websites, 51 met the inclusion criteria for evaluation. Websites were classified as highly recommended (n = 36), recommended (n = 12), or not recommended (n = 3) based on scores (range 14-30; maximum possible score = 30). Half offered content in multiple languages. Most websites were 9-10th-grade reading level. Discussion: Childhood cancer information appropriate for clinical nurse orientation and self-directed learning by LMIC nurses is available on free websites. Some information (diagnosis, chemotherapy, psychosocial support) is repeated across websites, while some is lacking (pediatric cancer genetics and health equity disparities). Reading levels are higher than recommended for health literacy. The reviewed websites were rarely peer-reviewed, inconsistently updated, and generally self-regulated. However, 48 websites on childhood cancer were deemed appropriate pediatric oncology clinical nursing education resources.
    Keywords:  childhood cancer; education; internet; nursing; pediatric oncology
    DOI:  https://doi.org/10.1177/27527530231190370
  14. Cleft Palate Craniofac J. 2023 Nov 05. 10556656231213170
      OBJECTIVES: Evaluate the readability of online English and Spanish cleft lip and palate patient education materials.DESIGN: Review of free online materials.
    SETTING: English and Spanish language online patient education materials on cleft lip and palate were collected from American Cleft Palate-Craniofacial Association (ACPA) approved teams.
    PARTICIPANTS: American Cleft Palate-Craniofacial Association (ACPA) approved teams.
    INTERVENTIONS: English materials were analyzed using the Flesch-Kincaid, SMOG, and Coleman-Liau readability calculators. Spanish materials were analyzed using the Fry Graph, Fernandez Huerta, and INFLESZ calculators. A one-way analysis of variance (ANOVA) was used to test for variability between the readability tools.
    OUTCOMES: Readability levels were examined for both sets of materials.
    RESULTS: 171 (90.5%) teams provided English language materials online, with an average readability score calculated as 10.5 ± 2.9 (10th-11th grade). A total of 44 (23.2%) teams listed Spanish language materials online, with average readability score of 7.9 ± 1.2 (8th grade). ANOVA demonstrated statistically significant variability between the readability assessment tools (P < .01).
    CONCLUSION: Online cleft lip and palate patient education material provided by ACPA craniofacial teams were more available in English than in Spanish. Both sets of materials demonstrated readability levels above the recommended 6th-7th grade. Refining readability is associated with lowered healthcare costs and increased patient satisfaction.
    Keywords:  cleft lip; cleft lip and palate; cleft palate; craniofacial surgery; patient satisfaction
    DOI:  https://doi.org/10.1177/10556656231213170
  15. J Med Libr Assoc. 2023 Oct 02. 111(4): 783-791
      Objective: To evaluate tertiary drug information databases in terms of scope, consistency of content, and completeness of COVID-19 drug information.Methods: Five electronic drug information databases: Clinical Pharmacology, Lexi-Drugs, AHFS DI (American Hospital Formulary Service Drug Information), eFacts and Comparisons, and Micromedex In-Depth Answers, were evaluated in this cross-sectional evaluation study, with data gathered from October 2021 through February 2022. Two study investigators independently extracted data (parallel extraction) from each resource. Descriptive statistics were primarily used to evaluate scope (i.e., whether the resource addresses use of the medication for treatment or prevention of COVID-19) and completeness of content (i.e., whether full information is provided related to the use of the medication for treatment or prevention of COVID-19) based on a 10-point scale. To analyze consistency among resources for scope, the Fleiss multi-rater kappa was used. To analyze consistency among resources for type of recommendation (i.e., in favor, insufficient evidence, against), a two-way mixed effects intraclass coefficient was calculated.
    Results: A total of 46 drug monographs, including 3 vaccination monographs, were evaluated. Use of the agents for treatment of COVID-19 was most frequently addressed in Lexi-Drugs (73.9%), followed by eFacts and Comparisons (71.7%), and Micromedex (54.3%). The highest overall median completeness score was held by AHFS DI followed by Micromedex, and Clinical Pharmacology. There was moderate consistency in terms of scope (kappa 0.490, 95% CI 0.399-0.581, p<0.001) and recommendations (intraclass correlation coefficient 0.518, 95% CI 0.385-0.651, p<0.001).
    Conclusion: Scope and completeness results varied by resource, with moderate consistency of content among resources.
    Keywords:  COVID-19; Drug Information; Tertiary Databases
    DOI:  https://doi.org/10.5195/jmla.2023.1662
  16. Integr Med Res. 2023 Dec;12(4): 100996
      Background: Patients are increasingly utilizing the internet to learn about dietary and herbal supplements (DHSs) for various diseases/conditions, including pain management. Online health information has been found to be inconsistent and of poor quality in prior studies, which may have detrimental effects on patient health. This study assessed the quality of online DHSs consumer health information for pain.Methods: Six search items related to DHSs and pain were used to generate the first 20 websites on Google across four English-speaking countries. The identified 480 webpages produced 68 eligible websites, which were then evaluated using the DISCERN tool. The mean scores and standard deviations (SD) of the reviewers' ratings on each of the 15 DISCERN instrument items as well as the overall total score were calculated.
    Results: The mean summed score for the 68 eligible websites was 46.6 (SD = 10.1), and the mean overall rating was 3.3 (SD = 0.8). Websites lacked information regarding areas of uncertainty, the effects of no treatment being used, and how treatments affect the overall quality of life. These shortcomings were especially apparent across commercial websites, which frequently displayed bias, failed to report the risks of DHS products, and lacked support for shared decision-making regarding the use of DHSs.
    Conclusion: Variability exists in the quality of online consumer health information regarding DHS use for pain. Healthcare providers should be aware of and provide guidance to patients regarding the identification of reliable online resources so that they can make informed decisions about DHS use for pain management.
    Keywords:  Consumer health information; Dietary and herbal supplements; Information assessment; Pain; Quality of information
    DOI:  https://doi.org/10.1016/j.imr.2023.100996
  17. Cureus. 2023 Nov;15(11): e48333
      Background Endodontic microsurgery (apicectomy) can be considered in cases of persistent infection that is resistant to conventional root canal treatment. The aim of this study was to evaluate the quality and readability of the available online information regarding the apicectomy procedure in Arabic. Methods Online search on the three most commonly used websites (Google, Yahoo, and Bing) using one keyword. The first 100 websites from each search were analyzed for quality and readability using DISCERN instrument scores, the Journal of the American Medical Association (JAMA) benchmarks, the Health On the Net (HON) seal, Flesch Reading Ease Scores (FRES), Flesch-Kincaid Grade Level (FKGL), and the Simplified Measure of Gobbledygook (SMOG) Index. Results Searching using the Arabic translation for "root end resection surgery" revealed 349,900 websites. Following the inclusion criteria, 31 websites were selected and evaluated in this study. The selected websites belonged to either non-profit organizations or commercial websites. The quality of most of the selected websites received a moderate score (83.9%) using the DISCERN tool. None of the selected websites obtained the HON seal. Quality evaluation using the JAMA benchmarks revealed that currency was the most achieved item (45.2%), followed by authorship (22.6%). Evaluation of the readability of the selected websites using the FRES, FKGL, and SMOG showed that the included websites were considered readable. Conclusion Although the included websites were readable, the quality of the websites was moderate. There is an urgent need to create more trustworthy and readable websites explaining the different endodontic treatments.
    Keywords:  apical surgery; apicoectomy; discern tool; endodontic micro-surgery; endodontic surgery; fkgl; readability
    DOI:  https://doi.org/10.7759/cureus.48333
  18. Cureus. 2023 Oct;15(10): e46599
      PURPOSE: The purpose of this study is to evaluate the quality of patient education materials accessible through popular online search engines regarding anterior cruciate ligament (ACL) injuries and anterior cruciate ligament reconstruction (ACLR).  Methods: Two search terms ("ACL surgery" and "ACL reconstruction") were entered into three search engines (Google, Yahoo, and Bing). The quality of information was scored using a novel scoring system developed and overseen by sports medicine orthopedic clinical research fellows and fellowship-trained orthopedic surgeons. Website quality, credibility, and readability were further assessed by the DISCERN score, Journal of the American Medical Association (JAMA) benchmark criteria, and Flesch-Kincaid Reading Grade Level (FKRGL), respectively. The Health On the Net Code of Conduct (HONcode) certification was also utilized to assess the transparency of health information for each website.RESULTS: We evaluated 39 websites. The average score for all websites was 11.2±5.6 out of 28 total points. Six out of the 39 websites (41%) were HONcode certified. The websites that contained HONcode certification had a higher average JAMA benchmark score (3.5±0.7) and DISCERN score (44.6±14.7) when compared to the websites without the certification, 2.2±1.2 and 37.6 ± 15.9 for JAMA and DISCERN, respectively. The mean JAMA benchmark score was 2.7±1.2 (67.5%) for all websites out of a possible four points. The average FKRGL for all 39 websites was 10.0±2.0 (range: 5.4-13).
    CONCLUSION: The quality of patient education materials accessible on the internet regarding ACL injuries and ACLR can be misleading and directly impact the patient's decision-making process essential to the patient-physician relationship over the past decade.
    CLINICAL RELEVANCE: The internet can be a helpful online resource, however, surgeon clarification and consultation with qualified healthcare professionals are strongly recommended prior to clinical decision-making regarding potential treatment options.
    Keywords:  acl tear; anterior cruciate ligament (acl); anterior cruciate ligament (acl) reconstruction; ortho surgery; orthopedic sports medicine
    DOI:  https://doi.org/10.7759/cureus.46599
  19. Urol Res Pract. 2023 Nov 07.
      OBJECTIVE: The internet and social media have become primary sources of health information, with men frequently turning to these platforms before seeking professional help. Chat generative pretrained transformer (ChatGPT), an artificial intelligence model developed by OpenAI, has gained popularity as a natural language processing program. The present study evaluated the accuracy and reproducibility of ChatGPT's responses to andrology-related questions.METHODS: The study analyzed frequently asked andrology questions from health forums, hospital websites, and social media platforms like YouTube and Instagram. Questions were categorized into topics like male hypogonadism, erectile dysfunction, etc. The European Association of Urology (EAU) guideline recommendations were also included. These questions were input into ChatGPT, and responses were evaluated by 3 experienced urologists who scored them on a scale of 1 to 4.
    RESULTS: Out of 136 evaluated questions, 108 met the criteria. Of these, 87.9% received correct and adequate answers, 9.3% were correct but insufficient, and 3 responses contained both correct and incorrect information. No question was answered completely wrong. The highest correct answer rates were for disorders of ejaculation, penile curvature, and male hypogonadism. The EAU guideline-based questions achieved a correctness rate of 86.3%. The reproducibility of the answers was over 90%.
    CONCLUSION: The study found that ChatGPT provided accurate and reliable answers to over 80% of andrology-related questions. While limitations exist, such as potential outdated data and inability to understand emotional aspects, ChatGPT's potential in the health-care sector is promising. Collaborating with health-care professionals during artificial intelligence model development could enhance its reliability.
    DOI:  https://doi.org/10.5152/tud.2023.23171
  20. J Plast Reconstr Aesthet Surg. 2023 Oct 20. pii: S1748-6815(23)00642-3. [Epub ahead of print]87 390-402
      Appropriate patient education and preparation prior to surgery represent a fundamental step in managing expectations, avoiding unnecessary encounters and eventually achieving optimal outcomes. Thus, the objective of this study is to evaluate ChatGPT's potential as a viable source for patient education by comparing its responses and provided references to frequently asked questions on body contouring, with Google's. A Google search was conducted on July 15th, 2023, using the search term "body contouring surgery". The first 15 questions under the "People also ask" section and answers provided by Google were recorded. The 15 questions were then asked to ChatGPT-3.5. Four plastic surgeons evaluated the answers from 1 to 5 according to the Global Quality Scale. The mean score for responses given by Google was 2.55 ± 1.29, indicating poor quality but some information present, of very limited use to patients. The mean score for responses produced by ChatGPT was 4.38 ± 0.67, suggesting that the content was of good quality, useful to patients, and encompassed the most important topics. The difference was statistically significant (p = 0.001). Deficiencies in providing references represent one of the most evident weaknesses of ChatGPT. However, ChatGPT did not appear to spread misinformation, and the content of the generated responses was deemed of good quality and useful to patients. The integration of AI technology as a source for patient education has the potential to optimize patient queries on body contouring questions.
    Keywords:  Artificial intelligence; Body contouring; ChatGPT; Large language model; Patient education
    DOI:  https://doi.org/10.1016/j.bjps.2023.10.091
  21. Cureus. 2023 Oct;15(10): e46662
      Background and objective The field of artificial intelligence (AI) is advancing at a rapid pace, impacting all aspects of human life. Chat Generative Pre-trained Transformer (ChatGPT), which represents one of AI's most recent and remarkable achievements, has garnered significant attention and popularity in the academic community. ChatGPT, a language model-based chatbot developed by OpenAI, responds quickly and provides answers to the questions put to it. This chatbot has the ability to gather content from a variety of sources on the internet. However, its success in providing correct information has not yet been comprehensively analyzed. In light of this, this study aimed to engage in a comparative content analysis of health-related information provided by ChatGPT and a few selected websites. Methods We performed a qualitative analysis of data obtained from various information sources by using the DISCERN score and the Journal of the American Medical Association (JAMA) benchmark criteria. In addition, readability levels of the content were measured by using the Flesch-Kincaid grade level, Gunning Fog Index, and Simple Measure of Gobbledygook (SMOG) index. Results Based on our findings, there was no statistically significant difference between the websites and ChatGPT in DISCERN scores. However, the JAMA score was statistically significantly higher for websites. With regard to the Flesch-Kincaid grade level, Gunning Fog Index, and SMOG index values, the data obtained from the websites had higher readability. Conclusion Although AI is starting to play a significant role in our everyday lives, it has yet to surpass traditional methods of accessing information in terms of readability and reliability.
    Keywords:  chatgpt; discern; health information; jama; website
    DOI:  https://doi.org/10.7759/cureus.46662
  22. Can Urol Assoc J. 2023 Oct 23.
      INTRODUCTION: Prostate cancer ranks as the third leading cause of death among Canadian men, and is primarily treated with radiotherapy and prostatectomy. Given YouTube's significant global traffic, patients often turn to it for information on treatment and side effects. This study assessed YouTube videos for prostate cancer patients, focusing on radiotherapy, prostatectomy, and side effect management.METHODS: The study analyzed 50 YouTube videos, comparing their accuracy and coverage against the National Comprehensive Cancer Network (NCCN), UpToDate, and cancer.ca. Two raters were involved in the review of the videos to ensure inter-rater reliability.
    RESULTS: Video lengths ranged from 1-60 minutes (mean 11 minutes), and creation dates ranged from 2012-2021. Videos were presented by physicians, patients, or allied health professionals (75%, 16%, and 8%, respectively). Results showed physician presenters had a Video Power Index (video popularity) of 23.45, while patient presenters had an average of 61.36 (almost three times as popular as physician-led videos). The overall accuracy of videos showed that 82% demonstrated completely accurate and detailed information, 18% showed partially complete information, and 76% showed no biased information. No false information was found in any videos.
    CONCLUSIONS: This study showed that while the YouTube informational videos included good coverage of treatment side effects, there were gaps in information regarding quality of life after treatment or management of side effects. Information from this study can benefit the provider-patient interaction, with the hope that healthcare providers create more videos on quality of life after treatment and management of side effects to satisfy patient needs.
    DOI:  https://doi.org/10.5489/cuaj.8523
  23. Eur Oral Res. 2023 Sep 06. 57(3): 138-143
      Purpose: The aim of this study was to evaluate YouTube videos as a source of information for digital indirect bonding techniques.Materials and methods: The keyword "digital indirect bonding" was first searched on YouTube, resulting in 57 recorded videos. Descriptive parameters, including source, target audience, purpose, duration, upload date, number of likes, dislikes, views, and comments, were then evaluated. After this initial assessment, the interaction index and viewing rate were calculated. Video content quality was determined using a 5-point scale that categorized videos as having poor, moderate, or good content quality. This rating was based on the presence and discussion of various topics related to digital indirect bonding, including digital scan, digital bracket placement, transfer tray production from a 3D-printed model or direct production as a 3D-printed tray, clinical application, and advantages and/or disadvantages. The videos were assessed for quality using the global quality scale (GQS) and video information and quality index (VIQI). Statistical evaluation was conducted using Kruskal-Wallis, Chi-square, and Pearson correlation analysis, and intraclass correlation coefficients were calculated to determine the rating reliability.
    Results: The majority of the videos were classified as having poor content quality (41.9%), followed by moderate (38.7%) and good (19.4%) content quality. No significant differences were found between the videos in terms of descriptive parameters. However, videos with good content quality had significantly higher GQS and VIQI scores than moderate and poor content videos. The total content showed significant correlations with GQS and VIQI (r=0.780 and r=0.446, respectively; plt;0.05).
    Conclusion: In conclusion, while the majority of YouTube videos regarding digital indirect bonding were of poor content quality, those that were of good content quality could be considered a useful source of professional information.
    Keywords:  Digital; YouTube; indirect bonding; information; video
    DOI:  https://doi.org/10.26650/eor.20231152882
  24. Dental Press J Orthod. 2023 ;pii: S2176-94512023000500303. [Epub ahead of print]28(5): e232386
      INTRODUCTION: With the abundant use of the internet, patients undergoing or interested in orthodontic treatment try to use it to obtain information on pain during treatment. However, YouTube™ is unregulated and may potentially contain inaccurate information.OBJECTIVES: Thus, this study aimed to evaluate the scientific quality of the videos on YouTube™ related to orthodontic pain management.
    METHODS: A total of 62 videos related to orthodontic pain management were included in the study. All videos were evaluated by two experienced orthodontists. The video uploader, content, length, upload date, time since upload, number of views, comments, likes, dislikes, Interaction index, and Viewing rate of the videos were recorded and evaluated. The videos were scored using the Quality Criteria for Consumer Health Information (DISCERN), Global Quality Scale (GQS), and Audio-Visual Quality (AVQ), and divided into two groups: Doctors and Non-doctors.
    RESULTS: The mean DISCERN score was 2.56 ± 0.91, the GQS score was 2.56 ± 1.06, and AVQ was 2.48 ± 0.68. A statistically significant difference was found in DISCERN score of videos uploaded by Doctors compared to Non-doctors, but no statistically significant difference was found in GQS and AVQ scores between both groups (p> 0.05).
    CONCLUSIONS: The videos uploaded by Doctors were better in terms of quality and reliability, as compared to Non-doctors; and the AVQ of the videos uploaded by both groups was adequate. Despite that, both groups did not serve as a good source of information. YouTube™ cannot be considered a reliable source of information in terms of quality and reliability on videos related to orthodontic pain management.
    DOI:  https://doi.org/10.1590/2177-6709.28.5.e232386.oar
  25. J Plast Reconstr Aesthet Surg. 2023 Oct 15. pii: S1748-6815(23)00600-9. [Epub ahead of print]87 449-460
      BACKGROUND: The transgender patient population is expanding, and gender affirming surgery (GAS) volume is increasing. Accurate, comprehensive, and easily navigable resources on GAS are lacking. We aim to evaluate the readability of online materials for specific gender affirming surgical procedures to identify mechanisms of improving information access for transgender patients.MATERIALS AND METHODS: "Facial feminization", "facial masculinization", "MTF breast augmentation", "FTM chest masculinization", "MTF vaginoplasty", "metoidioplasty", and "FTM phalloplasty" were searched on Google. Per keyword, the first 75 text-containing results were included. Text was analyzed for reading difficulty using the Flesch-Kincaid Reading-Ease (FKRE) test and grade level using the Flesch-Kincaid Grade Level (FKGL) formula, Gunning Fog Index (GFI), Simple Measure of Gobbledygook (SMOG), and Coleman-Liau Index (CLI). Scores were compared using independent t-and ANOVA tests (α = 0.05).
    RESULTS: Mean readability scores (FKRE 37.44) and grade-levels (FKGL 12.87, GFI 15.61, SMOG 11.91, CLI 15.00) correlated with college-level difficulty. Masculinizing surgical materials were more difficult to read than feminizing ones (p ≤ 0.023). Top surgery materials were easier to read than facial and genital surgery materials (p ≤ 0.013). Specifically, chest masculinization resources were more difficult to read than those for breast augmentation (p ≤ 0.006). No differences were found between facial feminization and masculinization surgery resources, nor between resources for different gender affirming genital surgeries.
    CONCLUSION: Online GAS materials are written above the recommended 6th grade reading-level, with resources for transgender men being significantly more challenging to understand. Improving readability of online resources can help overcome barriers to care for the transgender patient population.
    Keywords:  Gender; Gender affirming surgery; Health literacy; Internet; Plastic surgery; Transgender
    DOI:  https://doi.org/10.1016/j.bjps.2023.10.067
  26. J Cogn Neurosci. 2023 Nov 15. 1-14
      Most prior research characterizes information-seeking behaviors as serving utilitarian purposes, such as whether the obtained information can help solve practical problems. However, information-seeking behaviors are sensitive to different contexts (i.e., threat vs. curiosity), despite having equivalent utility. Furthermore, these search behaviors can be modulated by individuals' life history and personality traits. Yet the emphasis on utilitarian utility has precluded the development of a unified model, which explains when and how individuals actively seek information. To account for this variability and flexibility, we propose a unified information-seeking framework, which examines information-seeking through the lens of motivation. This unified model accounts for integration across individuals' internal goal states and the salient features of the environment to influence information-seeking behavior. We propose that information-seeking is determined by motivation for information, invigorated either by instrumental utility or hedonic utility, wherein one's personal or environmental context moderates this relationship. Furthermore, we speculate that the final common denominator in guiding information-seeking is the engagement of different neuromodulatory circuits centered on dopaminergic and noradrenergic tone. Our framework provides a unified framework for information-seeking behaviors and generates several testable predictions for future studies.
    DOI:  https://doi.org/10.1162/jocn_a_02083
  27. Health Promot Int. 2023 Dec 01. pii: daad143. [Epub ahead of print]38(6):
      Online health information-seeking behaviour has increased since the World Health Organization declared COVID-19 a global pandemic in March 2020. This study examined whether health-related information on COVID-19 searched on the internet was associated with mental well-being among higher education students. A cross-sectional internet survey was conducted among 18- to 34-year-old students in Finland (N = 2976; mean age 24.61 years and median 24) in the spring of 2020. The data were analysed using descriptive statistics, Pearson's chi-square tests, Kruskal-Wallis nonparametric H tests, and a two-way ANOVA. The results indicated that most students (86% of females, 82% of males) used the internet to search for information on COVID-19. Students' self-perceived abilities to determine the relevance of online information on COVID-19 were associated with mental well-being.
    Keywords:  COVID-19; higher education student; internet; mental well-being; online health information-seeking
    DOI:  https://doi.org/10.1093/heapro/daad143
  28. Malays J Med Sci. 2023 Oct;30(5): 181-191
      Background: The unique nature of adolescence makes youths highly susceptible to high-risk behaviours. Thus, prevention and health promotion are imperative for this influential age. Despite various approaches towards health promotion, knowledge related to adolescent health is still low among Malaysian adolescents. This study aims to investigate adolescent health information-seeking behaviours related to high-risk behaviours.Methods: A cross-sectional study was conducted among 370 adolescents aged 10 years old-19 years old throughout Malaysia. The questionnaire used was adapted from a previous study and the pilot study resulted in Cronbach's alpha of 0.85. IBM SPSS Statistics version 25.0 software was used for data analysis at two statistical levels: descriptive and inferential (Mann-Whitney U test).
    Result: The most important health information needs related to high-risk behaviour according to the adolescents were 'violence' (3.72 score out of 5), 'sexual activity-related disease' (3.64 score out of 5) and 'physical activity and effect of lack in physical activity' (3.61 score out of 5). 'Physician' (4.01 score out of 5) and 'the internet' (3.95 score out of 5) were the most important sources for obtaining health information related to high-risk behaviours. The main criterion for the quality of health information was the 'validity and reliability of the information' (4.55 score out of 5). The findings indicate that adolescents have a positive attitude towards health information-seeking behaviour, although slight differences between boys and girls are exhibited. The most common barrier to health information seeking experienced by adolescents is 'difficulty in determining the quality of information found'.
    Conclusion: Adolescents tend to use professional and informal sources, have good criteria in the selection of information and have a considerably high interest in seeking health information related to high-risk behaviour.
    Keywords:  adolescents; health information; health information-seeking behaviour; high-risk behaviour; information seeking behaviour
    DOI:  https://doi.org/10.21315/mjms2023.30.5.15
  29. J Med Libr Assoc. 2023 Oct 02. 111(4): 762-773
      Objective: LGBTQ+ health research guides can strengthen the LGBTQ+ community through connecting people to quality health services and information, and previous studies have recommended that health sciences libraries create and maintain these guides. Little evidence exists, though, on how these guides are used and how well they meet the needs of LGBTQ+ users. Using retrospective data retrieved from multiple LGBTQ+ health research guides, we examined the categories of LGBTQ+ health information most used, as well as how often guides were accessed. Based on these results, we hope to find patterns which can lead to best practices for libraries.Methods: Five North American academic health sciences libraries contributed select usage data from their LGBTQ+ health research guides, covering a three-year period (July 2018-June 2021). Data was analyzed in two ways. Firstly, the 20 most-clicked resources from each guide were categorized through open coding, to assess if certain information resource categories were more popular among guide users, allowing for inference of user needs. A time-series analysis was also conducted for two sites, using the Classical Seasonal Decomposition by Moving Averages method, to provide deeper insights into the data.
    Results: Open coding data showed consumer health information resources were used more often than other health resource categories. Resources from more locally based organizations and those with provider and services information were heavily used, indicating that users may be looking for information connecting to local health services and providers. The time series analysis allowed the potential positive effect of guide promotion to be showcased in ways that would not have been clear from the raw data.
    Conclusion: This study shows that people are accessing LGBTQ+ consumer health information through academic library research guides, with a preference for local information. Guide usage appears to be positively driven by outreach within one's institution and to the greater community. Locating external partners may increase guide impact and provide important links to local resources and services.
    Keywords:  LGBTQ+; consumer health; health disparities; health information; health sciences libraries; libguides; outreach; research guides
    DOI:  https://doi.org/10.5195/jmla.2023.1661
  30. Integr Med Res. 2023 Dec;12(4): 100978
      The definition of complementary, alternative, and integrative medicine (CAIM) remains dynamic and complex despite a steady increase in the popularity/usage of CAIM therapies across the globe. A lack of consistency in how these terms are defined remains a challenge for researchers, clinicians, and national and international organizations (e.g., World Health Organization, National Center for Complementary and Integrative Health) alike. In the present article, we provide a brief history of the use of these terminologies, and then outline the process we took to develop and create an operational definition of complementary, alternative, and integrative medicine. Our operational definition is the first to be informed by a systematic search of four quality-assessed information resource types, ultimately yielding 604 unique CAIM therapies. We then developed a single search string for the most common bibliographic databases using the finalized operational definition list of CAIM therapies. These CAIM therapies were searched against the Therapeutic Research Center's "Natural Medicines" database for all 604 therapies, whereby each item's scientific name and/or synonym was included as a keyword or phrase in the search string. While the current definition is not without limitations and ongoing debates still surround the field, this work is arguably a steppingstone towards enabling increased collaboration and communication amongst healthcare clinicians, researchers, and the public. This operational definition provides a foundation for developing well-coordinated research efforts that will assist in the acceptance and understanding of this field, while also focusing on adopting knowledge translation techniques and efforts for further research advancement and use.
    Keywords:  Bibliographic database; Complementary and alternative medicine; Integrative medicine; Operational definition; Standard of classification
    DOI:  https://doi.org/10.1016/j.imr.2023.100978
  31. J Med Libr Assoc. 2023 Oct 02. 111(4): 819-822
      Background: Few resources exist to support finding journals that accept case reports by specialty. In 2016, Katherine Akers compiled a list of 160 journals that accepted case reports, which many librarians continue to use 7 years later. Because journals' editorial policies and submission guidelines evolve, finding publication venues for case reports poses a dynamic problem, consisting of reviewing a journal's author guidelines to determine if the journal accepts case report manuscripts. This project aimed to create a more up to date and extensive list of journals that currently accept case reports.Case Presentation: 1,874 journal titles were downloaded from PubMed. The team reviewed each journal and identified journal titles that accept case reports. Additional inclusion factors included being indexed in MEDLINE, accessible on the internet, and accepting and publishing English language submissions.
    Discussion: The new journal list includes 1,028 journals covering 129 specialties and is available on the Open Science Framework public page.
    Keywords:  Case Reports; Journals; Publishing
    DOI:  https://doi.org/10.5195/jmla.2023.1747
  32. J Med Libr Assoc. 2023 Oct 02. 111(4): 833-834
      In 2020 - 2021 the Robert B. Greenblatt, M.D. Library at Augusta University implemented two projects leveraging virtual reality (VR) technology to provide immersive experiential learning opportunities for health sciences students. The projects shared some commonalities in spite of having differing objectives and desired outcomes. These common facets led to the success of both projects and will be helpful for other institutions considering implementing VR projects.
    Keywords:  Virtual reality; gamification; health sciences library; technology in curriculum
    DOI:  https://doi.org/10.5195/jmla.2023.1632
  33. Bioinformatics. 2023 Nov 01. pii: btad651. [Epub ahead of print]39(11):
      MOTIVATION: Information retrieval (IR) is essential in biomedical knowledge acquisition and clinical decision support. While recent progress has shown that language model encoders perform better semantic retrieval, training such models requires abundant query-article annotations that are difficult to obtain in biomedicine. As a result, most biomedical IR systems only conduct lexical matching. In response, we introduce MedCPT, a first-of-its-kind Contrastively Pre-trained Transformer model for zero-shot semantic IR in biomedicine.RESULTS: To train MedCPT, we collected an unprecedented scale of 255 million user click logs from PubMed. With such data, we use contrastive learning to train a pair of closely integrated retriever and re-ranker. Experimental results show that MedCPT sets new state-of-the-art performance on six biomedical IR tasks, outperforming various baselines including much larger models, such as GPT-3-sized cpt-text-XL. In addition, MedCPT also generates better biomedical article and sentence representations for semantic evaluations. As such, MedCPT can be readily applied to various real-world biomedical IR tasks.
    AVAILABILITY AND IMPLEMENTATION: The MedCPT code and model are available at https://github.com/ncbi/MedCPT.
    DOI:  https://doi.org/10.1093/bioinformatics/btad651
  34. J Med Libr Assoc. 2023 Oct 02. 111(4): 854-857
      ActivePresenter v9. Atomi Systems, Inc, Headquarters: No 281, Group 1, Phu Dien ward, North Tu Liem, Ha-noi, Vietnam; support@atomisystems.com; https://atomisystems.com/download/; $0 - $399 depending on license selected. Technical requirements: Operating Systems: Windows 8.1, Windows 10, Windows 11 (only 64-bit is supported), macOS 10.15, macOS 11, macOS 12; Hardware: 2 GHz or faster processor with SSE2; greater than 4 GB of RAM; 4 GB of available hard-disk space for installation; microphone.
    DOI:  https://doi.org/10.5195/jmla.2023.1731
  35. J Med Libr Assoc. 2023 Oct 02. 111(4): 852-853
      EndNote 21 desktop version. Released May 2023. Clarivate, 1500 Spring Garden Street, Fourth Floor, Philadelphia, PA 19130; https://endnote.com/; 1-888-418-1937; onetime purchase full license, $274.95, discounts available, contact for institutional pricing. For a list of technical requirements, visit https://endnote.com/product-details/compatibility.
    DOI:  https://doi.org/10.5195/jmla.2023.1803
  36. Health Info Libr J. 2023 Nov 09.
      BACKGROUND: Continual evidence surveillance is an integral feature of living guidelines. The Australian Stroke Guidelines include recommendations on 100 clinical topics and have been 'living' since 2018.OBJECTIVES: To describe the approach for establishing and evaluating an evidence surveillance system for the living Australian Stroke Guidelines.
    METHODS: We developed a pragmatic surveillance system based on an analysis of the searches for the 2017 Stroke Guidelines and evaluated its reliability by assessing the potential impact on guideline recommendations. Search retrieval and screening workload are monitored monthly, together with the frequency of changes to the guideline recommendations.
    RESULTS: Evidence surveillance was guided by practical considerations of efficiency and sustainability. A single PubMed search covering all guideline topics, limited to systematic reviews and randomised trials, is run monthly. The search retrieves about 400 records a month of which a sixth are triaged to the guideline panels for further consideration. Evaluations with Epistemonikos and the Cochrane Stroke Trials Register demonstrated the robustness of adopting this more restrictive approach. Collaborating with the guideline team in designing, implementing and evaluating the surveillance is essential for optimising the approach.
    CONCLUSION: Monthly evidence surveillance for a large living guideline is feasible and sustainable when applying a pragmatic approach.
    Keywords:  Australia; PubMed; clinical guidelines; guideline development; information retrieval; review and systematic search; search strategies
    DOI:  https://doi.org/10.1111/hir.12515
  37. J Med Libr Assoc. 2023 Oct 02. 111(4): 747-749
      With the arrival of ChatGPT, the academic community has expressed concerns about how generative artificial intelligence will be used by students and researchers alike. After consulting policies from other journals and discussing among the editorial team, we have created a policy on the use of AI on submissions to JMLA. This editorial provides a brief background on these concerns and introduces our policy.
    DOI:  https://doi.org/10.5195/jmla.2023.1826
  38. J Med Libr Assoc. 2023 Oct 02. 111(4): E62
      [This corrects the article DOI: 10.5195/jmla.2022.1443.].
    DOI:  https://doi.org/10.5195/jmla.2023.1853