bims-librar Biomed News
on Biomedical librarianship
Issue of 2023–12–31
twelve papers selected by
Thomas Krichel, Open Library Society



  1. J Alzheimers Dis. 2023 Dec 18.
      The quality of information about dementia retrieved using ChatGPT is unknown. Content was evaluated for length, readability, and quality using the QUEST, a validated tool, and compared against online material from three North American organizations. Both sources of information avoided conflicts of interest, supported the patient-physician relationship, and used a balanced tone. Official bodies but not ChatGPT referenced identifiable research and pointed to local resources. Users of ChatGPT are likely to encounter accurate but shallow information about dementia. Recommendations are made for information creators and providers who counsel patients around digital health practices.
    Keywords:  Alzheimer’s disease; artificial intelligence; dementia; health
    DOI:  https://doi.org/10.3233/JAD-230573
  2. Ann Vasc Surg. 2023 Dec 26. pii: S0890-5096(23)00857-9. [Epub ahead of print]
       OBJECTIVE: Online resources are a valuable source of information for patients and have been reported to improve engagement and adherence to medical care. However, readability of online patient educational materials (OPEM) is crucial for them to serve their intended purpose. The American Medical Association (AMA) recommends that OPEM be written at or below the 6th grade reading level. To avoid disparities in access to comprehensible health information on peripheral artery disease (PAD), it is imperative that the readability of PAD OPEM is appropriate for both English- and Spanish-speaking patients. The aim of this study is to evaluate the readability of PAD OPEM in Spanish and compare to English-language OPEM.
    METHODS: We conducted a Google search in English and Spanish using "peripheral arterial disease" and "enfermedad arterial periferica", respectively, and the top 25 patient-accessible articles were collected for each. Articles were categorized by source type: hospital, professional society, or other. Readability of English-language OPEM was measured using the Flesch Reading Ease Readability Formula (FRES), Automated Readability Index, Coleman-Liau Index, Flesch-Kincaid Grade Level, Gunning Fog, Linsear Write Formula, and the Simple Measure of Gobbledygook Index. Readability of Spanish OPEM was measured using the Fernández-Huerta Index and INFLESZ Scale. Readability of the articles was compared to the AMA recommendation, between English- and Spanish-language, and across sources using statistical tests appropriate to the data.
    RESULTS: OPEM from professional societies represented the fewest number of English- (n=7, 28%) and Spanish-language (n=6, 24%) articles. Most English- (n=18, 72%) and Spanish-language (n=20, 80%) OPEM were considered difficult as measured by the FRES and Fernández-Huerta Index, respectively, but did not significantly differ between languages (P=0.59). There were no significant differences in the average readability of all readability measurements across sources (hospital, professional society, or other). All the average readability grade levels for English- and Spanish-language OPEM was significantly higher than the 6th grade reading level (P<0.01). Only three (6%) OPEM met the AMA recommended reading level and there was no significant difference between English- and Spanish-language OPEM (P=1.0).
    CONCLUSIONS: Nearly all Spanish- and English-language PAD OPEM assessed were written at a reading grade level higher than recommended by the AMA. There was no significant difference in the readability of materials from hospitals or professional societies. To prevent further widening of health disparities related to literacy, health content creators, particularly hospitals and professional societies, should prioritize, develop, and ensure that English- and Spanish-language patient education materials are written at a level appropriate for the public.
    Keywords:  Readability; educational materials; online patient education; peripheral artery disease
    DOI:  https://doi.org/10.1016/j.avsg.2023.10.029
  3. Arthrosc Sports Med Rehabil. 2023 Dec;5(6): 100769
       Purpose: To provide an evaluation of the quality of diagnostic and treatment information regarding ulnar collateral ligament injuries on YouTube.
    Methods: YouTube was searched using the terms "ulnar collateral ligament," "Tommy John surgery," and "UCL surgery." The first 100 results for each 3 terms were screened for inclusion. Each included video was graded based on its diagnostic and treatment content and assigned a quality assessment rating. Video characteristics such as duration, views, and "likes" were recorded and compared between video sources and quality assessment ratings.
    Results: A total of 120 videos were included in the final analysis. Only 17.5% provided very useful to excellent quality content. Only 3 videos (2.5%) provided excellent quality content; these were all physician-sponsored videos. These 3 videos only achieved an excellent score for diagnostic content; no video achieved an excellent score for treatment content. Most videos were scored as somewhat useful for both diagnostic (40%) and treatment (56.7%) content. Videos classified as somewhat useful had the highest number of average views (27,197), with a mean duration of 7 minutes 40 seconds. The most common video source was physician sponsored (32%), followed by educational (26%). Physician videos had the lowest number of views (5,842 views).
    Conclusions: The quality of ulnar collateral ligament-related information on YouTube is low. Differential diagnoses for related symptoms, accurate surgical indications, and thorough discussions of adverse outcomes were the most lacking information. Physician-sponsored and educational videos provided the highest-quality information but had the lowest number of average views.
    Clinical Relevance: Because most Internet users in the United States search for information regarding their medical issues online, it is important to understand the quality of available online medical information. Knowing this can help inform the necessary next steps to improve the quality and comprehensibility of online medical information.
    DOI:  https://doi.org/10.1016/j.asmr.2023.100769
  4. Med Ultrason. 2023 Dec 27. 25(4): 398-402
       AIM: This study aims to evaluate the educational quality of videos related to ultrasound guided dry needling (USDN). Material and method: This study was designed as a cross-sectional study. A video-based search was performed on the YouTube online video sharing platform (https://www.youtube.com/) using the English keywords "ultrasound guided dry needling" on May 10, 2023. The first 60 videos were analysed.
    RESULT: The first 60 videos were analyzed, and 32 videos that met the inclusion criteria were included in the study. The content of the videos mostly consisted of technical knowledge regarding Ultrasound Guided Dry Needling (USGDN) (56.3%) and information (43.84%). The total mean DISCERN score was 26.9 ± 12.0 (range 17 to 54). The total mean JAMA Score was 2.4 ± 0.7 (range 2 to 4). There was no significant differences between the groups, according to the DISCERN, and JAMAs scores (all p>0.05). The video with the highest DISCERN score belongedto The American Institute of Ultrasound in Medicine (AIUM) channel.
    CONCLUSION: There is a significant amount of content available on YouTube regarding USDN; however, unfortunately, most of the existing content is of low quality and carries the risk of misinformation. Healthcare professionals should be aware of the importance of health-related information on YouTubeand strive to provide high-quality, accurate, and up-to-date content.
    DOI:  https://doi.org/10.11152/mu-4206
  5. Orthop J Sports Med. 2023 Dec;11(12): 23259671231218668
       Background: Videos relating to rehabilitation exercises for common injuries relevant to younger populations such as anterior cruciate ligament (ACL) tear receive high view counts on social media platforms such as TikTok.
    Purpose/Hypothesis: The purpose of this study was to analyze the quality, reliability, and educational value of TikTok videos among the patient population for ACL injury. It was hypothesized that TikTok videos related to ACL rehabilitation exercises would lack quality, reliability, and educational value.
    Study Design: Cross-sectional study.
    Methods: TikTok was queried for relevant videos using the hashtags "#ACLrehab" and "#ACLexercises." For each included video, the type of uploader (general user or health care professional) was identified. In addition, the number of views, likes, shares, comments, and favorites for each included video was recorded, and the content of each video was graded using the DISCERN (a well-validated informational analysis tool) and the ACL exercise education score (ACLEES - a custom-designed tool for the evaluation of ACL-related exercises).
    Results: A total of 111 videos with 5,520,660 cumulative views were included; the median number of views per video was 9801.0 (interquartile range [IQR], 3583.0-28,000.0). Of these videos, 84 and 27 were created by the general public and health care professionals, respectively. The videos collectively received 335,577 likes, 2969 comments, 22,856 favorites, and 6142 shares, with a median of 439 (IQR, 111-1374), 10 (IQR, 2.5-25.5), 54 (IQR, 18-172.5), and 12 (IQR, 2-36), respectively. The tabulated scores for the DISCERN and ACLEES between general users and health care professionals were all statistically nonsignificant. Health care professionals had a higher percentage of videos with a "very poor" DISCERN score in comparison with the general public (66.67% vs 53.57%, respectively).
    Conclusion: The overall educational value of the TikTok videos related to ACL rehabilitation exercises was very poor. Health care professionals should be aware of the broad distribution of ACL rehabilitation exercise videos that are accessible on TikTok and raise awareness of the deficiencies of the platform as a medium for educational medical-related information.
    Keywords:  ACL; TikTok; educational value; rehabilitation; reliability
    DOI:  https://doi.org/10.1177/23259671231218668
  6. Front Public Health. 2023 ;11 1315393
       Background: Heart failure (HF) is a complex and life-threatening syndrome associated with significant morbidity and mortality. While TikTok has gained popularity as a social media platform for sharing HF-related information, the quality of such content on TikTok remains unexplored.
    Methods: A cross-sectional analysis was conducted on TikTok videos related to HF in China. The sources of the videos were identified and analyzed. The content comprehensiveness of the videos was evaluated using six questions that covered definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The reliability and quality of the videos were assessed using three standardized evaluation instruments: DISCERN, JAMA benchmarks, and the Global Quality Scale. Additionally, the correlation between video quality and video characteristics was further investigated.
    Results: Among the video sources, 92.2% were attributed to health professionals, while news agencies and non-profit organizations accounted for 5.7% and 2.1%, respectively. The content comprehensiveness score for the videos was 3.36 (SD 3.56), with news agencies receiving the highest scores of 4.06 (SD 3.31). The median DISCERN, JAMA, and GQS scores for all 141 videos were 26.50 (IQR 25.00-28.750), 2.00 (IQR 2.00-2.00), and 2.00 (IQR 2.00-2.00), respectively. Videos from health professionals had significantly higher JAMA scores compared to those from non-profit organizations (P < 0.01). Correlation analysis between video quality and video characteristics showed positive correlations between content comprehensiveness scores and video duration (r = 0.420, P < 0.001), number of comments (r = 0.195, P < 0.05), and number of shares (r = 0.174, P < 0.05). GQS scores were negatively or positively correlated with the number of days since upload (r = -0.212, P < 0.05) and video duration (r = 0.442, P < 0.001).
    Conclusion: The overall quality of the videos was found to be unsatisfactory, with variations in quality scores observed across different video sources. Content comprehensiveness was inadequate, the reliability and quality of the information presented in the videos was questionable. As TikTok continues to grow as a platform for health information, it is essential to prioritize accuracy and reliability to enhance patients' self-care abilities and promote public health.
    Keywords:  TikTok; content quality; health education; heart failure; self-care; social media
    DOI:  https://doi.org/10.3389/fpubh.2023.1315393
  7. Digit Health. 2023 Jan-Dec;9:9 20552076231220787
       Background: The internet has become the primary source of health-related information, and online health information-seeking behaviour has been used as a reliable surrogate of public awareness. We studied the trends of search interest in polycystic ovary syndrome over time and whether funding for polycystic ovary syndrome research corresponded with the changes in search interest. We also studied the geographic reach of polycystic ovary syndrome interest and whether polycystic ovary syndrome awareness month is an effective strategy to increase polycystic ovary syndrome interest.
    Methods: We performed joinpoint regression on relative search volume data for polycystic ovary syndrome using Google Trends from 2004 to 2022, comparing weekly, monthly and yearly trends. We retrieved the total polycystic ovary syndrome-related articles from 1980 to 2022 to study funded and unfunded literature trends. We did a Mann-Whitney U-test analysis comparing the mean relative search volume during the polycystic ovary syndrome awareness month versus the rest of the weeks yearly.
    Results: Three joinpoints were seen at months 70, 196, and 199 months which were statistically significant when compared to the null hypothesis of zero joinpoints (p = .0002), one joinpoint (p = .0002), and two joinpoints (p = .0395), respectively. The search interest of 'Polycystic ovary syndrome' was seen in 195 regions globally. The mean relative search volume in September corresponding to polycystic ovary syndrome awareness month was higher than other months from 2013 to 2022. Of the 41,292 journal articles analysed, there was a positive trend in funded polycystic ovary syndrome research from the 2000s until the onset of the COVID-19 pandemic.
    Conclusions: An increasing polycystic ovary syndrome search interest is probably driven by major legislative and scientific events suggesting the importance of such events. Polycystic ovary syndrome Awareness Month is an effective international awareness initiative to increase online polycystic ovary syndrome information-seeking behaviour. The declining trend in funding is a concern as it mismatches with the continued increase in information-seeking behaviour globally.
    Keywords:  global equity; google trends; information-seeking behaviour; polycystic ovary syndrome; polycystic ovary syndrome awareness month; search interest
    DOI:  https://doi.org/10.1177/20552076231220787
  8. Yearb Med Inform. 2023 Aug;32(1): 230-243
       OBJECTIVES: This survey aims to provide an overview of the current state of biomedical and clinical Natural Language Processing (NLP) research and practice in Languages other than English (LoE). We pay special attention to data resources, language models, and popular NLP downstream tasks.
    METHODS: We explore the literature on clinical and biomedical NLP from the years 2020-2022, focusing on the challenges of multilinguality and LoE. We query online databases and manually select relevant publications. We also use recent NLP review papers to identify the possible information lacunae.
    RESULTS: Our work confirms the recent trend towards the use of transformer-based language models for a variety of NLP tasks in medical domains. In addition, there has been an increase in the availability of annotated datasets for clinical NLP in LoE, particularly in European languages such as Spanish, German and French. Common NLP tasks addressed in medical NLP research in LoE include information extraction, named entity recognition, normalization, linking, and negation detection. However, there is still a need for the development of annotated datasets and models specifically tailored to the unique characteristics and challenges of medical text in some of these languages, especially low-resources ones. Lastly, this survey highlights the progress of medical NLP in LoE, and helps at identifying opportunities for future research and development in this field.
    DOI:  https://doi.org/10.1055/s-0043-1768726