1 / 20

Annual reports and feedback from UMLS licensees

Simplify and streamline the process of collecting annual reports and feedback from UMLS licensees in a structured and efficient manner using an online form. Gather valuable information on UMLS usage, user support, and recommendations for improvement.

gconnie
Download Presentation

Annual reports and feedback from UMLS licensees

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Kin Wah Fung MD, MSc, MA The UMLS Team National Library of Medicine Workshop on the Future of the UMLS Semantic Network Annual reports and feedback from UMLS licensees

  2. Background • One of the requirements of the UMLS license is to submit an annual report of UMLS usage within 30 days of the end of each year • Up to last year, a free-form email (with suggested section headings) was the main way to collect the annual reports. Disadvantages: • low response rate (usually less than 100 received each year) • difficult to analyze • From 2005, online form to collect annual reports. Advantages: • more structured questions • easier to analyze • targetted email reminders possible => higher response rate

  3. Format of online annual report • Logon page – identity authenticated with UMLS license number • Main report page: • user info: affiliation, activity type, computing environment • usage of UMLS • feedback on user support and documentation • Optional sections for feedback on: • Metathesaurus • Semantic Network • Lexical tools • UMLS Knowledge Source Server

  4. Results (up to March 31, 2005)

  5. Results (up to March 31, 2005)

  6. Affiliation

  7. Main activity of organization/company

  8. How long have you been using the UMLS? • Range 2 months – 15 years • Average: 4.3 years • Median 2.3 years • Significantly longer than the rest of respondents - average 2.6 years, median 1 year (Independent-samples T test, 2- tailed p = 0.003)

  9. How are you using the UMLS?

  10. What kind of information do you use the UMLS to process?

  11. Usage of the Semantic Network • How have you used the Semantic Network? • in a research setting – 69 • in a production environment – 7 • Ways in which Semantic Network is used: • in natural language processing • word sense disambiguation • tagging of natural language expressions • natural language generation • ontological uses • finding concept distance • reference for building biomedical ontologies • other uses • suggesting relationships between UMLS concepts • restricting search of terms in the Metathesaurus • research on structure of Semantic Network

  12. Components of Semantic Network used • Do you use the Semantic Network on its own or in conjunction with the Metathesaurus concepts? • on its own - 15 • in conjunction - 58

  13. Have you extended or modified the Semantic Network?

  14. What improvements would you suggest? • more semantic types (4) • better description of semantic types and how they are assigned (2) • multiple hierarchies • more semantic relations • more uniform granularity • extension of relations to concept level • evolve towards a formal ontology

  15. One possible way to prioritize changes?

  16. One possible way to prioritize changes?

  17. One possible way to prioritize changes?

  18. One possible way to prioritize changes?

  19. One possible way to prioritize changes?

  20. Thank you!

More Related