An Evaluation of UMLS as a Controlled Terminology for the Problem List Toolkit

We are developing a set of software components—the Problem List Toolkit (PL-Tk) – to support operations on clinical problem labels. An adaptation of the National Library of Medicine’s Unified Medical Language System (UMLS) provides general vocabulary services to domain-specific software components. Our initial investigation centers on the inclusion in UMLS of problem labels used in the Beth Israel Deaconess Medical Center's Online Medical Record (OMR). We also explore the semantic typing of problem labels matched in UMLS. We have operationally defined a clinical problem to derive its semantic type from classes of terms representing findings or processes typically requiring diagnostic evaluation or therapeutic management in clinical practice. Of 1262 unique OMR problem labels, 999 terms (79%) have matches in UMLS. 986 of 999 terms (99%) map to the UMLS concept of the corresponding lexical match. 952 of 999 terms (95%) have semantic types that comply with our operational definition of clinical problems. These 952 terms (75%) constitute Version 1.0 of the problem list vocabulary BI96. Matching terms with inappropriate semantic types raise issues regarding requirements for PLTk, typing of existing UMLS terms, and the adequacy of our operational definition for clinical problems. UMLS provides a large repertoire of pre-coordinated terms that are used as problem labels in a heavily used computer-based patient record system. The semantic type hierarchy provides a framework for the consistent use of clinical concepts in problem lists such that clinical problem labels represent “good” clinical problems.