Community-wide Evaluations for Advancement of Bioinformatics Services and Systems
Brown Bag Lecture by Dr. Dina Demner Fushman | 5/24/2011 11AM-12PM | 7th Floor Conference Room, Bldg 38A
Abstract: The epigraph to the 1968 F.W. Lancaster’s (then the Deputy Chief, NLM Bibliographic Services Division) report on the evaluation of effectiveness and efficiency of the Medical Literature and Analysis System (MEDLARS) states: “IN ORDER TO SURVIVE, A SYSTEM MUST MDNITOR ITSELF, EVALUATE ITS PERFORMANCE, AND UPGRADE IT WHEREVER POSSIBLE.” The 1966-67 MEDLARS study was one of the earliest evaluations of an information retrieval system, and the first to use recall and precision measures in a production-level setting. The early evaluations emphasized the importance of reusable test collections and relied on relatively small collections built through individual research efforts. With the growth of the readily available collections, it became clear that large-scale evaluations are needed and can be conducted only through community-wide efforts. The efforts, spearheaded by the Text REtrieval Conferences, are now growing in size and variety. Today, there are several: ImageCLEF, BioNLP Shared Task, BioCreative, Medical Record retrieval …..
This talk will present innovative approaches to solving practical challenges to information retrieval and extraction developed in some of the challenges. It will focus on the i2b2 evaluations and highlight approaches developed by the NLM team.
Bio:Dr. Dina Demner-Fushman is a Staff Scientist for the Communications Engineering Branch at the National Library of Medicine. She conducts research in clinical decision support, clinical question answering, use of natural language processing in information retrieval, human computer interaction aspects of information retrieval, and information retrieval in biomedical domain. Her interest in biomedical language processing stems from years of clinical practice (M.D. obtained from Kazan State Medical Institute in 1980) and clinical research (Doctorate (Ph.D.) in Medical Science earned from Moscow Medical and Stomatological Institute in 1989.) She earned her MS and PhD in Computer Science from the University of Maryland, College Park in 2003 and 2006, respectively. She earned her B.S degree in Computer Science from Hunter College, CUNY in 2000.