570 likes | 717 Views
Visualization of Electronic Health Records Ben Shneiderman ben@cs.umd.edu @ benbendc Founding Director (1983-2000), Human-Computer Interaction Lab Professor, Department of Computer Science Member, Institute for Advanced Computer Studies University of Maryland College Park, MD 20742.
E N D
Visualization ofElectronic Health RecordsBen Shneiderman ben@cs.umd.edu @benbendcFounding Director (1983-2000), Human-Computer Interaction LabProfessor, Department of Computer ScienceMember, Institute for Advanced Computer StudiesUniversity of MarylandCollege Park, MD 20742
Visualization ofElectronic Health Records@benbendcUniversity of MarylandCollege Park, MD 20742
Interdisciplinary research community - Computer Science & Info Studies - Psych, Socio, Poli Sci & MITH (www.cs.umd.edu/hcil)
Design Issues Input devices & strategies Keyboards, pointingdevices,voice Direct manipulation Menus, forms, commands Output devices & formats Screens, windows, color, sound Text, tables, graphics Instructions, messages, help Collaboration &Social Media Help, tutorials, training Search www.awl.com/DTUI Fifth Edition: 2010 • Visualization
HCI Pride: Serving 5B Users Mobile, desktop, web, cloud Diverseusers: novice/expert, young/old, literate/illiterate, abled/disabled, cultural, ethnic & linguistic diversity, gender, personality, skills, motivation, ... Diverse applications:E-commerce, law, health/wellness, education, creative arts, community relationships, politics, IT4ID, policy negotiation, mediation, peace studies, ... Diverse interfaces: Ubiquitous, pervasive, embedded, tangible, invisible, multimodal, immersive/augmented/virtual, ambient, social, affective, empathic, persuasive, ...
Information Visualization & Visual Analytics • Visual bands • Human percle • Trend, clus.. • Color, size,.. • Three challe • Meaningful vi • Interaction: w • Process mo 1999
Information Visualization & Visual Analytics • Visual bandwidth is enormous • Human perceptual skills are remarkable • Trend, cluster, gap, outlier... • Color, size, shape, proximity... • Three challenges • Meaningful visual displays of massive da • Interaction: widgets & window coordinati • Process models for discovery 1999 2004
Information Visualization & Visual Analytics • Visual bandwidth is enormous • Human perceptual skills are remarkable • Trend, cluster, gap, outlier... • Color, size, shape, proximity... • Three challenges • Meaningful visual displays of massive data • Interaction: widgets & window coordination • Process models for discovery 1999 2004 2010
Treemap: Gene Ontology • Space filling • Space limited • Color coding • Size coding • - Requires learning (Shneiderman, ACM Trans. on Graphics, 1992 & 2003) www.cs.umd.edu/hcil/treemap/
Treemap: Smartmoney MarketMap www.smartmoney.com/marketmap
Market mixed, February 8, 2008 Energy & Technology up, Financial & Health Care down
Treemap: WHC Emergency Room (6304 patients in Jan2006) Group by Admissions/MF, size by service time, color by age
Treemap: WHC Emergency Room (6304 patients in Jan2006) (only those service time >12 hours) Group by Admissions/MF, size by service time, color by age
Information Visualization: Mantra • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand • Overview, zoom & filter, details-on-demand
Information Visualization: Data Types 1-D Linear Document Lens, SeeSoft, Info Mural 2-D Map GIS, ArcView, PageMaker, Medical imagery 3-D World CAD, Medical, Molecules, Architecture Multi-VarSpotfire, Tableau, Qliktech, Visual Insight Temporal LifeLines, TimeSearcher, Palantir, DataMontage Tree Cone/Cam/Hyperbolic, SpaceTree, Treemap Network Pajek, UCINet, NodeXL, Gephi, Tom Sawyer InfoVizSciViz. infosthetics.com visualcomplexity.com eagereyes.org flowingdata.com perceptualedge.com datakind.org visual.ly visualizing.org infovis.org
Obama Unveils “Big Data” Initiative (3/2012) Big Data challenges: • Developing scalable algorithms for processing imperfect data in distributed data stores • Creating effective human-computer interaction tools for facilitating rapidly customizable visual reasoning for diverse missions. http://www.whitehouse.gov/sites/default/files/microsites/ostp/big_data_press_release_final_2.pdf `
EHRs: Temporal categorical data Category Numerical Event Patient ID: 45851737 Stock: Microsoft Event 04/26/2010 10:00 31.03 04/26/2010 10:15 31.01 04/26/2010 10:30 31.02 04/26/2010 10:45 31.08 04/26/2010 11:00 31.16 12/02/2008 14:26 Arrival 12/02/2008 14:36 Emergency12/02/2008 22:44 ICU 12/05/2008 05:07 Floor 12/14/2008 06:19 Exit Time Arrival Emergency ICU Floor Exit A type of time series
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
LifeLines: Patient Histories www.cs.umd.edu/hcil/lifelines
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
LifeLines2: Align-Rank-Filter & Summarize www.cs.umd.edu/hcil/lifelines
LifeLines2: Align-Rank-Filter & Summarize www.cs.umd.edu/hcil/lifelines2
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
Similan: Search www.cs.umd.edu/hcil/similan
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
LifeFlow: Aggregation Strategy Temporal Categorical Data (4 records) LifeLines2 format Tree of Event Sequences LifeFlow Aggregation www.cs.umd.edu/hcil/lifeflow
Patient Histories: Our Research www.cs.umd.edu/hcil/toolname
Discovery Process: Systematic Yet Flexible Preparation • Own the problem & define the schedule • Data cleaning & conditioning • Handle missing & uncertain data • Extract subsets & link to related information
Discovery Process: Systematic Yet Flexible Preparation • Own the problem & define the schedule • Data cleaning & conditioning • Handle missing & uncertain data • Extract subsets & link to related information Purposeful exploration – Hypothesis testing • Range & distribution • Relationships & correlations • Clusters & gaps • Outliers & anomalies • Aggregation & summary • Split & trellis • Temporal comparisons & multiple views • Statistics & forecasts
Discovery Process: Systematic Yet Flexible Preparation • Own the problem & define the schedule • Data cleaning & conditioning • Handle missing & uncertain data • Extract subsets & link to related information Purposeful exploration – Hypothesis testing • Range & distribution • Relationships & correlations • Clusters & gaps • Outliers & anomalies • Aggregation & summary • Split & trellis • Temporal comparisons & multiple views • Statistics & forecasts Situated decision making - Social context • Annotation & marking • Collaboration & coordination • Decisions & presentations
UN Millennium Development Goals To be achieved by 2015 • Eradicate extreme poverty and hunger • Achieve universal primary education • Promote gender equality and empower women • Reduce child mortality • Improve maternal health • Combat HIV/AIDS, malaria and other diseases • Ensure environmental sustainability • Develop a global partnership for development
30th Anniversary!!! www.cs.umd.edu/hcil@benbendc
Office of National Coordinator: SHARP Strategic Health IT Advanced Research Projects - Security of Health Information Technology - Patient-Centered Cognitive Support - Healthcare Application and Network Platform Architectures - Secondary Use of EHR Data Univ of Maryland HCIL tasks - Missing Laboratory Reports - Medication Reconciliation - Wrong Patient Errors www.cs.umd.edu/hcil/sharp
Medication Reconciliation: Current Form Univ of Maryland HCIL tasks - Missing Laboratory Reports - Medication Reconciliation - Alarms and Alerts Management www.cs.umd.edu/hcil/sharp www.youtube.com/watch?v=ZGf1EiuIIIM
Twinlist: Medication Reconciliation “Best reconciliation app I have ever seen” Dr. Shawn Murphy, PartnersHealthcare & Harvard Medical “Super-cool demo” Dr. Jonathan Nebeker, Univ of Utah & VA “Twinlist concept is brilliant” Dr. Kevin Hughes, Harvard Medical School Tiffany Chao, Catherine Plaisant, Ben Shneideman Based on class project of : Leo Claudino, SamehKhamis, RanLiu, Ben London, Jay Pujara Students of CMSC734 Information Visualization class www.youtube.com/watch?v=YoSxlKl0pCo