220 likes | 341 Views
Liz Marai Pitt Computer Science CMU Robotics Institute (adj). LSST, 08/07/2008. Data Management and Visualization at Pitt CS. Pitt Computer Science. Data Management Graphics and Visualization Artificial Intelligence Core Systems Theory and Algorithms
E N D
Liz Marai Pitt Computer Science CMU Robotics Institute (adj) LSST, 08/07/2008 Data Management and Visualization at Pitt CS
Pitt Computer Science • Data Management • Graphics and Visualization • Artificial Intelligence • Core Systems • Theory and Algorithms • Small: 12 active faculty (avg. tier I: 25) • Strong: tier I (2 CAREER awards this summer only) • Excellent record of interdisciplinary collaboration
Current Collaborations • Pitt School of Medicine • Orthopedics & Bioengineering • Center for Modeling Pulmonary Immunity • Center for Biomedical Informatics • Center for Computational Biology and Bioinformatics • Pitt Center for Modeling and Simulations (Chemistry) • CMU Robotics Institute • Center for Parallel, Distributed and Intelligent Systems • Pittsburgh Supercomputing Center
Visualization Research Lab Department of Computer Science University of Pittsburgh
Image Processing, Modeling & Simulation of Biological Structures w/ UPMC Orthopedics Medical measurements (images, motion, forces etc) Half of parameters not measurable, yet inferrable Uncertainty Multiple sources of data Predictive models and simulations
Exploratory Visualization and Analysis Quantitative measures, incorporated into the modeling process (analysis) Anomaly detection (exploration)
Annotations for Interdisciplinary Collaboration Miscalibration? Or valid observation?
Contact • http://www.cs.pitt.edu/~marai • marai@cs.pitt.edu • SENSQ 5423
Advanced Data Management Technologies Laboratory July 2008 Department of Computer ScienceUniversity of Pittsburgh
Stream Data Management Web & Real-time Data Management Scientific Data Management Sensor Data Management Mobile Data Management Advanced Data Management Technologies LabDepartment of Computer Science, University of Pittsburgh People Research User-centric Data Management for Scalable Network Centric Applications http://db.cs.pitt.edu Panos Chrysanthis AlexLabrinidis Graduate Students • Lory Al Moakar • Roxana Gheorgiou • Shenoda Guirguis • Qinglan Li • Panickos Neophytou • Jie Xu Staff: • Alex Connor
Data Flow Data Acquisition Web Data Management Data Stream Processing Data Dissemination
Data Stream Management Systems • Alerting/Monitoring Service • Register query (filter) ahead of time • “Match” against incoming data stream • Generate “events” & notify users • Examples: • Stock market monitoring • Transient alerts • Google alerts • Detection of outbreak of diseases
Efficient Query Scheduling (Results) 73% Avg. Response Time (Sec) 65%
User-centric Web-data Management 4:26 AM ET • Given an option, would you prefer slightly-stale results fast OR fresh results, slightly delayed?
How to capture user preferences? • Proposed Quality Contracts Framework • Micro-economic paradigm • Combination of quality functions • Consider Quality of Service (response time) • Consider Quality of Data (freshness) • Basic idea: • Convert performance on individual metric into “worth” to users • Use Quality Contracts to guide resource allocation
Scientific Data Management • Biological Data Management • Center for Modeling Pulmonary Immunity • NIH-funded (2005 - 2009) • 4 centers in the US • Build mathematical models of immune response • http://cmpi.cs.pitt.edu • Data exchange server • Platform to record all experimental information • Enable sharing & interoperability across centers
Data Exchange Server • Platform to exchange experimental data • Goal 1: organize data already online • Goal 2: capture data from notebooks • Goal 3: allow for new data to be recorded • Provenance (data lineage) • Annotations • Goal 4: export / import capability • Goal 5: make repository user-friendly • Goal 6: minimize need for data cleaning • Goal 7: make repository active (alerts) • Publish / Subscribe
Stream Data Management Efficient Query Scheduling AQSIOS project Web & Real-time Data Management Quality Contracts Admission Control Transaction Scheduling Biological Data Management Data Exchange Server Annotation (Metadata) Management Publish/subscribe Sensor Data Management Mobile Data Management Advanced Data Management Technologies LabDepartment of Computer Science, University of Pittsburgh Directors Research Panos Chrysanthis AlexLabrinidis User-centric Data Management for Network Centric Applications http://db.cs.pitt.edu
National Science Foundation CAREER: User-Centric Data Management (IIS-0746696)Jul 2008 - Jun 2013 STREAMS: Algorithms and Metrics for New Generation Data Stream Management Systems (IIS-0534531)Mar 2006 - Feb 2009 S-CITI: A Secure Critical Information Technology Infrastructure for Disaster Management (ANI-0325353)Oct 2003 - Sep 2008 National Institutes of Health CMPI: Center for Modeling Pulmonary ImmunitySep 2005 - Sep 2010 Advanced Data Management Technologies LabDepartment of Computer Science, University of Pittsburgh Acknowledgments