190 likes | 362 Views
Proposing Collaborative Cyberinfrastructure e-Water. Image: http://www.cougaarsoftware.com/images/DDE_small.JPG. Driving forces. Technology push Distributed access to content and computing resources Tools and services for data collection, mining Web based communication and computation
E N D
Proposing Collaborative Cyberinfrastructure e-Water Image: http://www.cougaarsoftware.com/images/DDE_small.JPG
Driving forces • Technology push • Distributed access to content and computing resources • Tools and services for data collection, mining • Web based communication and computation • Collaboration pull • Virtual organizations • Share distributed resources
e-Waterservices • How can I safely keep my data? • How do I find relevant data? • But we are all different…. still can work together? • What does the data say? • Why do we share?
1) How can I safely keep my data? Data on your shelves • expensive data sitting on the shelf unused. • obsolete or out-of-date • low quality (missing data, redundancy, conflict, etc) • wasting valuable time, effort and resources Image: http://www.i-grafix.com/images/story/full/3101_MIS.jpg
Solution: Virtual Data Repository • Publish your own data in any format • Online publishing • file, database, user interface, etc • Mobile publishing • field data, sensor data, etc • Convert and store it in e-Water repository • Backup • Version Control
Solution: Virtual Data Repository • Ubiquitous access to data sources: • Web as a data medium • Data anytime, anywhere, any purpose, etc • No installation is required • Integrate own data with other • Support semantic and visual data integration http://www.mtpc.org/converge_04_06/band.jpg
Solution: Virtual Data Repository • Data privacy and security: • Authority to access, use or release • Concerns for misuse, misinterpretation, “free riders” • Specify data access control rules • Keep it privately (release upon request) • Share it with peer groups • Open to public http://www.vyala.com/images/securefolders_icon.gif
2) How do I find relevant data? • Today’s data world • a large volume of data • new, divergent data types • rapidly emerging and evolving • Low quality • Finding relevant data is challenging and time consuming • More difficult to find geographic documents, map data, statistic analysis services Image: http://www.omikron.net/media/presse/boykottlisten.jpg
Solution: Online Discovery • “Google Water” (Search) • Document search • Data search • Ground water, Surface water, Sewage, Water quality, Storm water, etc • Real time data, Sensor readings, Historical data • Shape and Map data • Service search • Models or tools for simulation, statistical analysis, data mining • “Water Crawler” (Discovery) • Software agent Image: http://www.senatorhill.com/articles/search.jpg
3) But we are all different…. • Heterogeneity is a major bottleneck • Format (file, database, web data, etc) • Naming • Meaning • Purpose • Organization • Temporal • Spatial • Lack of standards for data access Image: http://www.nida.nih.gov/about/welcome/aboutdrugabuse/magnitude/images/fig004.gif
Solution: Data Mapping • Interpretable by others • Map with standard • Data transformation and cleaning • Format change using standards • Alignment of temporal and spatial data • Management of incomplete data and incorrect data • Data Integration • Integrated data is more meaningful
4) What does the data say? • Data that stands by itself is not meaningful. • Too much data would turn out to be impossible for manual process • Domain experts are still expensive and difficult to obtain. Image: http://www.datx.com/emails/question.htm
Solution: Use information technology • Statistical models to find correlations of important factors • Simulation models for decision support • Data mining to discover meaningful relations or unknown facts • Teach a Machine to be a domain expert
5) Why do we share? Coordination and collaboration on regional and national water IT solutions Efficiency, standardization, reliability, and availability of comprehensive water data and information solutions Continuity of care, improve safety, or add community value Image source: www.buildingsrus.co.uk/.../ target1.htm
Solution:e-WaterInfrastructure • Collaboration between communities and agencies • Easy and ubiquitous services - Anytime and Anywhere. No installation are required. • Shared data can be not only viewed but also used by applications.