1 / 32

Data Integration on the Semantic Sensor Web

Data Integration on the Semantic Sensor Web. Alasdair J G Gray Information Management Group University of Manchester Seminar at Imperial College London 7 April 2011. Overview of the Talk. Motivation: Estuarine Flooding Semantic Sensor Web – SemSorWeb Requirements Architecture

alden
Download Presentation

Data Integration on the Semantic Sensor Web

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Integration on the Semantic Sensor Web Alasdair J G Gray Information Management Group University of Manchester Seminar at Imperial College London 7 April 2011

  2. Overview of the Talk • Motivation: Estuarine Flooding • Semantic Sensor Web – SemSorWeb • Requirements • Architecture • Ontology-based query access over sensor, streaming, and stored sources • Demo Data integration on the SemSorWeb – Alasdair J G Gray

  3. The Solent • Strait separating the Isle of Wight from English mainland • Complex tidal and wave patterns Image: http://www.combinedops.com/ Image: http://www.chandlery-online.com/ Data integration on the SemSorWeb – Alasdair J G Gray

  4. The Solent Images: http://www.wikipedia.com/ Data integration on the SemSorWeb – Alasdair J G Gray

  5. Estuarine Flood Warning • Financial implications • Damage • Loss of business • Personal factors • Emotional • Flood prediction • Early warning/forecasting • Locations • Severity • Requires correlating • Sea-state data • Weather forecasts • Details of sea defences • Response Planning • Evacuation routes • Personnel deployment • … • Requires more data • Traffic reports • Shipping • … Image: http://www.metro.co.uk/ Data integration on the SemSorWeb – Alasdair J G Gray

  6. Flood Risk Alert: English South Coast • Detect conditions likely to cause a flood “Provide details of overtopping events in the Solent region with high wind speed observations” • Need to correlate data from multiple sources • Sensor data • Web feeds • Databases and other sources • Present data model in terms of the user domain: e.g. Flood risk assessment Wave, Wind, Tide Real-time sensor data Meteorological forecasts Flood defences data(database) ... ... ... Other sources Data integration on the SemSorWeb – Alasdair J G Gray

  7. Sensor Web Requirements “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” “Provide flood risk details of overtopping events in the Solent region with high wind speed observations” • Accurate characterisation of conditions that define an event • Correlation of data of differing modalities • Integrating data from heterogeneous data models • Discovery of relevant data sources • Presentation and control of information Data integration on the SemSorWeb – Alasdair J G Gray

  8. OntologyNetwork: Reconcile Terminology Upper DOLCE UltraLite SWEET SSG4Env infrastructure SSN Service Schema External FOAF OrdnanceSurvey Flood domain Role AdditionalRegions CoastalDefences Data integration on the SemSorWeb – Alasdair J G Gray

  9. SemSorWebArchitecture Applications Application Services Application Tier Semantic Registry Semantic Integrator Middleware Tier Data Source Data Tier Connectivity Bridge Concrete Resource

  10. Data Sources Data integration on the SemSorWeb – Alasdair J G Gray

  11. Channel Coastal Observatory: Observing Sea-State 43 sensors deployed around UK coast • Measuring • Tides (7) • Waves (24) • Weather conditions (12) • On and off shore • Bespoke hardware • Fixed functionality • Fixed (low) data rate • No bursts • Central data centre Data integration on the SemSorWeb – Alasdair J G Gray

  12. Publishing CCO Data • Relational data streams • envdata_sandownpier_tide (ts:int, Observed:float, Tz:float, Hs:float, HMax:float, Tp:float) • Streaming data service • Semantically annotated metadata description • Service description • Spatiotemporal data coverage • Thematic data coverage • Tide height Data integration on the SemSorWeb – Alasdair J G Gray

  13. Environment Agency: Flood Defences Database (NFCDD) • Flood defence details • Type of defence • Wall • Sand banks • … • Location • Height • … Data integration on the SemSorWeb – Alasdair J G Gray

  14. Publishing NFCDD Data • Relational database • locations (id:int, latitude:decimal, longitude:decimal,location:string,storm_threshold:decimal) • Stored data service • Semantically annotated metadata description • Service description • Spatiotemporal data coverage • Thematic data coverage • Sea defences Data integration on the SemSorWeb – Alasdair J G Gray

  15. Integrating Data Data integration on the SemSorWeb – Alasdair J G Gray

  16. Abstract Problem Integrator Stored data service Streaming data service Streaming data service Sensor Network Stored data Sensor Network Data integration on the SemSorWeb – Alasdair J G Gray

  17. Types of Heterogeneity Data source Data stream Query capabilities Data access Data semantics Integrator Stored data service Streaming data service Streaming data service Sensor Network Stored data Sensor Network Data integration on the SemSorWeb – Alasdair J G Gray

  18. Querying Approach • Use ontologies as common modelRequires: • Representation of RDF stream • Expressing continuous queries over an RDF stream • Establishing mappings between ontology models and data source schemas • Accessing data sources through queries over ontology model Data integration on the SemSorWeb – Alasdair J G Gray

  19. RDF Stream • Named graph • Continuously updating • Triples annotated with timestamp STREAM http://www.semsorgrid4env.eu/ccometeo.srdf ... ... ( <ssg4e:Obs1, rdf:type, cd:Observation>, ti ), ( <ssg4e:Obs1, cd:observationResult, “34.5”>, ti ), ( <ssg4e:Obs2, rdf:type, cd:Observation>, ti+1 ), ( <ssg4e:Obs2, cd:observationResult,”20.3”>, ti+1), ... ... cd:Observation cd:observationResult xsd:double Data integration on the SemSorWeb – Alasdair J G Gray

  20. SPARQLStream “Every 5 minutes give me with the wind speed observations over the last minute in the Solent Region ” PREFIX cd: <http://www.semsorgrid4env.eu/ontologies/CoastalDefences.owl#> PREFIX sb: <http://www.w3.org/2009/SSN-XG/Ontologies/SensorBasis.owl#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> RSTREAM SELECT ?windspeed?windts FROM STREAM <http://www.semsorgrid4env.eu/ccometeo.srdf> [ NOW – 1 MINUTE TO NOW STEP 5 MINUTES ] WHERE { ?WindObs a cd:Observation; cd:observationResult?windspeed; cd:observationResultTime?windts; cd:observedProperty?windProperty; cd:featureOfInterest?windFeature. ?windFeature a cd:Feature; cd:locatedInRegioncd:SolentCCO. ?windProperty a cd:WindSpeed. } cd:Observation cd:observationResult cd:observedProperty xsd:double cd:Property cd:featureOfInterest cd:Feature cd:locatedInRegion cd:Region Data integration on the SemSorWeb – Alasdair J G Gray

  21. Semantic Integrator SNEEql query over source schema SPARQLStream query over ontology Streaming Source Semantic Integrator Tuples Query Translator Q Stored data Tuples q SNEE Query Evaluation Engine S2O Mappings Tuples Streaming Source [[q]] Tuples Data Translator [[Q]] Stored data SPARQL bound variables Tuples Data integration on the SemSorWeb – Alasdair J G Gray

  22. Query Translation RSTREAM SELECT ?x FROM STREAM <http://…> [NOW–1 MIN TO NOW STEP 5 MIN] WHERE { ?y a cd:Observation; cd:observationResult ?x. } • Conjunctive queries • Extended with windows • Extended with window-to-stream Data integration on the SemSorWeb – Alasdair J G Gray

  23. Query Execution envdata_westbay v Streams Ontologies Feature envdata_chesil v locatedInRegion Observation envdata_milford v S2O Mapping hasObservationResult v envdata_hornsea observedProperty Region xsd:float envdata_rhylflats Timestamp: long Hs : float Lon: float Lat: float WaveHeightProperty SPARQLStream PREFIX cd: <http://www.semsorgrid4env.eu/ontologies/CoastalDefences.owl#> PREFIX sb: <http://www.w3.org/2009/SSN-XG/Ontologies/SensorBasis.owl#> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> SELECT ?waveheight?wavets?lat?lon FROM STREAM <http://www.semsorgrid4env/ccometeo.srdf> WHERE { ?WaveObs a cd:Observation; cd:observationResult ?waveheight; cd:observationResultTime ?wavets; cd:observationResultLatitude ?lat; cd:observationResultLongitude ?lon; cd:observedProperty ?waveProperty; cd:featureOfInterest ?waveFeature. ?waveFeature a cd:Feature; cd:locatedInRegioncd:SouthEastEnglandCCO. ?waveProperty a cd:WaveHeight. } SNEEql (SELECT Lon,timestamp,Hs,Lat FROM envdata_rhylflats) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_hornsea) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_milford) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_chesil) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_perranporth) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_westbay) UNION (SELECT Lon,timestamp,Hs,Lat FROM envdata_pevenseybay) Data integration on the SemSorWeb – Alasdair J G Gray

  24. Data Translation <ns9:sparql> <ns9:head> <ns9:variable name="waveheight"/> <ns9:variable name="wavets"/> </ns9:head> <ns9:results> <ns9:result> <ns9:binding name="waveheight"> <ns9:literal datatype=xs:double>4.850</ns9:literal> </ns9:binding> <ns9:binding name="wavets"> <ns9:literal datatype=xs:long>1272588663</ns9:literal> </ns9:binding> </ns9:result> <ns9:result> <ns9:binding name="waveheight"> <ns9:literal datatype=xs:double>2.1230</ns9:literal> </ns9:binding> <ns9:binding name="wavets"> <ns9:literal datatype=xs:long>1272587400</ns9:literal> </ns9:binding> </ns9:result> </ns9:results> </ns9:sparql> Data integration on the SemSorWeb – Alasdair J G Gray

  25. Flood Application “Smashing it all together” Data integration on the SemSorWeb – Alasdair J G Gray

  26. Flood Web Application • Discover relevant sources • Role • Task • Location • Mashup data • Layers on a map • Limited execution environment • Application services provide REST access to Web services Data integration on the SemSorWeb – Alasdair J G Gray

  27. Relevant Data Sources Sensor/Streaming Data Contextual Data Base Maps Flood defense details Land usage Weather forecasts Flooding forecasts • Sea-state sensor data • CCO • Port authority • WaveNet • Shipping • AIS • Traffic Alerts • RSS feed Data integration on the SemSorWeb – Alasdair J G Gray

  28. Demo http://www.semsorgrid4env.eu/services/dynamic-demo Data integration on the SemSorWeb – Alasdair J G Gray

  29. Conclusions: SemSorWeb • Accurate characterisation of conditions that define an event • Declarative queries • Correlation of data of differing modalities • Query evaluation over streaming and stored • Integrating data from heterogeneous data models • Ontology-based access to streaming data • Discovery of relevant data sources • Semantic registry (not covered in this talk) • Presentation and control of information • Application service to support, e.g. smash-ups Data integration on the SemSorWeb – Alasdair J G Gray

  30. Conclusions • Query-based access to RDF streams • SPARQLStream • Continuous query language • S2O mappings • Relational streams to ontology • Global-as-View approach • Query translation to SNEEql • Query substition • Query execution by SNEE-DQP Data integration on the SemSorWeb – Alasdair J G Gray

  31. Acknowledgements For more information: http://www.semsorgrid4env.eu/ • Christian Brenninkmeijer • Alvaro Fernandes • IxentGalpin • Norman Paton • Jean-Paul Calbimonte • Oscar Corcho Data integration on the SemSorWeb – Alasdair J G Gray

  32. References • I. Galpin, C. Y. A. Brenninkmeijer, A. J. G. Gray, F. Jabeen, A. A. A. Fernandes, and N. W. Paton. SNEE: A query processor for wireless sensor networks. Distributed and Parallel Databases, 29(1-2):31–85, 2011. Special issue on Query Processing in Sensor Networks. • A. J. G. Gray, R. García-Castro, K. Kyzirakos, M. Karpathiotakis, J.-P. Calbimonte, K. Page, J. Sadler, A. Frazer, I. Galpin, A. A. A. Fernandes, N. W. Paton, O. Corcho, M. Koubarakis, D. De Roure, K. Martinez, and A. Gómez-Pérez. A semantically enabled service architecture for mashups over streaming and stored data. In European Semantic Web Conference (ESWC 2011), pages 300–314, 2011. To appear. • J.-P. Calbimonte, Ó. Corcho, and A. J. G. Gray. Enabling ontology-based access to streaming data sources. In Proceedings of 9th International Semantic Web Conference (ISWC 2010), volume 6496 of LNCS, pages 96–111, Shanghai, China, November 2010. Springer. (Alphabetical authorship, equal responsibility). Data integration on the SemSorWeb – Alasdair J G Gray

More Related