1 / 12

LSIR Developments for SiwssEx

LSIR Developments for SiwssEx. Hoyoung Jeung EPFL-LSIR SwissEx Annual Meeting, Zurich 15 th July. System Overview. processed. queried. captured. Distributed Metadata Join. Interactive processing metadata @Wiki + real-time sensor data @GSN Used for PermaSense

derek-alexander
Download Presentation

LSIR Developments for SiwssEx

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LSIR Developments for SiwssEx Hoyoung Jeung EPFL-LSIR SwissEx Annual Meeting, Zurich 15th July

  2. System Overview processed queried captured

  3. Distributed Metadata Join • Interactive processing • metadata @Wiki + real-time sensor data @GSN • Used for PermaSense • dealing with sensor redeployment problems

  4. Automatic Metadata Generation • Dynamic metadata composition by GSN • Possibility of user-given operation for the trigger in GSN • Automatic metadata page creation at SwissEx wiki • <metadata> • <deployement>EPFL</deployment> • <station>multidata</station> • <sensor>temperature</sensor> • <from>2010-05-17T14:00:41</from> • <to>2010-05-17T14:00:41</to> • <dirtiness>1.0</dirtiness> • </metadata>

  5. User-Interactive Data Cleaning • Model-based anomaly detection • User can select model/parameters original data stream ↓ approximation using user-selected models ↓ detecting anomalies ↓ user confirmation: anomaly is an actual error?

  6. Advanced Metadata Search • Provides a rich set of search conditions • Multiple-property, geographical search • Supports various visualization • e.g., bar, pie, graph, and map • aggregation of query results • search results export -> XML/CSV

  7. Dealing with Evolving DB Schema • Problem • tables managed by different versions of GSN, multiple tables, conflicts, overlaps, errors • Used for PermaSense • Input • list of tables representing mappings • old schema • Output • unified schema • synchronization mechanism

  8. Spatial Query Support • Problem (posed by Hydrosys) • Possibility to query stations based on spatial predicates • Solution 1 • Extend GSN with GIS toolkit • Create new web method (/geodata) • Parameters: query, envelope [,union] • Allows basic queries (e.g. average wind speed in a given area at a time) • Solution 2 • Use Postgres/PostGIS • More flexibility for arbitrary queries • Add automatic index • Adapt web methods

  9. Simulation Support • Web service for meteoIO • Integration with GeoTop • Web access (front-end) to simulation • Filtering, interpolations, … • Used for Hydrosys

  10. Access Control of GSN • The prevention of unauthorized use of data • Authentication • User authentication by password • GSN server authentication by using SSL/TLS protocol User Access Virtual Sensor U rw vs1 U w vs3 U own vs1 U r vs2

  11. Various Technical Support • Install, configuration, patches • SLF, Hydrosys, APUNCH, Remote Sensing lab @ EPFL, …. • Maintenance and training • Supporting integration of new data sources • Continuous development of SwissEx wiki • Collaboration with SLF • Securing data: repository for Sensorscope • Reloading all historical data • Mirroring data

  12. Planned Work • Major goal • Make the developments in real use • Continuing technical support • Hydrosys • Spatial queries with PostGIS • Adapt web methods, testing and documentation • SLF • Migrate IMIS • Mirroring of data (waiting for hardware) • LTE • Adapt web methods for fetching grid data

More Related