130 likes | 238 Views
K/CBIR - Knowledge/Content Based Information Retrieval: Data Mining of EO Archives. M. Quartulli, ACS. ESA-Esrin 19-06-2008. USNG User Workshop. EO Data Archives. Continuous acquisitions of large data (7Gb/contact 150Mb/s X-band downlink)
E N D
K/CBIR - Knowledge/Content Based Information Retrieval:Data Mining of EO Archives M. Quartulli, ACS ESA-Esrin 19-06-2008 USNG User Workshop
EO Data Archives • Continuous acquisitions of large data(7Gb/contact 150Mb/s X-band downlink) • Composite, diverse, complex(1m resolution optical + multi-temporal SAR series) • Std DB operations: update/delete, select + analyze, insert(approx. magnitudes 0 : 5 : 100, select+analyze expensive bc. of opaque archive) • On-Line Transactions Processing: (e.g. EOLI) • Many small transactions / point queries • Avoid redundancy, normalize schemas • Fast access to consistent, up-to-date DB ESA-Esrin 19-06-2008 USNG User Workshop
Current EO Data Archives Things you can’t do: • Retrieve by application / visually relevant phenomenon (rather than metadata) • Archive-Aided Image Interpretation (e.g. for GIS update) • Summarize archive(e.g. to evaluate temporal evolution) ESA-Esrin 19-06-2008 USNG User Workshop 3
EO Data Mining & K/CBIR Main objective: high-level description of archive contents • Discover/analyze patterns in archive (autonomous/abstract or explicitly supervised/applic.-oriented) • Record aggregation / summarization (with inherent imprecision) • EO Data Mining & K/CBIR: • Big queries (all records, no updates) • Locked at the moment of domain-expert analysis(summarization in several secs/few minutes) • Many to many archives / engines ESA-Esrin 19-06-2008 USNG User Workshop 4
EO Mining 1/2: Ingestion • Abstract / application-independent analysis • Fully autonomous: unsupervised record set partitioning(inputs: DB+descriptor base - no external intervention) • Fixed base of primitive descriptors: high-dimensional quasi-complete data translation • A high performance computing problem ESA-Esrin 19-06-2008 USNG User Workshop 5
EO Mining 2/2: Interaction • Link application ontology to data space • Start from ‘natural’ DB content partitioning • Learn associations: problem space terminology to abstract descriptor configs • Efficient pattern detector construction and operation • A user-centered computing problem ESA-Esrin 19-06-2008 USNG User Workshop 6
Interaction: Training • Probabilistic belief networks incrementally updated by machine-learning algorithms • Supervisor performance tracking • Immediate feedback by local data classification April 2007 - ESA KEO ESA-Esrin 19-06-2008 USNG User Workshop 7
Interaction: Ordering/Retrieval • Content-based query criterion definition • Efficient problem-oriented indexing of DB data April 2007 - TIGER Wade ESA-Esrin 19-06-2008 USNG User Workshop 8
Interaction: Detection in Archive • Efficiently define dynamic constraint / transition rules (triggers) e.g. at insertion of ‘learned’ data patterns • Fast definition of alert systems on newly acquired data ESA, April 2006 - Greater Dresden Flooding ESA-Esrin 19-06-2008 USNG User Workshop 9
Applications: CBIR KAOS: intelligent archive content navigation ESA-Esrin 19-06-2008 USNG User Workshop 10
Applications: ImInt “Geospatial Data Analysis for Security Applications at the JRC” Molch @ ESA-EUSC March 2008 ESA-Esrin 19-06-2008 USNG User Workshop 11
Applications: Change Analysis ESA IIM-TS: explore multi-temporal evolution patterns in EO data archives ACS @ ESA EUSC March 2008 ESA-Esrin 19-06-2008 USNG User Workshop 12
Conclusions • EO Data Mining & K/CBIR: • Archive summarization • Archive navigation • Archive-Aided Image interpretation • Wide range of application domains • Novel archive access paradigm ESA-Esrin 19-06-2008 USNG User Workshop 13