300 likes | 509 Views
Situational Awareness for Fire Fighters (SAFIRE). Sharad Mehrotra Professor of Computer Science. SAFIRE Team. Faculty Sharad Mehrotra Nalini Venkatasubramanian Researchers, Engineers, Programmers Naveen Ashish Chris Davison Dmitri Kalashnikov Jay Lickfett. Imagecat Inc. Paul Amyx
E N D
Situational Awareness for Fire Fighters (SAFIRE) SharadMehrotra Professor of Computer Science
SAFIRE Team • Faculty • Sharad Mehrotra • Nalini Venkatasubramanian • Researchers, Engineers, Programmers • Naveen Ashish • Chris Davison • Dmitri Kalashnikov • Jay Lickfett • Imagecat Inc. • Paul Amyx • Charlie Huyck • Ron Eguchi • Graduate Students • Subin Anthony • Stefano Bonetti • ChiaraChiappini • Jeffrey Hu • DaniMassaguer • Ronen Vaisenberg • Bo Xing
Outline • Center for Emergency Response Technologies • SAFIRE Project • Goals, concept, deliverables, core research areas • Progress & Timeline • SAFIRE system • Research • Testing & validation
Bren School Center for Emergency Response Technologies Established in 2007 by the School of Information and Computer Sciences
CERT Mission • lead research, technology development & coordination of ongoing projects on role of IT to improving emergency response. • Provide a forum for collaboration between academia, industry, and government agencies.
CERT Research • Robust computing, communication, and storage infrastructure • Graceful performance degradation under extreme loads, catastrophic failures, surge demands • Real-time Situational Awareness from multimodal inputs to support decision making • Diversity of information sources, modalities, and needs, uncertainty in data, challenge of scale
CERT: Current Projects • NSF funded Responsphere Infrastructure • Funded by NSF through research infrastructure program (1.8M, 2004-2010) • NSF funded ITR-RESCUE • Funded by NSF through its large ITR program (12.5M, 2003-2009) • DHS funded SAFIRE project • Funded by DHS through FEMA fire fighter safety program (1M, 2008-10).
CERT: Infrastructure 1/3 of UCI sensing, communicating, storing, and computing infrastructure with ~ 300 sensors of ~ 10 types, several comms nets: ~200 indoor net cameras (with mics), ~30 MicaZ motes (with light, acoustic, acceleration, magnetic, etc sensors), ~6 people counters, ~6 mobile cameras , RFID readers, outdoor cameras, gas sensor, mesh routers, 802.11 (Wi-Fi), Ethernet, power-line comms, 802.15.4 (Zigbee), mobile sensing platforms, storing server, computing servers, PCs, laptops, cellphones, PDAs, etc.
Outline • Center for Emergency Response Technologies • SAFIRE Project • Goals, concept, deliverables, core research areas • Progress & Timeline • SAFIRE system • Research • Testing & validation
SITUATIONAL AWARENESS FOR FIRE FIGHTERS (SAFIRE) Improve the safety of firefighters by providing decision makers with greatly improved situational awareness during response activities
Varying Situational Awareness Needs & Technological Requirements • 1st responders @ crisis site • dangers, hazmat in vicinity, ingress/egress routes, status of equipment, victim location • Technology Needs: information to enable immediate action, knowledge of surroundings, role-specific and fine granularity data • IC @ crisis site • Accurate assessment of the ongoing situation, response monitoring, and on-site planning • Technology Needs: mechanisms to monitor onsite, site-level granularity, information assimilation, decision-support • EOC • longer-term planning & consequence management • Traffic planning, shelter planning, structural health, public health, news/media • Technology Needs: inter-organization data sharing, simulations to help predict future, coarse level monitoring, decision support, ability to understand the “big picture”. SAFIRE
How Situational Awareness can Help? Example Scenario: Structure Fire Abnormal event such as flashover detected by sensors. Alert on FICB causes IC to conduct roll call earlier than normal. RIC or closest firefighters can be directed to last known location.
SAFIRE Deliverables • Core technologies for creating SA at IC level • A prototype end-to-end SA system for IC • Collect, manage, and transform diverse sensor data streams from incident site into actionable information. • Connect to existing info systems (e.g., CAD) • “Intelligent” interactive display system • Real-time situational data, alerting & analysis capability • Testing & validation of the SA system
SAFIRE Core Technology Areas GIS External Data Sources hazmat occupancy FICB Visualization SAFIRE System Acoustic data Environmental sensors Sensor database Video data FF physio. & location. • Multimodal Sensing • Robust Network Infrastructure • Visualization and User Interfaces • Sensor stream processing • Integration of external data sources
Sensing Technologies Polar Heart Rate Module • SAFIRE has explored variety of sensor technologies: • Personnel accountability / health monitoring, Incident site / environment / hazard information, Resource tracking • Location sensing • Despite numerous efforts, effective indoor localization has remained a challenge! • WIFI, UWB, IR, Acoustic, ultrasound, video-based • Acoustic sensing – e.g., first responder communication • Benefit of human cognition Polar T31 Heart rate strap transmitter Mote • Environmental sensors • Mobile Optical/Acoustic sensors (D-Link TPZ cameras) • Fixed Mote Infrastructure (dB, Temperature, Light, Humidity) • Personal sensors • Pulse Rate (heartbeat), Acceleration, Temperature, Humidity, location, , Orientation, Barometer
Localization Framework Search Space of Possible localization Plans • An integrative technology-agnostic localization framework • Modeling location components • Modeling location queries • Location Queries • Diverse Types: • Simple queries: “where am I” • Boolean queries: “Am I in Bren Hall” • Nearest neighbor queries • Proximity queries: “Are Alice & Bob within 100 feet” • Quality requirement • Granularity – room level, building level, ... • Certainty • Solve queries using the best combination of location components • Best tradeoff accuracy-precision/cost Merging results of different components Based on Lazaridis & Mehrotra, SIGMOD 2006
Spatial Messaging Acoustic Sensing for Enhancing SA Type of Acoustic Analysis: Human Speech: Who spoke to whom about what from where and when. Ambient Sounds: explosions, loud sounds, screaming, etc. Physiological Events: cough, gag, excited state of speaker, slurring, .. Other features: too loud, too quiet for too long, … Acoustic Capture Acoustic Analysis SA Application Localization Image/video tagging Alerts Processing Firefighters Speech Conversation monitoring & playback Voice Amb. Noise 23
Robust Networking Infrastructure The Problem Network Infrastructure that can deliver contextual data sensed by firefighters to the incident commander FICB • Multitude of technologies • WSN, UWB, mesh networks, DTN • But …. • Rapidly deployable, self-configuring networks are still elusive! • SAFIRE-Net: a robust networking infrastructure for crisis site • Exploit multiple networks that together provide connectivity, Exploit mobility when disconnected
Fire Incident Command Board (FICB) Firefighter Status Dashboard Available GIS layers Mapping and Localization Receive and display alert messages.
Integrating External Sources through EBox • EBox -- one-stop information source for pre-compiled and evolving situational information • GIS, floor plans, hazmat locations, hazmat descriptions, occupancy, real-time building sensors and instrumentation, other external data sources User can select from list of available GIS layers, documents, or sensor streams Data automatically “ingested” by SAFIRE to provide an integrated view
Outline • Center for Emergency Response Technologies • SAFIRE Project • Goals, concept, deliverables, core research areas • Progress & Timeline
Formation of the SAFIRE Advisory Board Fire Agencies Advisory Board formed within 1 month of the grant Advisory board members involved in all aspects of SAFIRE Research prioritization System development Testing & validation Technology transfer opportunities Four CERT Fire Fighter Forum in the past 1 year. Other Agencies and Companies
Progress: Component Level Research • Sensing - incorporation of multiple new sensors • CO sensors, localization, speech • Networking & Data collection Infrastructure • New antenna array for increased coverage, multi-network & store-and-forward architecture • Stream management • ability to incorporate variety of sensors , multimodal sensor archival and retrieval functionality • Visualization • New functionalities in FICB – simplified UI, annotations, ebox integration, etc. • Ebox • Prototype development, ontologies for resource selection, integration of static and dynamic data such as sensing infrastructure of buildings Talk by Dr. Kalashnikov Talk by Prof. Venkatasubramanian Talk by Prof. Mehrotra Illustrated through demo/video
Progress: SAFIRE End-to-End SA System Fire Incident Command Board real time visualization of one incident Alert Generator define alert rules, generate alerts Incident Replay post-incident visualization, analysis • Sept. 2008 -- 1st Prototype • May 2009 -- Significant redesign to add Robustness & more dynamic configuration of components SAFIRE Server coordinates all aspects of real time inicident monitoring communication with external systems (CAD, EBox) configuration of stream processor, incident archiver maintain representation of current state messaging between clients and data stream sources Mock CAD EBox Stream Processor schedule data collection receive and manage data streams stream level data processing Incident Archiver store incident and sensor stream data sufficient to meaningfully recreate an incident at later date Incident Network & Sensors Sensor Data Streams Incident - Event DB
Progress: Testing & Validation • Technology Testing Exercise: 16 SEP 08 • Bren Hall Evacuation w/Campus Police Department & UCI Zone Crew 3 • Networking & sensing technologies, 1st gen. FICB. • Live Burn Exercise: 23 FEB 09 • Live Burn with OCFA,LA Fire and Anaheim Fire • Testing Sensing (human bio-sensing) data collection & 2nd generation FICB
Progress: Testing & Validation Talk by Dr. Davison • Technology Testing Exercise: 12 May 09 • Bren Hall Hazmat, multiple casualty incident • Integrated technology exercise, 3rd gen. FICB. • Table Top Exercise: 15 May 09 • Part of CERT Fire Forum • Participants: LA County Fire, UCI EH&S, Newport Beach Fire Department, Orange County Fire Authority, ImageCat Inc., Raytheon