110 likes | 249 Views
Beyond MxN. Matthew Wolf CERCS, Georgia Institute of Technology And Oak Ridge National Laboratory. Work done in collaboration with Dr. Karsten Schwan Dr. Greg Eisenhauer Hasan Abbasi, Andrew Hilton And numerous other graduate students. www.cercs.gatech.edu. Why are we here?.
E N D
Beyond MxN Matthew Wolf CERCS, Georgia Institute of Technology And Oak Ridge National Laboratory • Work done in collaboration with • Dr. Karsten Schwan • Dr. Greg Eisenhauer • Hasan Abbasi, Andrew Hilton • And numerous other graduate students www.cercs.gatech.edu
Why are we here? • It’s Jim Kohl’s fault First we assess blame…
Center for Experimental Research in Computer Systems(CERCS) Overview Karsten Schwan, Calton Pu, Douglas Blough, Sudhakar Yalamanchili An NSF Industry University Co-operative Research Center (IUCRC)
GT TeraStream: Overview Remote Collaborators capture, transport, filter, transform, intrusion detect .. Remote Hub Access Grid Nodes Real-time Visualization • Enabling Effective Scientific Collaboration: • Remote interactive computing and remote collaboration • Customized grid services, network- and resource-aware operation • Large-scale Applications and Distributed Application Services: • Scientific and distributed simulation • Storage and data management Emory Univ 10GB ORNL link Remote Hub Access Grid Nodes BioGrid Wireless Clients GT 10GB Backbone TeraStream Server Cluster Machine Mobile Sensors Science Clients Engineering Clients Real-time Visualization Clusters Survivable Services Storage Simulation Access Grid Nodes Data staging, recovery, replay
Data Collaborations • Data Collaborations Environments must scale to • Large numbers of collaborators, • Large (intra- and inter-continental) distances, • And LARGE ( >> TB) data sources. • Examples include projects like the Terascale Supernova Initiative, the Community Climate Model, and the Genomes-to-Life Initiative • Data personalization must play an important role
ECho: Event-based Data Exchange • Represent information flows as event streams (publish/subscribe model) • Transparency of local and remote receivers via event channels, implemented with underlying peer-to-peer communications over TCP, UDP, Wireless, multicast, etc. • Efficient, fully typed binary data transmission, based on dynamically defined event formats (PBIO) • Dynamic extension of existing formats and discovery/operation on format contents (reflection) • Interoperate with CORBA and Java (JECho) via IDL and XML
Binary XML transport • ECho/SOAP gateway • Modifying SOAP to do PBIO over http as well as XML over http • Automatic WSDL generation on • MxN • Looking at XML-based metadata to represent global specing of data • Visualization pipeline as a sample application???
Source-based Filtering:USEFUL Data via Dynamic Code Generation Source F( ) Sink F( ) Source Filter Function: { if ((data inside target area) and ((data values inside useful ranges)) { return 1; /* submit into channel */ } return 0; /* suppress data */ }
vs. Undamaged Damaged Undamaged W W L L W / l and L / l l = interatomic spacing Motivating Application • Mechanical Engineering • Physics • Chemistry • Aerospace Engineering Twinning Plane FCC