1 / 22

JAIDA, JAS3, WIRED4 and the AIDA tag library - experience and new developments

JAIDA, JAS3, WIRED4 and the AIDA tag library - experience and new developments. DONSZELMANN, Mark (SLAC) JOHNSON, Tony (SLAC) SERBO, Victor (SLAC) TURRI, Max (SLAC). FreeHEP Java Library. Items discussed in this talk are all part of FreeHEP Java Library

jlacy
Download Presentation

JAIDA, JAS3, WIRED4 and the AIDA tag library - experience and new developments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JAIDA, JAS3, WIRED4 and the AIDA tag library - experience and new developments DONSZELMANN, Mark (SLAC) JOHNSON, Tony (SLAC) SERBO, Victor (SLAC) TURRI, Max (SLAC) Victor Serbo, CHEP07

  2. FreeHEP Java Library • Items discussed in this talk are all part of FreeHEP Java Library • Open-Source utilities for HEAP and beyond • Mostly Java (now also open-source) • http://java.freehep.org/ • FreeHEP philosophy • Avoid common HEP pitfall of lock-in to monolithic frameworks • Small modular projects which can be used together or separately • Define interfaces to allow open communication between modules • Easy to extend or replace components • Use open-standards where possible • Example: AIDA - Abstract Interfaces for Data Analysis • Data can be in different formats and representations • Adapt data to “look like” standard AIDA object and then use set of standard interfaces to work with it • Tools built using AIDA can work with analysis objects from Root, PAW, Fits, SQL transparently. • New in FreeHEP organization • Re-factor dependences and move code from CVS to SVN • Use Maven 2 to build/test/deploy • see poster by Mark Donszelmann: #52 in Poster Session 1 Victor Serbo, CHEP07

  3. AIDA • AIDA is a standard set of interfaces for creating and manipulating histograms, n-tuples and related data analysis objects, like Plotter, Fitter, etc. • Documentation and examples: http://aida.freehep.org • Current release 3.3.0 • There are several AIDA implementations: • Java: http://java.freehep.org/jaida • C++ • Open Scientist: http://www.lal.in2p3.fr/OpenScientist • PI: http://cern.ch/pi • Python: http://paida.sourceforge.net • Also AIDAJNI layer that allows using Java implementation from C++: http://java.freehep.org/aidajni Victor Serbo, CHEP07

  4. JAIDA – Java Imlementation of AIDA • Features: • Data analysis and fitting (JMinuit and FMinuit) • High quality plots in variety of formats (pdf, ps, gif, png, swf, etc.) • Read/Write support for AIDA XML format (with zip and gzip options) • Read support for Hbook, Root and plain Text files. • Download and Setup: • Current version 3.3.0-5, implements AIDA 3.3.0 • Documentation and setup instructions at http://java.freehep.org/jaida • Needs Java 1.4 or higher Victor Serbo, CHEP07

  5. New in JAIDA • Full implementation of the AIDA 3.3 interfaces • Add Zip option for AIDA XML files • Provides directories that map to AIDA ITree structure • Now can read and create AIDA XML objects on-demand • Opening XML files with many objects much faster • Add Binary XML option for AIDA XML files • Faster reading – don’t have to convert numbers from String to double • Saves space • Will support incremental storage of large objects (e.g. n-tuples) • New module for reading and writing Fits files • Add support for plotting 1D and 2D histograms with variable bins • Add utility class to fill IHistogram, ICloud, or ITuple with data distributed according to a given IFunction • Add utility class to convert individual AIDA objects to XML and back • Support for native i386-MacOSX (Hbook, FMinuit) Victor Serbo, CHEP07

  6. Using JAIDA Java Application Oracle, MySQL, ... J A I D A JAS3 GUI XML GEANT4 (C++) AIDAJNI Layer Fits Hbook AIDATLD (Tag Library) Root Victor Serbo, CHEP07

  7. JAS3 • Pulls together many FreeHEP modules, event display (WIRED4), etc. into single GUI application • Design based on Application Shell, into which many (optional) modules can be plugged • Highly customizable for different application domains • HEP/Astrophysics/Other • Data analysis/Online Monitoring/GRID analysis • Experiment/User specific modules • Modules can be updated independently of the shell • Possible to release bug fixes fast • Includes support for programming in several languages • Scripting: currently Pnuts and Python • Java (compiled) • Analysis (histograms, tuples, fitting, etc.) based on JAIDA • JAS3 web page: http://jas.freehep.org/jas3 • Current 0.8.4rc1 • ftp://ftp.slac.stanford.edu/software/jas/JAS3/v0.8.4rc1 Victor Serbo, CHEP07

  8. JAS3 Example Can write and run scripts, Java code Console allows direct interaction with scripting language Victor Serbo, CHEP07

  9. JAS3 in BaBar • Combine on one HTML page • Live monitoring plots • Static reference plots • Instructions and useful information • Fast Monitoring • Live plots received from the shared memory via CORBA • Reference plots from Hbook and Root files • Featured on YouTube (during the last minute of http://www.youtube.com/watch?v=dj7gCZTEoq0 ) • Ambient or “Slow Monitoring” (time histories of voltages, currents, temperatures, etc.) • Data received from the DB or Live Archivers via CORBA Victor Serbo, CHEP07

  10. Victor Serbo, CHEP07

  11. Ambient • DHP Victor Serbo, CHEP07

  12. Data on the webAIDA Tag Library • Using the AIDA Tag Library (AIDATLD) you can easily insert live plots into the web pages (using Java Server Pages technology). • Users don’t need any special software – just a web browser • Can be used to make data/plots accessible to distributed collaboration quickly • HTML-like tags: <aida:tree>, <aida:plotter>, <aida:style> • The AIDA Tag Library is designed to work in a container supporting JSP 2.0 or greater (such as e.g.Tomcat 5.5.*) • Examples/Demo and Documentation: http://aidatld.freehep.org Web Application Server (e.g. Apache Tomcat) Web Browser Plots sent as images (png, swf, pdf etc.) Data (Root, SQL etc) AIDATLD Victor Serbo, CHEP07

  13. AIDATLD Demo – plot from ROOT file <%@page contentType="text/html"%> <%@page pageEncoding="UTF-8"%> <%@ taglib prefix="c" uri="http://java.sun.com/jsp/jstl/core" %> <%@taglib prefix="aida" uri="http://aida.freehep.org/jsp20" %> <%@page isELIgnored="false" %> <head> <title>SimpleAIDA Plot</title> </head> <body> <h1>Plot Histogram from Root File</h1> <p/> <c:set var="treeName" value="C:/work/Data/rootdemo.root"/> <c:set var="treePath" value="/h100"/> <aida:tree storeName="${treeName}" storeType="root"/> <aida:objects storeName="${treeName}" path="${treePath}" var="aidaPlotObject"> </aida:objects> <aida:plotter> <aida:region> <aida:plot var="${aidaPlotObject[0]}"/> </aida:region> </aida:plotter> </body> </html> Victor Serbo, CHEP07

  14. JAIDA/AIDATLD in GLAST • The Gamma-ray Large Area Space Telescope • http://glast.gsfc.nasa.gov • http://www-glast.slac.stanford.edu • Many web applications developed for GLAST make use of JAIDA/AIDATLD • Software releases validation • http://glast-ground.slac.stanford.edu/SystemTests • Telemetry trending • Data Quality Monitoring • Calibrations trending • Pipeline processing overview • See also talk by Dan Flath (Id:361): “The GLAST Data Handling Pipeline” • Sky source and Gamma Ray Burst Monitoring Victor Serbo, CHEP07

  15. GLAST Data Origin • Data is stored in various formats • Databases • Oracle, MySQL • Files • Xml, Fits, Root • Adapters are used to convert it to AIDA objects • These objects are then handled and displayed using JAIDA and AIDATLD • Users don’t care where data is coming from and in what format they were stored. • Can mix-and-match different data on one web page Victor Serbo, CHEP07

  16. Summary Table Navigation Tree Comparison plots Victor Serbo, CHEP07

  17. Telemetry Trending • ~12K telemetries are stored in Oracle db • Raw values on change • Accumulated statistics every 5 minutes • This application allows users to • View any telemetry over any time period • Group telemetries together in a navigation tree • Stack corresponding plots • Or produce a single overlay plot • Access raw/statistical data • Choose the maximum number of data points per plot • If necessary data is accumulated on the fly • Tabular view of the selected data Victor Serbo, CHEP07

  18. Victor Serbo, CHEP07

  19. SQL Backend for AIDA • Next 3 slides provided by Julius Hrivnac • Julius.Hrivnac@cern.ch • SQLTuple • SQL backend for AIDA ntuples • Uses direct SQL commands to perform ntuple operations (like creation of projections) => allows work with very big ntuples (unlike other SQL-AIDA couplings) • Exists also as a JAS plugin and a Web Service • More information at http://cern.ch/hrivnac/Activities/Packages/SQLTuple/ Victor Serbo, CHEP07

  20. AIDATLD at Atlas • AIDATLD used together with SQLTuple to look at SQL databases • deployed as J2EE Web Service at http://cern.ch/SQLTuple • Atlas Tag Database Characteristic Histograms available in http://cern.ch/SQLTuple/presenter.jsp • or as a Google Gadget: http://www.google.com/ig/adde?moduleurl=http%3A//hrivnac.web.cern.ch/hrivnac/Activities/Packages/GoogleGadgets/TagsCharacteristicsHistograms.xml Victor Serbo, CHEP07

  21. SQLTuple in JSP Page Victor Serbo, CHEP07

  22. Status and Plans • Continue support and development of JAIDA and JAS3 • Need new, more functional plotter • Need ability to work with big data volumes • Support and develop web applications based on AIDATLD • AIDA meeting Summer 2007 to discuss improvements and future releases • WIRED4: experiment-independent interactive event display http://wired.freehep.org • User Support: • Bug reports: http://bugs.freehep.org • Forum: http://forum.freehep.org Victor Serbo, CHEP07

More Related