1 / 15

Data Filtering and Software

Data Filtering and Software. IceCube Collaboration Meeting Monday, March 21, 2005. DAQ Dispatch. P&F Server. Filt/Rec Data. Raw Data. Recon Worker X 50-60?. System Overview. Expt. Control / Logging. DAQ Land. 4-15MB/s 1500-2000Hz. ALL: RAW+FILT+REC. FILT:RAW+FILT+REC.

dionne
Download Presentation

Data Filtering and Software

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005

  2. DAQ Dispatch P&F Server Filt/Rec Data Raw Data Recon Worker X 50-60? System Overview Expt. Control / Logging DAQ Land 4-15MB/s 1500-2000Hz ALL: RAW+FILT+REC FILT:RAW+FILT+REC Data Handling ALL:FILT+REC Transient Buffer Online Analysis Rec/Filt Data Online Analysis Tape Online Analysis Recon Monitor Offline Software/IceTray Data Systems Overview

  3. Data Handling • Accomplishments • South Pole Test System operational since late last year. • South Pole System installed at the Pole in late December. • SPS operational with 1 string! • SPADE installed at Pole and used to transfer drill, webcam, and TestDAQ data. • Coming Year Activities • Data ingestion to Data Warehouse to be implemented. • Web interface to Data Warehouse. • Upgrade data storage facilities. • IceCube Metadata standard and data directory structure to be defined. • Upgrade SPS and SPTS for upcoming season. Data Systems Overview

  4. Experiment Control • Provide system for South Pole operating • Control • Configuration • Monitoring • Logging • JBoss Support • Based on “JBoss” • Infrastructure in place • Run-Control JMX Console in development Data Systems Overview

  5. Filtering • PnF System • V1.0 Tested at SPTS & deployed at Pole • Currently not in data stream • Lacking some run information and testing • New Version of Monolith soon (April) • Test & run PnF at Pole in preparation for next year • Plans for next year • Integrate with Real DAQ,Exp Ctrl, DAQ Disp, SPADE at SPTS (August/Sept) • PnF is output stream for Real DAQ • Filtering at South Pole required Data Systems Overview

  6. Offline Software • Several incremental releases this past year • In use by reconstruction and simulation groups. • Many people developing physics modules • Lots of physics to do yet • Current release: • OFFLINE-SOFTWARE V01-05-00 • There are tools available for all • Event viewer • Script to make histograms for ROOT • AMANDA muon reconstruction and merging by summer Data Systems Overview

  7. Software 1 Data Systems Overview

  8. Software 2 Data Systems Overview

  9. Software 3 Data Systems Overview

  10. Event Viewer Data Systems Overview

  11. ATWD Calibration & Feature Extraction Data Systems Overview

  12. Simulation • Version 0.2 released • Implemented in IceTray • I3Db • Corsika Reader • MMC Propagator • Hit Constructor (Photonics interface) • Noise Generator • ROMEO, ROMEO-AMANDA • DOM Simulator (atwd,fadc,TWR) • Trigger Sim • ATWD Channel Merger • Feature Extraction • Event Viewer Data Systems Overview

  13. JULIET 300 PeV Data Systems Overview

  14. Simulation Plans • Version 1.0 of IceCube simulation • Ready Mid April • Generate large set of events for validation against AMASIM with same Ice properties etc… • New Photonics tables • Ready April-May • Finalize metadata specs and production scripts • Large production run using V1.0 • Data set in ware house Data Systems Overview

  15. Summary • Great Progress in the last year • SPADE operating reliably • PnF/DAQ Dispatch tested and running • Experiment Control system defined and providing Jboss support • Simulation V0.2 running • Broad range of developers in IceTray • Decision for C++ and data classes 1 year ago • For Next Year • Systems on track for physics from 30-32 string detector • Online system integration and testing in Aug/Sep • Reconstruction and filtering Data Systems Overview

More Related