70 likes | 231 Views
Overview of recent progress. Preparation of System Test with MOKKA / MarlinReco input : received updated track cheater code from Alexei Raspereza: checked and works fine ongoing email exchange with Dennis Martsch about MOKKA files he processes on the GRID:
E N D
Overview of recent progress • Preparation of System Test with MOKKA / MarlinReco input: • received updated track cheater code from Alexei Raspereza: checked and works fine • ongoing email exchange with Dennis Martsch about MOKKA files he processes on the GRID: • first test file had error messages about negative energy deposits, 71 out of 200 events aborted: • this was identified as a problem of MOKKA version 6.1, vanishes in previous version 6.0 • since last week checked new test file: still some strange effects (see Ben’s & Erik’s slides) • gave detailed feedback to Dennis yesterday, waiting for response • Understanding results of previous system test with SGV input: • different code for comparing SGV and Marlin gives different results; • this has been shown to arise from the flavour tagging part of the chain; • there may be a problem with the neural network code, study ongoing • (for details see following transparencies)
b c (b-bkgr) c open: SGV full: MARLIN (7th Feb 07) Comparing Marlin and SGV - initial result from Sonja Sonja’s comparison (below) uses: SGV: FORTRAN ZVRES + SGV tag-input calc’n + standalone flavour tag with old NN code MARLIN: C++ ZVRES + Marlin tag-input calc’n + Marlin flavour tag using newest NN code Identical input events
Comparing Marlin and SGV - initial result from Ben Ben’s comparison (below) uses: SGV: FORTRAN ZVRES + SGV tag-input calc’n + Marlin flavour tag + PlotProcessor MARLIN: C++ ZVRES + Marlin tag-input calc’n + Marlin flavour tag + PlotProcessor note that it was previously checked independently that the PlotProcessor works reliably Identical input events
Agreement of Marlin performance • as a cross check we compared the performance obtained from MARLIN: OK; • the difference seen in the c- and the b-tag is expected (different input samples, limited statistics) b c (b-bkgr) c different input events open: MARLIN (SH) full: MARLIN (BJ)
Differences arise from flavour tag part • further cross check proves that differences seen arise from the flavour tag part of the chain: • SGV: FORTRAN ZVRES + SGV tag-input calc’n + standalone flavour tag with old NN code • MARLIN: C++ ZVRES + Marlin tag-input calc’n + standalone flavour tag with old NN code • using same flavour tag version either test setup shows good agreement between MARLIN & SGV b c (b-bkgr) c Identical input events open: SGV full: MARLIN (standalone flavour tag)
Differences also seen in network outputs red: MARLIN flavour tag inputs fed into MARLIN flavour tag with new NN code black: MARLIN flavour tags fed into standalone flavour tag with old NN code c tag c tag (b-background)
Differences depend on NN format & code version • in the c(b-bgd) tag there is a • sizable fraction of jets which yield • large values in the standalone code • and small ones for the Marlin tag • these effects (also previous page) • depend on whether nets are read in • as text files or in XML format • and on which version of the NN code • is used for the standalone flavour tag • next: try to find a set of input values • for which we obtain different results • & inform Dave Bailey about the issues