80 likes | 209 Views
Persistency Framework News for ATLAS. Andrea Valassi (IT-ES) For the Persistency Framework team ATLAS Database Meeting , 7 th April 2011. Outline and summary. Recent developments and releases POOL, CORAL, COOL ( release s since Dec 2010 talk at ATLAS sw week )
E N D
Persistency Framework Newsfor ATLAS Andrea Valassi (IT-ES) For the Persistency Framework team ATLAS Database Meeting, 7th April 2011
Outline and summary • Recent developments and releases • POOL, CORAL, COOL (releases since Dec 2010 talk at ATLAS sw week) • Largest activity was on CORAL • Work in progress and open questions
LCG 59b for ATLAS (Jan 2011) • Main motivation: POOL, CORAL, COOL patches • Previously expected in Dec 2010 internal release for SPI (delayed) • Complete the port to icc, drop support for Windows vc7 and slc4 • Upgrade to ROOT 5.26.00e, Qt 4.6.3p1 • POOL 2.9.11 • Many fixes and enhancements for ATLAS in collection packages • Support ROOT 5.28 streaming optimizationsin RootStorageSvc • CORAL 2.3.14 • Avoid ORA-24327 loop on network glitch (bug #58522) • Give precedence to CORAL_AUTHENTICATION[DBLOOKUP]_PATH over current directory for XML file lookup (bug #76297) • Internal consolidation of C++ tests (CppUnit) and qmtest setup • [NB: the 2.3.13 internal tag and 2.3.12 CMS tag are not included in any LCG release] • COOL 2.8.8 • Improve handling of NaN floats and doubles (bug #72147) • For full details see the release notes on TWiki
LCG 60 for LHCb (Jan 2011) • Main motivation:upgrade in ROOT • Add builds with icc(for LHCb online) • Upgrade to ROOT 5.28.00 • Streaming optimizations in ROOT I/O (supported by POOL 2.9.11) • Mistake in ROOT builds adds a dependency on pcre (bug #77476) • POOL 2.9.11a • Rebuild of previous POOL 2.9.11 (for ATLAS in LCG 59b) • CORAL 2.3.14a • Rebuild of previous CORAL 2.3.14 (for ATLAS in LCG 59b) • COOL 2.8.8a • Rebuild of previous COOL 2.8.8 (for ATLAS in LCG 59b) • For full details see the release notes on TWiki
LCG 60a for ATLAS (Feb 2011) • Main motivation:upgrade in Frontier client and ROOT • Upgrade to Frontier client 2.8.0 with performance optimizations • Upgrade to ROOT 5.28.00a • Fix pcre dependency issue (bug #77476) • Fix segmentation fault for empty containers (bug #77747) • POOL 2.9.12 • StorageSvc patch to allow writing built-in types via PersistencySvc • RootStorageSvc patch to adapt to ROOT fix for segmentation fault • CORAL 2.3.14b • Rebuild of previous CORAL 2.3.14a (for LHCb in LCG 60) • COOL 2.8.9 • Fix thread reentrancy issues in getenvand setenv (bug #78519) • For full details see the release notes on TWiki
LCG 60b for ATLAS (Mar 2011) • Main motivation:upgrades in ROOT and Qt • Upgrade to ROOT 5.28.00b: fix I/O crash for vectors (bug #79235) • Upgrade to Qt 4.6.3p2: fix corrupted headers (bug #79099) • POOL 2.9.13 • RootStorageSvc and CollectionUtilities patches from/for ATLAS • CORAL 2.3.15 • Several fixes in OracleAccess • Avoid retrial loop if “ORA-28001 password expired” (bug #77440) • Throw (do not return false) if OCI fails in Cursor::next (bug #78178) • Internal changes in handling of different schemas • COOL 2.8.9a • Rebuild of previous COOL 2.8.9 (for ATLAS in LCG 60a) • For full details see the release notes on TWiki
CORAL “network glitch” issues • Different issues reported by all experiments • e.g. ORA-24327 “need explicit attach” in ATLAS/CMS (bug #58522) • Fixed with a workaround in CORAL 2.3.13 (released in LCG 59b) • e.g. OracleAccess crash after losing session in LHCb (bug #73334) • Fixed in current CORAL 2.3.16 candidate (see below) • Work in progress since a few months (A.Kalkhof, R.Trentadue, A.V.) • Catalogued different scenarios and prepared tests for each of them • Prototyped implementation changes in ConnectionSvc and plugins • Current priority: fix crashes when using a stale session • May be caused both by network glitch and user code (bug #73834)! • A major internal reengineering of the plugins is needed (replace references to SessionProperties by shared pointers) • Done for OracleAccess in 2.3.16 candidate, pending for other plugins • The patch fixes single-thread issues; MT issues are still being analyzed • Next: address actual reconnections on network glitches • e.g. non serializable R/O transaction: should reconnect and restart it • e.g. DDL not committed in update transaction: cannot do anything
More work in progress • Address recent bugs reported by the experiments • e.g. performance penalty from COOL exceptions (bug #79937) • API extensions to CORAL and COOL in the pipeline • e.g. many payload per IOV, replace ATLAS CoraCool (task #10335) • This breaks binary compatibility to previous releases • When will be a good time for ATLAS (offline/online) to release this? • Reviewing other pending requests for enhancements to plan ahea • What are the highest priorities from ATLAS (e.g. in COOL)? • CORAL performance studies and optimizations • e.g. comparison of Frontier and CORAL server • e.g. studies of solid state disks with IT-DB • Is there any other R&D that could be useful for ATLAS? • Prepare future changes in the development infrastructure • Port from CMT to cmake (with SPI and LHCb) • Move out of CVS eventually (to start with, of “LCG CVS”)