160 likes | 324 Views
Meeting Tango February 2004 - ESRF. Archiving. Main Items. Historical Archiving Snapshots. What’s new : Historical Archiving. Support of new types Spectrum MySQL (classic insert) Oracle (classic insert) Image MySQL (load data from file) Oracle (link towards a file).
E N D
Meeting Tango February 2004 - ESRF Archiving
Main Items • Historical Archiving • Snapshots
What’s new : Historical Archiving • Support of new types • Spectrum • MySQL (classic insert) • Oracle (classic insert) • Image • MySQL (load data from file) • Oracle (link towards a file)
What’s new : Historical Archiving • Benchmarks : Configurations • Configuration 1 (number) • Number : 2500 = 5 x 20 x 25 • Period : 10 seconds • Duration : 0 seconds – database crashed… • Configuration 2 (speed) • Number : 105 = 7 x 3 x 5 • Period : 1 seconds • Duration : 15 hours • Configuration 3 (stamina) • Number : 105 = 7 x 3 x 5 • Period : 10 seconds • Duration : 100 hours
What’s new : Historical Archiving • Benchmarks : Results • Scalar : 100 scalars/sec = 2 Ko/sec • Spectrum (256 values) : 100 spectrums/sec = 170 Ko/sec • Image (501x501 = 251001 values) : 10 images/sec = 3 Mo/sec
What’s new : Historical Archiving • Benchmarks : Remarks • The "Refresher" (Atk component) crashes down • Cause : • Message while it is waking up • Consequence : • All the attributes polled by this component are not any more. • No more filing for these attributes. • Temporary solution : • One attribute per component !
What’s new : Historical Archiving • Benchmarks : Remarks • The Dbt behaviour (problems) • Cause : • DServer overload • DBT overload • Consequence : • Communications problem between DServers • In all cases, Dbt is overloaded • … snowball phenomenon • … DbtDServer crashes down !!
What’s new : Historical Archiving • Benchmarks : Remarks • The Dbt behaviour (solution) • Decrease the number of tangoTests (ORB capacity ?) • Decrease the number of Devices per DServer • Decrease the number of DServer per computer • Limitation upon the links DataCollector / Dhdb (Collisions ?) • 1 DataCollector linked to n Dhdbs • 1 Dhdb is linked to 1 DataCollector • No never refer to Dbt • Use of asynchronous mechanism • Problem : IOR lost !
What’s new : Historical Archiving • Benchmarks : Other Remarks
What’s new : Historical Archiving • Conclusion • Problems • Communications problem essentially (collision ?, ORB capacity ?) • Remain to do • Addition of supplementary modes and / or • Migration towards the « events » • Tool to show the data
What’s new : Historical Archiving • Documentation • Whole second reading and corrections • Translation in English • Remarks : • Problems during the load of a source code with Pogo (Use of the tabulations as marks…)
What’s new : Historical Archiving • Filing package • Purpose : Tests on the Lucia beamline (Swiss) • Included : • Script to install the HDB database (MySQL only) • … • Script to launch the devices
What’s new : Historical Archiving • Source Forge • All the source code were transferred on CVS • http://cvs.sourceforge.net/tango-cs/tango/jserver/archiving/ • http://cvs.sourceforge.net/tango-cs/tango/api/java/fr/soleil/TangoHdb/
What’s new : Snapshots • Three parts • Database (Structure and tables) done • Context part • Messages done • Actions done • GUI In progress • Snapshots part • Messages In progress • Actions In progress • GUI In progress
What’s new : Snapshots Interface used to create a new context
What’s new : Snapshots Interface used to create a new snapshot