160 likes | 172 Views
GEANT.VALIDATIONPORTAL (aka GRID.VALIDATION) is a tool developed by Dmitri Konstantinov, Grigory Latyshev, and Witek Pokorski for physics validation and testing of Geant4 releases. It provides a user-friendly interface, secure storage of test results, overlay plots, comparison with experimental data, and statistical evaluation. Try it and share your feedback!
E N D
GEANT VALIDATIONPORTAL(aka GRID VALIDATION):STATUS Dmitri Konstantinov (IHEP, Protvino) GrigoryLatyshev (IHEP, Protvino) WitekPokorski(CERN) for Geant-Val developers
Motivation Continuous framework development, continuous physics model development. Validation is Important! Development of the project started in 2013. geant-val.cern.ch
How “geant-val” works • Run Geant test • Convert/combine results into “geant-val” input JSON objects. • Upload “geant-val” JSONs to database. • Use geant-val.cern.ch– regression testing, exp. data plots, stat evaluation Histograms Running test geant-valJSON Database Web Server geant-val.cern.ch
Prerequisites for demonstration Please open our application in your browser - geant-val.cern.ch If you connected to our website before, in order to pick up latest fixes/changes, please, bypass cached version with one of the following commands: geant-val.cern.ch
Front page CERN Single Sign-On for authentication, access controlallowing access to not “public” results Link to “main” page allowing comparison of different Geant versions “Special” page showing G4 exception for “sc” test Page allowing to see content of “validation” tables Page allowing to see content of “validation” tables geant-val.cern.ch
Available physics/regression tests interfaced to “geant-val” geant-val.cern.ch
“Release comparison” page – main user’s page Switching between tests “Reset” button Dynamically filled info from inspire ID Links to Inspire DB (paper) and HepdataDB(experimental data) geant-val.cern.ch
Exercise – release comparison, overlaying plots, comparison with data (I) Let’s repeat the following steps: • Select “test22-NA61” • Select “10.4.beta01” and “10.3.p01” • Select “proton” as “Beam” particle • Select “31” as “Beam energy” • Select “qgsp“ as “Physics List/Model” • Select “C” as “Target” • Select “proton” as outgoing particle • Select “D2(SIG)/DP/DTHETA” as observable geant-val.cern.ch
Exercise – release comparison, overlaying plots, comparison with data (II) • Select checkbox for “experimental data” if you want to compare with compatible experimental data. • and press “Submit” button! geant-val.cern.ch
Exercise – release comparison, overlaying plots, comparison with data (III) “Radio” button allows switching between static png plot and interactive JSROOT plots. “experimental” points are drawn by BLACK color geant-val.cern.ch
Exercise: ratio plots geant-val.cern.ch
First step towards statistical evaluation Click to rrder results by “chi2” value Simple chi-square for regression testing is introduced – experimental version: • Select “validation mode” • Select two versions of package • Select incoming particle • Select “observables” • Press “Submit” to calculate chi2/ndf Click icon to produce plot geant-val.cern.ch
data download formats Plain output format • “human readable” JSON output • Plain output is not final and will be adapted according to user’s requirements JSON format geant-val.cern.ch
Responsive design (powered by Bootstrap) Small but quite nice feature is “responsive” design!!! (comes for ~free with Bootstrap) Check how your website looks on small devices geant-val.cern.ch
Importance of geant-val • geant-val tool in production (current version since beginning of 2017) and used every month for physics validation of Geant4 releases (reference tags) • essential for the physics validation and testing • no release of Geant4 could me made without it- LHC experiments rely on it!!! geant-val.cern.ch
Conclusion We have developed and are continuing to improve a tool that validates Geant4 and: • has an intuitive GUI • is secure (never ending process) • provides persistent storage of validation test results • produces overlay plots and ratio plots for regression testing • compares simulations with experimental data • provides simple statistical test for regression testing Most importantly, this is an essential tool for physics validation! Geant4 developers and LHC experiments will benefit from results provided by “geant-val”! Try our application and send your feedback, ideas, suggestions to us!! geant-val.cern.ch