1 / 31

NeXus and Collaboration DANSE kick-off meeting

NeXus and Collaboration DANSE kick-off meeting. Tony Lam, Darren Kelly & Nick Hauser Bragg Institute August 14-15, 2006. Congratulations from ‘Down Under’. Thanks to Brent Fultz driving DANSE to a successful NSF proposal Thanks to Mike McKerns and Taura Scott for organising the meeting.

ossie
Download Presentation

NeXus and Collaboration DANSE kick-off meeting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NeXus and CollaborationDANSE kick-off meeting Tony Lam, Darren Kelly & Nick Hauser Bragg Institute August 14-15, 2006

  2. Congratulations from ‘Down Under’ Thanks to Brent Fultz driving DANSE to a successful NSF proposal Thanks to Mike McKerns and Taura Scott for organising the meeting.

  3. NeXus • “The State Of NeXus” Physica B. In press (October 2006) • Downstream developments • Collaboration • Minimizing effort and maximising impact • Components • Using your own toothbrush in someone else’s bathroom.

  4. NIAC Meeting - October 2006 The next meeting of the NeXus International Advisory Committee will be held at the Lawrence Berkeley National Laboratory near San Francisco, California, USA. The meeting will be held from October 5 to 6, 2006, immediately following NOBUGS 2006. If you are interested in attending or proposing agenda item contact Andrew Götz. Minutes of previous NIAC meetings available on the mediawiki COME ALONG

  5. NeXus meta-DTD http://www.nexus.anl.gov/mediawiki/index.php?title=Main_Page NeXusBean http://www.webel.com.au/nexml

  6. Beanshttp://java.sun.com/products/javabeans/

  7. Cloning Wollemi nobilis. Discovered in 1994, 200km west of Sydney Claim to fame: one of the oldest and rarest trees Reproduces by cloning. Population <100. DNA of entire population is identical Dinosaurs may have eaten its leaves from http://www.abc.net.au/science/features/wollemi/default.htm

  8. And this is what a neutron beam instrument clone looks like dke@gumtree:~/software/au.gov.ansto.bragg/release/1.0> -rw-r--r-- 1 dke users 544 2006-08-08 12:58 ExampleLocalEchidna.java -rw-r--r-- 1 dke users 4443808 2006-08-08 12:58 bragg-base-1.0.jar -rw-r--r-- 1 dke users 9345780 2006-08-08 12:58 bragg-el-1.0.jar -rw-r--r-- 1 dke users 1531683 2006-08-08 12:58 bragg-models-1.0.jar -rw-r--r-- 1 dke users 1757674 2006-08-08 12:58 bragg-nexus-1.0.jar -rw-r--r-- 1 dke users 5509976 2006-08-08 12:58 bragg-sics-1.0.jar -rw-r--r-- 1 dke users 313898 2006-08-08 13:02 dom4j-1.6.1.jar -rw-r--r-- 1 dke users 365 2006-08-08 13:02 j2ee.jar -rw-r--r-- 1 dke users 358180 2006-08-08 13:01 log4j-1.2.13.jar

  9. Example dataflow diagram • A picture that’s worth a thousand questions… instrument info Selector energy bins filename filename times Energy NeXusWriter NeXusReader Selector time interval Bckgrnd raw counts Selector 20

  10. NeXML and DANSE DANSE is welcome to review and use: • UML and XSD representations of NeXus • NeXusBeans and XStream inside or outside as a NeXus server (using web services) or pyre component NeXusReader and NeXusWriter • Java code. How to reuse Java developments in DANSE. Jpipe or ORB? See Gumtree poster • We’d like to see the UML description of DANSE

  11. Data processing inside Gumtree Gumtree’s data processor • Uses SDO data representation • http://www-128.ibm.com/developerworks/java/library/j-sdo/ • Use of NXprocess for provenance • Extend NXprocess to provide unique ID’s for each process • Scope of processor background subtraction, geometric corrections and data reduction algorithms • Can be replaced by DANSE components

  12. Pyre in Gumtree

  13. “A scientist would rather use someone else’s toothbrush, than use their code…” ACA July 2006

  14. Component Component schematic properties component core name input ports output ports control 25

  15. Component Component schematic properties component core name input ports output ports control 26

  16. Why does anyone collaborate? Benefits of collaboration • “You scratch my back…”. We do bigger things and/or things that we otherwise couldn’t do as an individual organisation (unless your organisation has unlimited resources). • Higher quality and functionality. More ideas, more testing. • For science and for the community. Altruism and interoperability. We provide interoperability for the community (if it were profit driven, we’d do it to gain a share of the market – could you sell a printer without USB?)

  17. New generation of collaboration OPAL market survey, 2002 • Collaboration was beginning to appear in neutron scattering data acquisition or data analysis. IPNS and Los Alamos had a mature hardware and software collaboration. • EPICS and TANGO continue to be successful collaborations • Lower levels of functionality and quality than expected

  18. Why does anyone collaborate? Tips to good collaboration • Communication. Face to face preferred. Take opportunities for satellite meetings • Respect • Separate framework development from domain specific content. Decoupling software engineering from scientific content. • Provide good tools for collaboration e.g. wiki, content management system, subversion, bug and issue tracking • Collaborations require a manageable structure and clearly defined rules of engagement e.g. how are features of the framework edited? • Have adequate resources to enable collaboration. Create an economy to maximize outcomes e.g. deliverables of equal value

  19. Why does anyone collaborate? Tips to good collaboration • Clearly defined priorities within development team, visible to the community • Clearly defined milestones (dates and deliverables). Allowing stakeholders to make plans based on your plans.

  20. NeXus collaboration Suggested collaborations • Suggest the NeXus community has a full-time technical secretary for next 12-24 months, jointly sponsored by each stakeholder • Institutes that write NeXus files are data providers. NeXus provides an interface between data providers and data requirers • Suggest DANSE has representation on the NIAC as a stakeholder that requires NeXus • Suggest that DANSE and NIAC look at the X-ray community and imgCIF. NSF proposal submitted to integrate imgCIF and NeXus • Suggest that the data requirers (e.g. DANSE and the Gumtree processor) collaborate on defining NXprocess for data provenance

  21. There’s more to DANSE and GRID than large datasets and HPC DANSE and GRID have advantages for reactor sources too • Deployment. Users don’t have to try to load codes on their machines • Code reuse, testing, verification and validation. • Versioning of codes • Provenance and curation • Data access, virtual organisations • Data availability and curation • Bragg has an inventory of code, both in-house and external, that we would like to integrate into DANSE. Looking to the DANSE team to provide coordination of legacy code integration

  22. End presentation

More Related