1 / 37

IDL 7.1

IDL 7.1. Agenda. Upcoming Events and training IDL 7.1 Overview/Demo IDL 8.0 what’s coming Discussion options How is your team using IDL Tips for working with large data External programming Case Studies Your feedback for what IDL needs to be. Upcoming training classes and events.

mariah
Download Presentation

IDL 7.1

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IDL 7.1

  2. Agenda • Upcoming Events and training • IDL 7.1 Overview/Demo • IDL 8.0 what’s coming • Discussion options • How is your team using IDL • Tips for working with large data • External programming • Case Studies • Your feedback for what IDL needs to be

  3. Upcoming training classes and events • February 8th, Spectral Analysis, Herndon • March 3rd, Intermediate IDL, Boulder • March 17th, Scientific Programming, Herndon • March 24th, Scientific Programming, Boulder • May 19th and 20th, VISualize, IDL and ENVI User Group, WWF, Washington, DC

  4. Main Goals of 7.1 Release • Make it easier for all users to open and access common data formats in IDL. • Helpful in getting the new user started • Streamlines simple processes for experienced users • Make the visualization of these data easier • Expand on the concept of interactive visualizations begun with iTools • Drag and drop functionality for common visualization tasks • Simple GUI editing tools for common visualization manipulations • In short, make the simple tasks in IDL even simpler

  5. Make it easier to read data and interact with graphics Workbench File>Open menu One UI click to open and view known data formats Drag & drop visualizations Drag from project view or variables view Drag onto visualization icon or action icon Interactive graphics integrated in Workbench Extensible, user-defined Tools & Actions IDL 7.1 Interactive Visualization Perspective

  6. Tool Palette Actions • Allows you to specify how you want the visualization to function • Simple plot or a log plot or a scatter plot • Volume render with color table or with RGBa • You can drag and drop variables onto positional arguments in the action • You can create your own specific actions and edit existing ones • You can export and import actions to share with your colleagues or put on code contrib or use in a plugin

  7. IDL 7.1 Data Access Enhancements • File->Open File will automatically import data from files of known data types. • Better handling of SAV files – IDL will now automatically restore save file variables as well as save file executables via File->Open File • IOPEN provides the same access enhancements for programmatic inclusion • Users now have the ability to add/define custom readers for the workbench to automatically recognize and read specific data formats: read routine, query routine, register with the workbench in the idlextensions.xml file.

  8. BMP DCM GIF H5 ISV JP2/J2K/JPX JPG PCT SHP TIF TXT WAV Anything with a defined template (TEMPLATE= template) Any Registered Custom Readers Supported File Types for Auto-Open

  9. 7.1 iTool Enhancements • Continue to simplify the power of direct graphics with ease of use of procedural access • IOPEN routine has been added for automatic data import (it will determine file type and read in accordingly). • More programmatic access to iTool manipulations previously only accessible interactively: • Set and retrieve properties of iTool visualizations (ISETPROPERTY,IGETPROPERTY). • Set and retrieve data used to create an iTool visualization (IPUTDATA, IGETDATA). • Ceate annotations in an existing tool (IELLIPSE, IPOLYGON, IPOLYLINE, ITEXT). • Manipulate visualizations and annotations in an existing tool (ISELECT, IROTATE, ITRANSLATE, ISCALE, IZOOM). • IImage and IMap can now take a filename rather than a variable (leveraging the new IOpen routine). • Interactively push an iTool variables back to main level IDL

  10. 7.1 Enhanced Project Properties for Easier Application Distribution

  11. IDL 7.1 Core Enhancements • Data Access • Dataminer update: MySQL & 64-bit platforms • DICOM Module update: 64-bit Windows • AVI Read/Write plugin • 3rd party Ronn Kling • CSV file read, write, query • Scientific Data Formats • CDF-3.2, HDF4-r2.3, HDF5-1.6.7 (IDL 7.0.3) • 24-bit color PostScript

  12. IDL 7.1 Platform Support

  13. Platform Support Changes • 64-bit for Mac OS X 10.5.1 (Leopard) using and intel 64-bit CPU. (technically this came out as 7.0.4) • IDLffDicomEx and IDL DICOM Network Services on 64-bit Windows • 64-bit COM Export Bridge Functionality • Windows IDL command line • Solaris 10 x86_64 IDL command line only • No IDL Workbench or online help system • OMB FDCC (Federal Desktop Core Configuration) mandate for Windows XP & Vista

  14. IDL 7.1 Analysis • New Image Processing filters for noise reduction and image restoration • BAND_PASS, BAND_REJECT, LEAST_SQUARES, MEAN, ORDER_STATISTIC, WIENER

  15. Other 7.1 Enhancements • IDLdoc, a third party application, has been integrated to allow users to automatically create documentation and hover help text from code comments. • The Variable View makes it easier to delete variables, rename variables, change scalar values, and drag and drop variables into other views like editors or visualizations. • Other workbench features included with 7.0.3 like expanding and collapsing comments, context options for running code directly from the editor, and a Formatter Preference page for controlling editor appearance.

  16. Don’t Forget • Slither: IDLPython bridge • Enables running Python code within your IDL application • www.jacquette.com • IDL Advanced Math & Stats Module option • Integrates the IMSL™ C numerical library • Formerly known as IDL Analyst • Your own Plugin via the workbench!

  17. IDL 8.0 Strategy Plan Theme The evolution of IDL to add value for current customers and meet the modern expectations of new customers Goals Provide a new modern graphics API that is easy-to-use, yet fully capable for today’s scientific visualizations Add modern features to the language that simplify the interaction and update the syntax, constructs and data types Give the Workbench a makeover to streamline the ad-hoc user experience Internationalize the file I/O so Asian and Latin users can run IDL in their native language environments Revamp the User Assistance so users can quickly determine what they want to do from examples Proprietary Information 18

  18. Odds and Ends

  19. Tips for working with large data • IDL natively multithreaded, will take advantage of all processors/cores • IDL on a cluster, uses RT licenses, easy for “ridiculously” parellel problems • GPU processing, we have tools in our services group, this is for big data through put needs • Scientific Programming Class, learn how to use IDL language features to the fullest

  20. Calling C from IDL – See the External Development Guide • Think about training and consulting, should be a strong user • Connectivity Bridges, COM, ActiveX, Java Import and Export • Supported Inter-Language Communication Techniques in IDL • Gives pros and cons of each approach • Techniques that don’t use IDL’s API • Spawn • RPC • CALL_EXTERNAL • Techniques that use IDL’s internal API • Calling IDL as a subroutine from another program ("Callable IDL"). • Adding user-defined widgets to IDL widget applications • IDL system routine in another compiled programming language (usually C) and link it with

  21. ITT VIS – How we can help • Custom Software Developmentof applications built in IDL or with ENVI, and integration of IDL/ENVI software with other systems. • Commercialization of applications for image and complex data analysis and visualization, as well as data dissemination. • Creating intuitive User Interfaces to explore complex 2D, 3D, and 4D data. • Remote Sensing Science Support, including Algorithm Development, Testing, Verification, Ground Truthing and Field Support, Data Processing, Interpretation. • Automation of identification, measurement, data processing and classification tasks. • Implementation of Clustering, Parallel Processing, and GPU Off-Loading tasks. • Paid Technology Review for high performance evaluation. • Optimizationof software applications and combining IDL, ENVI, and 3rd Party applications to run with maximum efficiency for time critical computing tasks. • Ground Processing systems for ingest, calibration, radiometric correction, image quality tools and value added processing for image data products from airborne and space-based sensors, commercial, classified and other government programs.

  22. IDL and ENVI in Meteorology

  23. Large Meteorology Customers • BOM- Bureau of Meteorology(Australia) Weather forecasting for the Olympics, Mesoscale Analysis Scheme, numerical prediction model, diagnostic display system and a map based observational display system • Swiss Meteorological Institute • German Weather Forecast • Datamat (Italy) PC version of Digital Weather Radar Control & Processing Environment • Icelandic MeteorologicalOffice • Danish MeteorologicalInstitute

  24. Large Meteorology Customers • AFWA - Air Force Weather Agency, converted a large PV-WAVE space and world weather mapping application to IDL. • NOAA- Site License - Climate change studies & modeling Atmospheric chemistry, Ozone layer depletion research, Weather forecasting, Solar storm prediction, Space weather studies, Hurricane / El Niño research and predictions • NCAR - Site License - many 2D and 3D applications • JPL(Jet Propulsion Lab)- Using IDL to analyze and visualize data from MISR, AIRS satellites. • NASA Goddard - SeaDAS • Argonne National Labs - MM5 Viewer • Aerospace - DMSP tools

  25. SSD Weather Cell support Weather Data Cube Multi-dimensional Visualization • Whitepaper Design, Voice of Customer Meetings, Prototype Development

  26. EUMETSAT - EU Meteorological Satellite • Our Global Services Group built DAM, the Data Analysis and Monitoring software • Data Analysis and Visualization Software to integrate with Validation and Calibration Hardware and Software • Processing Chain: Data is Collected, Managed, Processed, Analyzed, and Disseminated • Solution: Services + ENVI + IDL • 4 functional components • Data Browser • Graphical Display Templates • Data Management Templates • Batch Reporting for Validation and Calibration • EPS Objective: State-of-the-Art performance and Accuracy throughout the Mission Lifetime

  27. NCAR - National Center for Atmospheric Research Thunderstorm Simulation

  28. NOAA has been using IDL for more than 15 years for a wide variety of research including: - El Niño/La Niña studies - Climate change studies & modeling - Atmospheric chemistry, data collection & research - Ozone layer depletion research & air quality studies - Weather forecasting - Solar storm prediction - Space weather studies - Hurricane research and predictions - Oceanography & ocean chemistry research NOAA – National Oceanic and Atmospheric Administration

  29. Dust storm in Beijing (4-19-2000)

  30. For TERRA-EOS program, ENVI is the tool of choice!

  31. MODISdata is in HDF format(Hierarchical data format)

  32. Features for Meteorology • Plots, Contours, Surfaces, Images,Volumes… • OpenGL Support - Interactive 2D and 3D Graphics • Mapping Tools • Animation • Interconnectivity with other components • Powerful Development Environment • Wide Use in Meteorology Community • Web dissemination • Image Processing • Extensibility of vertical applications • …

  33. Globe Temperature Data

  34. Initial Data 2D dataset in ASCII • Latitude, Longitude, Elevation, Temperature • Worldwide range -181.1505 -88.4254 6379.8779 210.4 -171.7536 -88.8214 6376.9424 209.5 -164.9497 -87.9617 6377.6724 208.6 -156.3159 -88.9221 6374.0708 207.8 -147.5161 -88.8466 6379.3926 207.1 -138.3586 -88.4253 6376.9170 206.7 -131.0185 -88.7888 6372.7861 206.6 -122.7701 -89.1594 6377.9980 206.8 -113.0113 -88.6244 6370.7715 207.2 Initial Data 3D grid data 3D Vertexes and Polygons 3D Gridding IsoSurface

  35. Earth Object Sphere Object Earth Object Image Object

  36. Result

More Related