1 / 34

Powerful and Free: Open-source Software that Water Resources Professionals can use for Data Analysis and Visualization

Powerful and Free: Open-source Software that Water Resources Professionals can use for Data Analysis and Visualization. Kenneth R. Odom, PhD, PE Hydro Services - Reservoir Management Section Southern Company 2012 Alabama Water Resources Conference. What we’ll cover ….

thiery
Download Presentation

Powerful and Free: Open-source Software that Water Resources Professionals can use for Data Analysis and Visualization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Powerful and Free: Open-source Software that Water Resources Professionals can use for Data Analysis and Visualization Kenneth R. Odom, PhD, PE Hydro Services - Reservoir Management Section Southern Company 2012 Alabama Water Resources Conference

  2. What we’ll cover … • Gnuplot – data visualization, smoothing, curve-fitting • R – data visualization, probability, statistics, modeling, simulation, optimization, etc. • Text editing • Other open-source software

  3. Gnuplot command window

  4. Gnuplot example 1 FILE: sunspot_data.txt #year count 1700 5 1701 11 1702 16 1703 23 1704 36 1705 58 1706 29 1707 20 1708 10 … … gnuplot>plot sunspot_data.txt gnuplot>plot sunspot_data.txt with lines

  5. Gnuplot example 2 FILE: fairhope_data.txt FILE: fairhope_data.gp #DATE PPT TEMP 1931 01 15 75 1931 02 67 74 1931 03 193 73 1931 04 173 86 1931 05 110 90 1931 06 210 97 1931 07 421 97 1931 08 84 95 1931 09 80 97 … … reset set xdata time set timefmt ‘%Y %m’ set format x ‘%Y-%m’ set grid plot fairhope_data.txt using 1:3 with lines gnuplot>load ‘fairhope_data.gp’

  6. Gnuplot example 2 FILE: fairhope_data.txt FILE: fairhope_data.gp #DATE PPT TEMP 1931 01 15 75 1931 02 67 74 1931 03 193 73 1931 04 173 86 1931 05 110 90 1931 06 210 97 1931 07 421 97 1931 08 84 95 1931 09 80 97 … … reset set xdata time set timefmt ‘%Y %m’ set format x ‘%Y-%m’ set grid set style line 2 lt 1 lw 2 pt 4 lcrgb ‘blue’ set title ‘Maximum Monthly Event Precipitation’ set xlabel ‘Year-Month’ set ylabel ‘Precipitation (in)’ plot [‘1970 01’: ‘1975 12’][]fairhope_data.txt \ using 1:($3/100) w lpls 2 t ‘Fairhope’ gnuplot>load ‘fairhope_data.gp’

  7. Gnuplot example 3USGS Fish River near Silver Hill, AL FILE: fish_river_data.txt #DATE(1) TIME(2) CDT(3) FLOW(4) CODE(5) PPT(6) CODE(7) 2010-04-01 00:00 CDT 98 A 0.00 A 2010-04-01 00:15 CDT 0.00 A 2010-04-01 00:30 CDT 98 A 0.00 A 2010-04-01 00:45 CDT 0.00 A 2010-04-01 01:00 CDT 98 A 0.00 A 2010-04-01 01:15 CDT 0.00 A 2010-04-01 01:30 CDT 98 A 0.00 A … …

  8. Gnuplot example 3USGS Fish River near Silver Hill, AL

  9. Gnuplot example 3USGS Fish River near Silver Hill, AL FILE: fish_river.gp gnuplot>load ‘fish_river.gp’

  10. Gnuplot example 3USGS Fish River near Silver Hill, AL

  11. Gnuplot example 4USGS Village Creek at Ensley, AL FILE: village_creek.txt #DATE(1)TIME(2)CDT(3)FLOW(4)CODE(5)TEMP(6)CODE(7)SC(8)CODE(9)DO(10)CODE(11) 2012-08-08 00:00 CDT 44 P 26.1 P 435 P 5.6 P 2012-08-08 00:15 CDT 46 P 2012-08-08 00:30 CDT 46 P 2012-08-08 00:45 CDT 46 P 2012-08-08 01:00 CDT 46 P 25.9 P 422 P 5.4 P 2012-08-08 01:15 CDT 47 P 2012-08-08 01:30 CDT 53 P 2012-08-08 01:45 CDT 57 P 2012-08-08 02:00 CDT 58 P 25.8 P 417 P 5.4 P 2012-08-08 02:15 CDT 60 P 2012-08-08 02:30 CDT 58 P 2012-08-08 02:45 CDT 57 P 2012-08-08 03:00 CDT 55 P 25.6 P 426 P 5.4 P … …

  12. Gnuplot example 4USGS Village Creek at Ensley, AL FILE: village_creek.gp gnuplot>load ‘village_creek.gp’

  13. Gnuplot example 4USGS Village Creek at Ensley, AL

  14. Gnuplot resources • Website: www.gnuplot.info • Software • Examples • Documentation • Tutorials • Google ‘gnuplot’

  15. R – statistical computingwww.r-project.org

  16. R – ‘the old way’

  17. USGS field streamflow measurements FILE: granby_colorado_gage.txt • num date time ht q rating qChan width area vel • 485 1987-04-29 16:20 0.71 30.0 FAIR 30.0 29.0 23.0 1.30 • 486 1987-05-27 12:30 1.07 69.4 FAIR 69.4 31.0 33.1 2.10 • 487 1987-07-10 11:15 1.06 61.4 FAIR 61.4 31.0 33.0 1.86 • 488 1987-08-04 14:05 0.81 36.5 FAIR 36.5 28.0 25.4 1.44 • 489 1987-09-03 11:40 0.54 15.5 FAIR 15.5 26.3 18.0 0.86 • 490 1987-10-08 12:15 0.57 16.1 FAIR 16.1 27.0 18.3 0.88 • … • …

  18. Using R – ‘the new way’R-studio

  19. Cahaha River data

  20. Stateline data (Coosa River)

  21. www.rstudio.org

  22. R Commander

  23. R Commander

  24. R Commander

  25. R-stats books

  26. www.r-bloggers.com r

  27. emacs

  28. emacs

  29. emacs

  30. emacs

  31. Notepad ++

  32. Other software • Image processing: • Image J,Inkscape(similar to Illustrator), Gimp (similar to Photoshop) • Matlab “like” software • Octave, Sage,SciLab • Text editors • Emacs,XEmacs, Notepad2,Notepad++,PSPad,Gedit,Geany • Programming/Scripting • Python 2.7.3 (Python 3.0 is working but under active development) • ERIC is a good python IDE • IPythonandIPython notebook • http://vislab-ccom.unh.edu/~schwehr/rt/ (IPython, Emacs, R) • gawk (subset large data files, pattern searching) • Office productivity • LibreOffice(similar to MS Office) • Gnumeric(good standalone spreadsheet but lacks full documentation) • Abiword(standalone word processor)

  33. Contact information • Email: kodom@southernco.com • Phone: 205-257-7783

More Related