310 likes | 500 Views
Automating ArcSDE Geodatabase Maintenance. 2011 IGIC Conference Muncie, Indiana Presenter: Trent Pell, GISP. History. MCCOG is a Metropolitan Planning Organization(MPO) MCCOG provides GIS and Planning support to Madison County Approximately 130,000 in population
E N D
Automating ArcSDEGeodatabaseMaintenance 2011 IGIC Conference Muncie, Indiana Presenter: Trent Pell, GISP
History • MCCOG is a Metropolitan Planning Organization(MPO) • MCCOG provides GIS and Planning support to Madison County • Approximately 130,000 in population • Approximately 86,000 land parcels • Approximately 450 sqaure miles • County/Community in transition • Largest City: Anderson
GIS Overview • Automation on a single SDE Geodatabase • Versioned w/global ID’s • Multiple Editors • RDMS is SQL Server 2008 R2 (processor license) • Windows 7 & Server 2008 R2 – 64 bit • ArcGIS Server 10sp1 Standard Enterprise Edition
Why Automate? • Performance • Streamlines process • After hours • Why not!
What Should be Automated? • Rebuild Database Statistics • Compress Database • Reconcile & Post database versions • Delete & Re-create Versions • Sync Database changes to Web Geodatabase
Process • Rebuild Statistics • Compress Database • Reconcile & Post versions to Default • Kill all connections to Database • Stop Web Services • Delete all versions • Compress Database • Rebuild Statistics • Re-create Versions
Rebuild Statistics • Analyze Tool • Updates database statistics of business tables, feature tables, and delta(adds & deletes) tables • Create model & export as python script • Run on client machine
Compress Database • SDE command line • Sdeversion –o compress –u sde –p password –i ServiceName -N • Batch file on server
Compress Database Uncompressed State Tree Compressed State Tree
Reconcile & Post Versions to Default • Reconcile Tool • Create model & export as python script • Run on client machine
Kill Connections to Database • SDE command line • sdemon -o kill -t all -p password -N -i Madison_Managed • Batch file on server • Stop WebServices accessing database • AGSSOM arcscript command • Batch file on server • cd C:\Users\tpell\Desktop\AGSSOMv10.0 AGSSOM.exe -x WebServiceName
Delete Versions • SDE command line • Sdeversion –o delete –V VersionName –N –u VersionOwnerName –p VersionOwnerPassword –i ServiceName • Batch file on server • Delete your QA version LAST!
Cleanup! • Compress database again • Re-run Analyze/Re-build Statistics • Re-Create Versions • SDE command line • Batch file on server
Automation • Utilize Windows Task Scheduler on both client and server • Allow ample time for each task to complete
Automation Time-Line • 1am - Rebuild Statistics • 1:30am - Compress Database • 1:45am - Reconcile & Post versions to Default • 2am - Kill all connections to Database • 2:15am - Stop Webservices • 2:30am - Delete all versions • 2:45am - Compress Database • 3am - Rebuild Statistics • 3:30am - Re-create Versions
Automation – Actions • Browse to necessary program or file • For python scripts browse to the python.exe • Python scripts require arguments • Argument is just the python file • For batch files just browse to the .bat file
One Step Further • Automate changes to Web based applications
Getting changes to the Web • Each dataset needs to be versioned with Global IDs • One way synchronization between internal Geodatabase and ‘Web’ Geodatabase
To the Web! • Stop all web services – AGSSOM batch file on server • Export, Compare & Import Schema Changes between Managed & Web Geodatabase – python script • Sync changes between Geodatabases – python script • Start Webservices – AGSSOM batch file on server
Automation Time-Line • 1am - Rebuild Statistics • 1:30am - Compress Database • 1:45am - Reconcile & Post versions to Default • 2am - Kill all connections to Database • 2:15am - Stop Webservices • 2:30am - Delete all versions • 2:45am - Compress Database • 3am - Rebuild Statistics • 3:30am - Re-create Versions • 3:45am - Export Replica Schema • 4:15am - Compare & Import Replica Schema • 4:45am - Sync Managed & Web Geodatabases • 5:15am – Start Webservices
Useful Tools • PythonWin • ArcScript AGSSOM tool • Geodatabase Toolset or GDBT • SDE command line is your friend
Lessons Learned • Communicate • TEST! • Make Backups • Local security settings • Ensure user on server has Log as a Batch Job privleges under Local Security Policy>User Rights Assignment • Be flexible with your time-line and implementation
Thank You! Trent Pell, GISP GIS Coordinator Madison County Council of Governments tpell@mccog.net 765-641-9695