1 / 47

Steward

Steward. Statewide Traffic Engineering Warehouse for Archived Regional Data. Status Report: September 2008. Daily Reports. ETL Process. STEWARD Database. Daily Archive Data. Facility Data. Analysis Reports. Proof of Concept Project. Proof of Concept: March 2008. District 2 data

hollis
Download Presentation

Steward

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Steward Statewide Traffic Engineering Warehouse for Archived Regional Data Status Report: September 2008

  2. Daily Reports ETL Process STEWARD Database Daily Archive Data Facility Data Analysis Reports Proof of Concept Project

  3. Proof of Concept: March 2008 • District 2 data • Occasional manual data transfer by FTP • Basic reporting capability • Basic quality assurance • Traffic count demo • Internet demo • UF Campus based

  4. Reports

  5. Daily Reports • Daily conversion Report • Time covered • Orphan and null detectors • Polling interval distribution • Conversion History Summary (1 record per day) • Diagnostic Reports • Effective vehicle length distribution • Max flow rate at each station

  6. QA Reports • Mobility Management (TTI) Tests • Lane distribution • I/O continuity • Comparison with Statistics Office counts

  7. Analysis Reports • Daily Volume Summary for Freeway Lanes and Ramps • Lane Distribution Summary by Station • Link Continuity Report • Performance Analysis Report by Station • Level of Service Report

  8. Summary Reports(Future) Daily Performance Summary Monthly Performance Summary Annual Summary and Trend Analysis

  9. Travel Time Reliability Reporting(Requires discussion with Systems Planning Office) • Travel time reliability delay, based on 10 mph below speed limit vs congestion delay, based on TT index > 1.5. • Percent on-time arrivals • Must be geared to District’s TT link structure

  10. All reports are generated in CSV format to facilitate further analysis, compilation and plotting

  11. CSV Report with XML Header

  12. Past and Current Clients • Work-Zone Crash Analysis sponsored by the Southeastern Transportation Center • Analysis of Breakdown at a Freeway Ramp sponsored by National Cooperative Highway Research Program • Identification of Recurring Congestion by RS&H • Travel Time Reliability Reporting as part of Strategic Intermodal System management • Mobility Monitoring Program by Cambridge Systematics • Freeway Capacity Project sponsored by National Cooperative Highway Research Program

  13. Resources for Continued Operation and Expansion • UF CMS Project • FDOT Research Office Project • TERL Support Activities

  14. UF CMS Project ... • Present a series of stakeholder workshops • Expand to include additional SunGuide detectors • Operate the system to provide data and reports to agencies and researchers • Analyze the data to explore congestion modeling relationships

  15. FDOT Research Office Project • Integrate Functions with Other FDOT Data Management Programs • Transfer Operations to the TERL Center in Tallahassee • Automate and fine tune the transfer of daily archive data reporting processes. • Expand to Include Other Data Sources

  16. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  17. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  18. 3. Return to TMC by email 2. Scheduled Task Process the archive data files to perform ETL and diagnostic functions STEWARD Etc. D5 D4 Diagnostic Reports 1. Scheduled Task “Push” daily archive file to UF FTP D2 FTP sites set up for each District Automated Archive Transfer

  19. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  20. Working Paper CDW2008-1: Development of STEWARD Configuration Data for SunGuide Archives • Stage 1: Enables processing of daily archive data and diagnostic report generation • Stage 2: Enables loading of daily archive data into the STEWARD database • Stage 3: Enables full report generation

  21. Diagnostic reports indicating archive data problems and inconsistencies Stage 1: Develop basic facility configuration and verify the integrity of the archive data 1. Obtain sample archive files from the TMC 2. Extract basic facility configuration required to produce diagnostic reports 3. Process several days of archive data using the basic configuration 4. Modifications to facility configuration by SunGuide staff

  22. Reports for district review and refinement Stage 2: Expand the facility data configuration to include all data required for development of the STEWARD database 1. Add the data fields that can be extracted from the archive data or the district facility inventory 3. Process more archive data 2. Add the data fields that require individual attention in cooperation with the district

  23. Stage 3: Expand the facility data configuration to include all data required for report generation 1. Add the data fields that require individual attention in cooperation with the District 2. Test the report generation features Reports for district review and refinement

  24. District 2 Status • I-95 at Stage 3 (Proof of Concept project) • Data availability TSS: 6/28/07 ~ 2/6/08 TVT: 2/25/07 ~ 2/5/08 Incident: 5/10/06 ~ 2/5/08 • 133 TSS stations with RTMS detectors and 37 TVT links • District is adding detectors on I-295 and I-10

  25. District 4 Status • Stage 1 (TSS ), No TVT data yet • Data availability TSS: 5/18/08 ~ 7/21/08 TVT: None Incident: None • TSS stations: 100 detectors at I-95 and 30 at I-595 • Invalid time stamps on some records

  26. District 5 Status • Stage 1(TSS and TVT) • Data availability TSS: 4/24/08, 5/2/08, 5/3/08 TVT: 4/24/08, 5/2/08, 5/3/08 Incident: None • TSS stations: 143 detectors at I-4, 124 at I-95, 14 at SR-528 and 70 unknown • TVT links: 310 at Turnpike, I-4, I-95, SR 408, SR 414, SR 417, SR 423, etc • Some invalid data (e.g., negative speeds and occupancies)

  27. District 6 Status • Stage 1 (TSS and TVT) • TSS detector locations are not available • Data availability TSS: 5/26/08 ~ 7/21/08 TVT: 5/26/08 ~ 7/21/08 • TVT link locations: SR 826, I-75, SR 826, I-195 • Duplicate data records on some days • 2 min TVT sampling rate will not support 5 or 15 min aggregation

  28. District 7 Status • Stage 1 (TSS), No TVT data • TSS stations: 104 detectors at I-275 and 46 at I-95 • TSS data availability: 6/3/08 ~ 6/5/08 • No apparent issues in TSS data

  29. Modifications to Accommodate Additional TMCs • Station number: increase from 2 characters to 3 characters Impacts: SunETLUtility was revised All the transformations were rerun All the data were reloaded into the database All the materialized views were regenerated Steward web interfaces were updated Overall system operations were tested and verified step by step • Steward testbed was built to test the multiple districts. District 2 and 4 data were loaded and Steward operations were tested.

  30. Other Modifications in Progress • Conversion program from TSS data to traffic count are included in the Steward • Max numbers of lanes and ramp per station must be extended from 6 and 3. District 6 has several stations with 7 lanes or 5 ramps.

  31. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development

  32. Working Paper CDW2008-2:Conversion of SunGuide Archive Data to the FDOT Count Formats • Good potential for agreement • Mutual calibration and improvement of data quality • Supplement to District counts

  33. Traffic Counts Traffic Counts Lane counts (CSV) STEWARD Database Statistics Office ITSCounts Utility District Planning Office SPS ITS Traffic Counts

  34. Sample Traffic Count Plots

  35. Current Activities and Progress • STEWARD Operation • Automation of data transfer • Expansion to other SunGuide TMCs • Integration with traffic counts • Internet site development http://cdwserver.ce.ufl.edu/steward/index.html

  36. Home Page

  37. Selection Criteria

  38. Resources Page

  39. Maps

  40. Maps

  41. Facility and Station Selection

  42. Next Steps ... • Continuing the operation of STEWARD to capture the SunGuide archive data • Continuing our efforts to bring more SunGuide TMCs into STEWARD • Expanding the automated transfer of archived data to all districts • Coordinating with District Planning Offices to produce traffic count data • Improving the Internet interface to facilitate queries and report production

  43. Future Steps ... • Reporting Procedures • QA Procedures • Transfer to TERL • Crash Record Integration • Congestion Modeling • Workshop Presentations

  44. Updates ...

  45. Discussion ...

  46. Thank you.

More Related