1 / 58

Assessing Speed Camera Benefit Cost-Effective Road Accident Reduction or

Assessing Speed Camera Benefit Cost-Effective Road Accident Reduction or Flawed Analysis, Wishful Thinking and False Claims? Let’s look at the facts:- Idris Francis B.Sc. idrisfrancis@fightbackwithfacts.com 01730 829 416 07717 222 459 December 2013. Presenter’s Background

emiko
Download Presentation

Assessing Speed Camera Benefit Cost-Effective Road Accident Reduction or

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Assessing Speed Camera Benefit Cost-Effective Road Accident Reduction or Flawed Analysis, Wishful Thinking and False Claims? Let’s look at the facts:- Idris Francis B.Sc. idrisfrancis@fightbackwithfacts.com 01730 829 416 07717 222 459 December 2013

  2. Presenter’s Background • State Scholarship in Pure and Applied Mathematics and Physics, Llandysul • 1st Class Honours B.Sc. in Electrical Engineering, University College Swansea and Institution of Electrical Engineers Prize for Wales • 1960-62 Postgraduate research, Eng. Dept, University of Cambridge • 1963-65 Circuit Design Engineer, Leo Computers, London NW10 • 1964-96 Founder and Director, Flight Link Control Ltd, specialising in remote control of moving objects and later joysticks controls. • 1985-94 included writing computer relational database software for company accounts, production, costing and sales • Queens Award for Export Achievement, primarily based on an innovative joystick control which became the world standard for electric wheelchairs • 2000-date Many thousands of hours studying road casualty data and trends, claims for speed cameras benefit and the data on which they are based.

  3. "When you have worked out the answer, you must always ask yourself - does it make sense?“ The advice of Thomas Davies, my wonderful mathematics teacher in Cardiganshire in the 1950's, that I have followed ever since and found invaluable. Applying that simple test to the Alice in Wonderland world of speed cameras shows immediately and in many ways that claims of camera benefit make no sense whatever.

  4. Contents Basic Data Accident and casualty parameters and trends before cameras, and now where there are no cameras Partnership claims of camera benefit far exceeding what is ever possible Close to forty adverse camera effects, many applying across the country not just at sites Seriously flawed analysis that lead to claims of far greater benefit than would ever be possible What really happens at sites that would qualify for cameras have none How to use that information properly to assess camera benefit, if any Effectiveness and cost-effectiveness, in isolation and compared to other measures Much exaggerated DfT estimates if the values of accidents prevented Misleading legal advice provided by police and partnerships. This presentation ( including more detail) and other files are on the CD and may be copied freely.

  5. Main Causes of Long Term Downward Trends in Fatal and Serious Injuries • * Improvements of all kinds in vehicle design - better brakes, tyres, steering, road-holding, seat belts, air bags, ABS, crumple zones, stability systems • * Better roads and road surfaces, more motorways • * Slowing traffic growth, no longer rising, for the first time since WW2 • * Better and quicker medical and other help at accidents and later • *Fewer pedestrian casualties as car ownership widens • * Falling reporting levels of non-fatal injuries (down 25% in recent years) • * and others.

  6. Adverse Effects of Speed Cameras The file "Dangers" on the CD contains a long but far from complete list of the adverse effects of speed cameras including, sudden braking, tailgating etc. all of which can lead to crashes not only at camera sites but also across the country (because drivers do not necessarily know whether there will be a camera in the next few hundred yards). Following protests from Safe Speed and others, the DfT issued an Invitation to Tended for an investigation of these adverse effects but when asked by the presented a year later what progress had been made, replied that it had been cancelled because there be none! Fully documented on the CD – see “Adverse effects Investigation Cancelled. This despite not infrequent media reports of deaths and injuries caused directly by the presence (real or imaginary) of cameras, including cars and motorcycles braking so harshly that they leave the road and hit immovable objects such as trees, walls etc. It is clearly impossible to quantify these effects with any accuracy, but it is simply not acceptable that they are ignored not only by the DfT but also by camera partnerships.

  7. Significance of the Graphs and Patterns The DfT publishes a great deal of data but it is not possible to understand what is happening without seeing it in graph form. The patterns we have seen so far and others to follow show that while it is a matter of almost pure chance whether an accident happens at a particular place and time, in aggregate accident and casualty numbers had do contain patterns which allow us to understand not only what has happened and what will happen, but also what would have happened at camera sites had cameras not been installed – which is of course the only way to assess camera effect. Those patterns have been hiding in plain sight for many years, yet understanding and analysing them turns out to be not only almost childishly simple, involving only simple arithmetic and said graphs with no need for complex and questionable mathematical formulae, computer models or assumptions that may well be invalid. First though, some basic information on the real significance of speeds above limits in accident causation and how Partnerships and others claim far greater benefit than would ever be possible:

  8. DfT Table RAS50007 2011 Killed Seriously injured Contributory factor No % No % Road environment contributed 158 9 2,409 12 Vehicle defects 55 3 450 2 Injudicious action 498 28 4,604 23 Exceeding speed limit 242 14 1,378 7 Travelling too fast for conditions 226 13 1,759 9 Driver/rider error or reaction 1,18568 13,39566 Poor turn or manoeuvre 202 12 2,842 14 Failed to look properly 433 25 6,882 34 Failed to judge path or speed 200 11 3,186 16 Swerved 116 34 4,190 21 Impairment or distraction 426 24 3,152 15 Impaired by alcohol 166 9 1,386 7 Behaviour or inexperience 467 27 5,247 26 Careless, reckless or in 285 16 3,533 17 Pedestrian only 302 17 3,779 19 Total number 1,752 100 20,396 100

  9. Putting Speeding in Context • Stats19 causation data shows that speeding was involved in: • * 5.1% of all collisions • * 7.6% of KSI collisions • * 13.8% of fatal collisions • No speeding was involved in: • * 99% of child pedestrian injuries • * 94% of all injuries • * 95% of cyclist fatalities • * 99% of collisions with cyclists • 96% of motorcycle accidents • * Speed cameras cover 1% of rural road length and 3% of urban • It would therefore be literally impossible for speed cameras to achieve the 30/40/50/60/70% reductions often claimed for them, even if they eliminated all speeding – which they do far from achieve. (Indeed, at many sites, speeds actually rise.)

  10. Deaths Each Day in Britain (approximate) All Causes...........................................................1,800 Avoidable Hospital Deaths (infection, medical errors, neglect etc. ...............................................200 Suicides....................................................................10 Falls at home.............................................................7 Road Deaths, all kinds ..............................................6 As above, involving speeding ...................................1 Primarily caused by speeding...................................0.5 As above, on the 2% of roads with cameras ...........0.05 (0.003%) Might a visitor from another planet wonder why we are spending £100m a year trying to reduce 0.003% of deaths in this country, when the same money could save vastly more lives spent in other more cost-effective ways? Like mops, buckets and disinfectant? When being in a hospital bed is several hundred times per hour, more likely to result in accidental death than being in a car at 70mph on a motorway ?

  11. GoSafe’s Claim of £45,354,695 Benefit in 20011/12 The table on Pg. 17 of the report, showing a (ludicrously precise) total camera benefit of £45,354,695 carries a foot-note, “The savings are based on the reduction in 2011 in the number of casualties in Wales compared with the 1994/1998 average, at current live camera sites". That however is to ignore that over the same period KSI fell across Wales by 38%, despite 98% of roads having no cameras, and that the same would surely have happened at camera sites had they not had cameras. In any case none of those cameras could have had any effect on KSI in from 1999 to their installation and (as maximum benefit must be reached within months of installation, no further % reductions afterwards’ It is not clear what overall % reduction was used to calculate that figure but the 38% which would have happened anyway must surely account for a major part if it – perhaps 75% or £30m. Much the same applies to slight accidents, reducing benefit by a further £3m or so. Even that much reduced benefit is far too high however because the DfT’s valuations of accidents are themselves preposterous – see later. More detail on the longer version of this presentation on the CD

  12. Misleading Statements in GoSafe’s 2011/12 Report Paragraph 4 of the Introduction and again in the Executive Summary shows reductions in various casualties at camera sites, with the implication that they were due to the cameras. However most or all of those cameras would have been installed some years before and whatever effect they might have had would have levelled off after a few months or a year or so at most, making it impossible for those further reductions to have been due to the cameras. (That is not of course to say that whatever % reductions they achieved in their early years reversed, only that they did not and could not continue to increase many years later). "PERFORMANCE.....at camera sites is encouraging: by the end of 2011, KSI casualties had been reduced by 50.77%* compared with the 1994-1998 annual average. Four significant figure results from data which not accurate two! More seriously, the 50.77% fall in KSI at sites seems impressive until adjusted for the 38% fall on the 98% of roads that had no cameras, the same applies to the 61.27% fall at sites compared to 54% overall. The difference in the first case, of 23 KSI, might or might not be statistically significant bearing in mind variable reporting levels, the 2.5 child KSI in the second case is certainly not.

  13. More Discrepancies in the GoSafe Report for 2011/12 Further, as above, the effect of any camera necessarily starts when it is installed and reaches its maximum within a few months or at most a year - so any further reductions years after installation, right up to 2009-11 would have been nothing whatever to do with the cameras. For both reasons those reductions are seriously misleading. "Camera sites in 2011 showed a 69.64% reduction in the number of people killed or seriously injured". That statement is confusing and possibly in error, first because it fails to specify what baseline was used and secondly because, being well above the 50.77% previously mentioned, the figure implies a baseline well before 1994-98, which would of course be absurd. "Motorists are continuing to break the law at camera sites and this demonstrates the continued need for educational messages to motorists“ Might it not, equally or more so, demonstrate that the cameras are failing to reduce speeding?And if cameras don't what chance have educational messages?

  14. VALUE OF PARTNERSHIP WORK Here "misleading" is inadequate a word to describe serious misrepresentation extending to many millions of pounds. When false claims such as this are used, as they often are, to seek and secure new funding, it amounts in the presenter's view to fraudulent misrepresentation or any one of several related offences, including breach of duty of care. The clue is the footnote stating that "The savings are based on the reduction in 2011 in the number of casualties in Wales compared with the 1994/1998 average, at current live camera sites". As previously pointed out, 38 of the 50.77% fall in KSI over that period was due to long term trend, not to camera effect. Accordingly, the value of KSI benefit achieved should have been reduced by a factor of 50.77/12.77 = 4 to 1 and the £38m total should have been of the order of £9.5m, a reduction of £28.5m. The data for slight injuries is not to hand but the £7m quoted should probably be halved. making a total discrepancy of about £32m and leaving a notional benefit of about £13m. Even that however is absurd because the DfT values used are themselves wildly exaggerated - a matter which the presenter intends to take up with a Select Committee - in that the figures for "lost output" do not exist, they are fantasy - others always take the place of those unable to work, to meet that demand.

  15. Assessment Report 256 - Statistics on the Scottish Safety Camera Programme http://www.statisticsauthority.gov.uk/search/index.html?kw=|Scottish%20Governmentand on the CD Claims similar to those of the Wales partnership were summarily dismissed by the above Report which pointed out (in words more acerbic than the presenter would have thought possible in a public document) that the claims: 1/ Totally ignored long term trends 2/ Totally ignored regression to the mean (see later) 3/ Risked being seen as biased because it its authors were employed by the Partnership – whose newly appointed head statistician, then resigned. And more of the same. Anyone wishing to understand properly the ways in which camera benefits have been wildly exaggerated not only in Scotland but across Britain would do well to read the UK Statistics Authority’s assessment. And the same applies to Safer Roads Humber:

  16. Safer Roads Humber Annual Safety Camera Progress Report April 2010 – March 2011 59% reduction in the number of people killed or seriously injured at core safety camera sites in the Humberside Partnership area 42% reduction in the number of injury collisions at core safety camera sites in the Humberside Partnership area £73,223,760 saving in terms of killed or seriously injured9% reductionin the average speed and a 11% reduction in the 85th percentile speed 32% reduction in the number of vehicles exceeding the speed limit at camera sites.

  17. Safer Roads Humber annual report 2010- 2011Published March 2012The partnership has now been operating safety cameras for eight years and the annual report gives details of the partnerships performance at core safety camera sites……..Figures from the report show that, in the eight years since safety camera enforcement began, there has been a 59 per cent reduction in the number of people killed or seriously injured at the core safety camera sites. In real terms there are 411 people alive and well today that would have been killed or seriously injured if safety cameras had not been introduced.

  18. So far we have seen that, for the 63 sites at which enforcement started between April and August 2003: : much or all of the observed reduction at those sites would have happened anyway, without cameras, as it did across the 98% of roads across the country which have none it is clearly impossible, even if speeding were eliminated entirely for that alone to bring about reductions of more than 5% or so in KSI, let alone the 59% claimed in the Partnership Report reductions in speed and speeding have been minimal (which is why the Partnership prefers to use % not mph to make the numbers seem larger) a large part of the observed reduction happened in 2002 before the cameras went live between April and August 2003. in 2003 and 2004, after switch-on, KSI at those sites hardly changed it is not credible that cameras, having failed nothing for 16 to 21 months could then cause the steep fall in 2005 . since 2005 the trend has been slightly upwards in contrast to elsewhere

  19. We now turn to much the most important part of this Presentation, how properly to assess camera effect (if any) To do that however we first need to understand the seriously flaws in the simplistic method first introduced in the equally flawed Eight Area Trial of 2000/01 (full details on request, available early December 2013), and indeed how those defects have been increased over time by Partnerships continuing to claim further % reductions many years after cameras achieved their maximum effect.

  20. The New and Better Finney FTP Method The fundamental blunder in speed camera assessment from the beginning has been to ignore or downplay the significance of trend and regression to the mean to be able to claim credit for the cameras for the observed reductions. A case in point was the 4th Report of 2006 which admitted in the fine print that regression to the mean accounted for 75% of the observed falls in KSI after trend, leaving only 25% for camera effect’ - then chose to announce their findings without adjusting it. As recently as April 2013 the current Minister, Stephen Hammond, wrote to the presenter that: "while it would be desirable to include some explicit allowance for regression to mean, no reliable method had yet [in 2005] been established for doing so”

  21. That might have been true then, but is no longer. Following a meeting I obtained with the DfT in September to protest at their view, they now accept Dave Finney’s method ( (confirmed by the presenter’s analysis of 220,00 qualifying sites that never had cameras what Finney found at 75) is a valid way of assessing camera data and supposed benefit. The file “DfT endorses new method” on the CD provides full details, what follows is only a brief summary. Mr. Finney and I would be happy to work with the Welsh authorities to implement use this analysis on Welsh data.

  22. The Importance of accurate data, particularly timing of accident selection and camera installation Accurate timing of data is essential if the Finney Method is to provide accurate assessment of camera effect. Its results for 75 Thames Valley sites (no camera benefit whatever) were based on meticulously researched data that showed that at every single site the high levels of the site selection periods fell immediately (in the first quarter) to the same level as the pre-selection period and that planning and logistical delays invariably meant that cameras were not installed less than a year later. It also found that the Thames Valley Partnership - like Scotland and Humber - had been claiming as camera benefit KSI and PIC reductions that had (a) happened before camera installation (b) were clearly due to regression to mean and perhaps (c) (as Scotland and Humber certainly had) further reductions well after camera affect(if any) would have stabilised.

  23. Summary of Finney Method 1/ Ignore data in SSP, almost always unusually high 2/ Ignore data in RTM period, fall is back to normal, before camera 3/ Ignore data in year before SSP, likely to be higher than normal 4/ Ignore data 3 years or more after installation, no further reductions possible 5/ Use pre-SSP data, normally the same as in RTM data, as baseline 6/ For each site choose the most representative pre-SSP period 7/ Use data in assessment period to assess fall from pre-SSP level 8/ Camera effect is pre-SSP level to assessment level 9/ When completed analysis shows, as for Thames Valley, that cameras provide no meaningful benefit, dismantle them and sell them for scrap

  24. The presenter’s contribution to this method has been to confirm Finney’s findings on regression to the mean and its timing across the country and at all speed limits. The analysis used some 4m accident records to identify 220,000 examples of sites that would have qualified for cameras but which for the most part did not receive them. The following graphs, only a few examples of the thousands that can be produced from Excel spreadsheets of the KSI data, show to a compelling degree how consistent these changes are, in terms of the close match of the post-RTM to pre-SSP levels and the instantaneous fall after the SSP, well before any camera would be installed in response to the SSP data being found to justify it. It is now possible for the first time to assess camera benefit reasonably accurately and beyond dispute and put an end to years of serious misrepresentation by the authorities.

  25. How to identify 220,00 examples of sites that would have qualified for cameras This turned out to be surprisingly easy because police Stats19 records of reported accidents include not only when but where they happened, to within 10m as defined by two 5 or 6 digit grid numbers. It is therefore a simple exercise (indeed a child of 10 in possession of card indexes and a very great deal of patience could do it) to assign every accident to its correct place in a new database of accidents that happened in any specified area. The first 3 digits of the Easting and the Northing codes conveniently specify 1 km sq areas, approximating to normal camera sites, though it almost equally easy to specify smaller areas (for instance in congested regions where there are many roads and many accidents). Or indeed to select particular areas on the basis of their roads' characteristics. Having done that and assembled a database of some 300,000 sites in which at least one KSI accident had occurred over 25 years it is then a simple matter to select from them all examples showing at least 3 (or 4, or 5) KSI in any 3 year period, thus approximating to the threshold for camera installation – and then produce graphs of their results, as follows.

More Related