1 / 44

A view from the auditor

Patient Safety in Radiation Oncology: Australian Edition. A view from the auditor. Melbourne 5 th October 2012 Ivan Williams , Joerg Lehmann, John Kenny, Jessica Lye, Leon Dunn. Why use / trust an auditor ? . Defensive (negative) rationale. 1045 patients. International Context.

edita
Download Presentation

A view from the auditor

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Patient Safety in Radiation Oncology: Australian Edition A view from the auditor Melbourne 5th October 2012 Ivan Williams, Joerg Lehmann, John Kenny, Jessica Lye, Leon Dunn

  2. Why use / trust an auditor ?

  3. Defensive (negative) rationale 1045 patients

  4. International Context • Numerous international examples of radiation oncology accidents • Analysis has shown that most systemic errors could have been detected by independent external audit • International audits have all found issues which needed to be resolved

  5. Why audit “Firstly and most directly, in every dosimetry audit programme, measured doses have been observed and reported which have been outside the required tolerances, in some cases significantly so.” Thwaites DI, SSDL 58, June 2010 Izewska J, et al., SSDL 58, June 2011 Ibbot, G.S., Followill, D.S., SSDL 58, June 2011.

  6. Positive rationale A properly constructed auditing program has resources beyond the capacity of any (many?) radiotherapy facilities. • Time • Dedicated staff • Dedicated equipment • Technical expertise • Oversight panels with professional experts The ACDS program has expertise and abilities beyond the capacity of many radiotherapy facilities within its area of audit

  7. Example I: Time

  8. Example II: Technical expertise Courtesy R.Ganesan, P Harty.

  9. Example III: Equipment Courtesy R.Ganesan, P Harty.

  10. Positive rationale: Oversight MOU Department of Health and Ageing ARPANSA (CEO) Formal Responsibility CAG Branch Head Medical Radiation ACDS Advise Approval of Documents Daily Administration Facilities & Professional Organisations Auditors

  11. Technical Expertise: OSLD commissioning • Al2O3:C (Sapphire) nanoDotTM OSLDs • Size: 1x1x0.2 cm3 • Retractable Active element: 5 mm diameter, 0.2 mm thick • Material: Aluminium Oxide doped with Carbon • Bar-coded for tracking 1.0 cm 1.0 cm

  12. Commissioning - Overview • Reproducibility • Signal depletion during readout • Reader stability • Fading • Linearity • Energy dependence Why? Accurate calculation of absorbed dose requires a correction for each of these. Kf, Kl, Ke, Kr

  13. Signal depletion per read • Each readout of the dosimeter • depletes the signal by 0.028%. • Consequence: Each dosimeter can be re-read a number of • times and corrected to reduce readout uncertainty.

  14. Linearity • Decrease in sensitivity as the absorbed dose to the nanoDot OSLD increases. • The sensitivity = cGy per unit signal. • Supralinear response with the degree of supralinearity being dependant on the accumulated dose.

  15. Energy Dependence 2.8 % w.r.t response at 6MV Slight energy dependence for MV photons up to 1% relative to response at 6MV Consistent with (Aznar et al., 2004; Jursinic, 2007; Viamonte et al., 2008), along with the manufacturers stating that there is little to no energy dependence. Electron beams show similar dependence (1 – 2%) with a larger measurement error associated with higher energies (18 – 20 MeV)

  16. The absorbed dose can be directly calculated using the following equation: Daudit= [(Counts.kr –Counts(bg).kr(bg).kf(bg)) kf] ECF.S.kE.kL • ECF is the individual element correction factor defined as the ratio of the mean batch counts, after 100 cGy irradiation, to the individual OSL counts, after 100 cGy irradiation. • S is the batch sensitivity, in cGy/counts, to 100 cGy of 6 MV photons. • kEis the energy correction to account for the slight energy dependence in OSLD response relative to 6 MV photons. • kLis the non-linearity correction to account for the non-linear sensitivity of the OSLD, normalized to the sensitivity at 100 cGy. • kris the reader correction to account for the daily variation in the OSLD reader. • A reader correction, kr(bg), is also applied to the background signal. • kfis the fading correction to account for the reduced signal that occurs between irradiation and readout date. • A fading correction, kf(bg), is also applied to the background signal from the initial ECF measurement. "

  17. Block Factors

  18. The ACDS: An auditing program In July 2010, the Australian Government funded a trial initiative to provide external, independent dosimetric verification for Australian radiotherapy centres: The Australian Clinical Dosimetry Service, ACDS. Housed within Australian Radiation Protection and Nuclear Safety Agency, ARPANSA, under a Memorandum of Understanding, MoU. Analysis of the service will be conducted in the third year to determine the outcomes of the ACDS A decision will be made whether to continue, modify or terminate the program based on the outcomes

  19. ACDS trial Fundamentally To increase the safety of radiotherapy within Australia via: • Three level audit – Level I, II and III. • National coverage • Private and public clinics • Interaction with professional colleges – Level Ib The service is free and voluntary Within MoU Extant to MoU

  20. Australian Context: Risk contributors • 50000+ Australians treated per year • On-going roll-out of new radiotherapy clinics and updating of older machines – technology • Detection of errors within modern machines can be more difficult in modern cancer therapies • Australian is BIG - logistics • Sparse population and large cities – regional centres, country centres and some metropolitan centres do not have local support • Staff shortages

  21. ACDS Audit Levels Level I: Linac output under reference conditions Level II: Treatment planning and delivery Level III: End-to-End test Diagnostic Imaging Target Outlining Treatment Planning Beam Calibration Patient Setup Treatment Delivery Record and Verify Level I Level II Level III Based on T.Kron et al., IJROBP 52(2), 566–579, 2002

  22. Audit reporting • based on auditors absolute measurement uncertainty () • action level: 2, failed audit > 3 • reporting to center: “Dose is 0.7 % high with a 2 of 4.2%”

  23. Lung / Thorax Methodology & Design Pelvis Breast H&N 4D Planning / Delivery Intensity Modulated Level III Audit Dose to Patient Inhomogeneity Calc Algorithm Targeting Simulation Phantom geometry Beam Modelling Treatment Delivery Level II Audit Dose Delivery / Dose Calculation Level I Audit Dose to Water All audit rest on the fundamental dosimetry, however, as the investigation approaches the dose to patient, the multiple factors affecting the dose to the patient must be considered.

  24. Methodology & Design Lung / Thorax Pelvis Breast Dose to Patient H&N 4D Planning / Delivery Inhomogeneity Calc Algorithm Intensity Modulated Level III Audit Targeting Simulation Phantom geometry Beam Modelling Treatment Delivery Level II Audit Dose Delivery / Dose Calculation Level I Audit Dose to Water With an on-going audit program, such as the ACDS, a variety of Level II audit test capabilities provides a strong foundation for Level III audits and a fall-back approach when questionable Level III outcomes arise and must be investigated.

  25. Methodology & Design Lung / Thorax Pelvis Breast Dose to Patient H&N 4D Planning / Delivery Inhomogeneity Calc Algorithm Intensity Modulated Level III Audit Targeting Simulation Phantom geometry Beam Modelling Treatment Delivery Level II Audit Dose Delivery / Dose Calculation Level I Audit Dose to Water Similarly, issues arising with a Level II audit may be investigated and resolved with a Level I

  26. Level I Passive dosimeter, TLD/OSLD, placed in the clinical beam in a regular, reproducible environment with well understood conditions. External audit. Was TLD (IAEA approach), changing to OSLD for logistical and operational reasons in July 2012 Required: 60% of all linacs in Australia. To-date: ~50% Expected: ~100%

  27. 6 MV 10 - 15 MV 18 MV

  28. Level Ib– by consumer demand On-site measurement with chamber for photons and electrons Required in many European Nations, Required by Australian Radiation Oncology Practice Standards, criterion 15.1. Recombination, polarity and output Organisation supplies water tank, beam data ACDS supplies chambers, electrometer, meters, cables ...

  29. 6 MV ≥ 10 MV 6 MeV 8-9 MeV 12 MeV 15-16 MeV ≥ 18 MeV

  30. 6 MV ≥ 10 MV 6 MeV 8-9 MeV 12 MeV 15-16 MeV ≥ 18 MeV

  31. Level II Diagnostic Imaging 3D Treatment Planning Patient Setup Treatment Delivery Record and Verify 2D array of detectors placed in the clinical beam in a phantom of solid water. Lung slabs are added and measurement is compared with predictions from the computer planning system. Outcomes are derived from the spatial and dosimetric difference between the predicted and measured doses.

  32. Level II – Basic Design Required: 40 % of all linacs in Australia. To-date: Testing and field trials Expected: ~40 %

  33. Level III Entire process check from CT to treatment with a human-like plastic phantom. Outcome is obtained from the spatial and dosimetric difference between measurement and prediction. Required: 15 linacs within Australia. To-date: 9 linacs audited Expected: 20+ linacs

  34. Level III Diagnostic Imaging 3D Treatment Planning Patient Setup Treatment Delivery Record and Verify 1 2 3 4 6 5 8 7 9 10 Humanoid Phantom (Ann D Roger) goes through the complete chain of procedures a patient experiences in Radiation Therapy. CIRS thorax phantom

  35. Level III Radiation Therapists should conduct each of the steps in keeping with routine clinical practice so that the audit assesses the actual patient process.

  36. Level III Dose Tolerances • measurement uncertainty () cannot be determined with sufficient accuracy in the given complex geometry • clinical acceptability (5%) is used as a starting point for 3 • points in low dose areas / clinically insignificant areas / not well defined areas are reported but not scored (RNS) •  and reporting will be re-evaluated over time as data comes in with the goal of catching outlying results

  37. Level III – case 2 Field: 6x, 10 cm x 15 cm 45° wedge Prescription: 2 Gy to Point 1 average (min, max) 1 2 3 4 6 5 8 7 9 10 •  adjusted for points in low dose areas • Global reference is used instead of local

  38. Level II underpinning Level III Example fields

  39. Recommendation I Review the accuracy of all barometers used for clinical dosimetry: Ensure that they are calibrated by a NATA accredited service, which is accredited for barometers. Ensure that the barometer(s?) is re-calibrated according to instructions. 1 % error in pressure ~ 1 % error in dose

  40. Early lessons learned • Air pressure issues • Barometer not calibrated (properly) or faulty • Airport pressure • Equipment (ionization chambers) problems • Outdated styles • Slightly damaged  Solvable administrative problems • Understanding of calibration / QA process • Staff changes • Long living spread sheets – routine QA • Wrong calibration factor used

  41. Successes & Challenges • Level I – ACDS will overshoot 100*% v 60% (accepted by DoHA) • Level Ib – Outside MoU (accepted (commended?) by DoHA) • Level II – ensure the ACDS hits target of 40 % • IMRT – Require plan for future • Prepare for review = prepare for post 2014 • External Professional Expectations/Desires 100 % = >95 %

  42. Acknowledgements RamanathannGanesan Peter Harty David Webb Duncan Butler Chris Oliver Peter Johnston 'The Australian Clinical Dosimetry Service is a joint initiative between the Department of Health and Ageing and the Australian Radiation Protection and Nuclear Safety Agency' John Kenny Jörg Lehmann Leon Dunn Jessica Lye Tomas Kron Abel MacDonald Alison McWhirter Tracey Rumble

More Related