1 / 7

Transcriber Agreement

Transcriber Agreement. Nash Borges Lisa Yung. Pr(a) – Pr(ch). k =. 1 – Pr(ch). Possible Metrics. 1 - Label Error Rate Time agreement Kappa statistic. Original. all feature. hybrid. May 14 th Set. first pass. second pass. May 28 th Set - First Pass. To Do List. Kappa statistics

kesler
Download Presentation

Transcriber Agreement

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Transcriber Agreement Nash Borges Lisa Yung

  2. Pr(a) – Pr(ch) k = 1 – Pr(ch) Possible Metrics • 1 - Label Error Rate • Time agreement • Kappa statistic

  3. Original all feature hybrid

  4. May 14th Set first pass second pass

  5. May 28th Set - First Pass

  6. To Do List • Kappa statistics • Give either/or labels 50% agreement • Allow for matching between two constrictions • Agreement during regions of all-feature trans. • Amount of time only one transcriber used feature based transcriptions • Use cost metric to differentiate between "close" and "far" disagreements

  7. Distances for Cost Metric • Place of constriction LAB, LAB-DEN, DEN, ALV, LAT, POST-ALV, RHO, VEL, GLO, NONE, SIL • Glottal state ST, IRR, VOI, A+VO, ASP, VL • Degree of constriction VOW, APP, FLAP, FRIC, CLO, SIL • Different costs for insertions/deletions?

More Related