1 / 49

What’s the reading on the air supply? Repeat the incident address.

Modified Rhyme Test DETERMINATION OF COMMUNICATION PERFORMANCE TEST FOR SPEECH CONVEYANCE AND INTELLIGIBILITY OF CHEMICAL, BIOLOGICAL, RADIOLOGICAL AND NUCLEAR FULL-FACEPIECE AIR-PURIFYING RESPIRATOR STANDARD TEST PROCEDURE. What’s the reading on the air supply? Repeat the incident address.

george
Download Presentation

What’s the reading on the air supply? Repeat the incident address.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Modified Rhyme TestDETERMINATION OF COMMUNICATION PERFORMANCE TEST FOR SPEECH CONVEYANCE AND INTELLIGIBILITY OF CHEMICAL, BIOLOGICAL, RADIOLOGICAL AND NUCLEAR FULL-FACEPIECE AIR-PURIFYING RESPIRATOR STANDARD TEST PROCEDURE

  2. What’s the reading on the air supply? Repeat the incident address.

  3. “And it don’t look good. Who ya gonna call?”

  4. “Open the relief valve only after I park (mark) the control wheel.”

  5. “What’s your take on the soil (oil) assessment?”

  6. “Thirty one to base …….Advise on status of jaw (saw), over…”

  7. “Let’s get a couple of MOPPS (cops) here….”

  8. The Modified Rhyme Test A Current Application NIOSH National Institute for Occupational Safety and Health DETERMINATION OF COMMUNICATION PERFORMANCE TEST FOR SPEECH CONVEYANCE AND INTELLIGIBILITY OF CHEMICAL, BIOLOGICAL, RADIOLOGICAL AND NUCLEAR FULL-FACEPIECE AIR-PURIFYING RESPIRATOR STANDARD TEST PROCEDURE

  9. An application of the Modified Rhyme Test • ISO 9921 standard on the “Assessment of Speech Communication” defines speech intelligibility as: “a measure of effectiveness of understanding speech”. • Commercial products that require assessment of speech intelligibility rely on specialized speech tests for meeting published standards or for labeling products • Unlike typical audiological speech tests, these tests are not performed in an audiometric test room • The tests include both the test administrator (speaker) and the subjects within the same acoustical environment. • Commercial applications that require ANSI or NIOSH approval ratings, will use the MRT as part of their certification process.

  10. Typical Applications of the Modified Rhyme Test for Evaluating Speech Intelligibility • COMMUNICATION PERFORMANCE FOR HEARING PROTECTION

  11. An current application of the Modified Rhyme Test DETERMINATION OF COMMUNICATION PERFORMANCE TEST FOR SPEECH CONVEYANCE AND INTELLIGIBILITY OF CHEMICAL, BIOLOGICAL, RADIOLOGICAL AND NUCLEAR FULL-FACEPIECE AIR-PURIFYING RESPIRATOR STANDARD TEST PROCEDURE NIOSH Procedure No. CET-APRS-STP-CBRN-0313 Rev. 1.1 Date: 22 December 2005

  12. Modified Rhyme Test • The intelligibility of a speech output device is an important predictor of user acceptability. • Testing methodologies use human beings, rather than electronic test instruments, to assess speech communication systems. • A number of specialized word lists are commonly used for testing various aspects of speech communication

  13. Modified Rhyme Test • At present, the American National Standards Institute’s approved procedure (ANSI S3.2-1989, “Method for Measuring the Intelligibility of Speech Over Communication Systems”) specifies three: * The Modified Rhyme Test * The Diagnostic Rhyme Test * Set of twenty Phonetically Balanced Word Lists

  14. Implementation of a A Standard Test Procedure • Primary objective of this test in this application is to evaluate the ability to transmit intelligible human speech while wearing full face-piece air-purifying apparatus • The use of ANSI test procedures is to establish a uniform protocol for establishing an acceptable level of speech conveyance and intelligibility • The test procedures are designed to asses a listener’s ability to comprehend a set of single syllable words within a controlled test environment • Single syllable words– short words that probably would be used in an emergency situation • Word tests that are suitable for single syllable words include segmental evaluation tests

  15. Modified Rhyme Test Evolution • Diagnostic Rhyme and Modified Rhyme are widely recognized segmental evaluation tests • Rhyme tests are available for various languages • AT&T and Bellcore and other manufacturers have developed their own segmental evaluation lists to evaluate their own products • The Modified Rhyme Test – This test is a segmental evaluation test that developed from the Diagnostic Rhyme Test (DRT). • To examine it’s evolution we’ll briefly look at the DRT

  16. Segmental Evaluation Methods • Segmental evaluation methods assess a single segment of phoneme intelligibility • Use monosyllabic words • Only single consonants are tested • Vocabulary is fixed and public • System designers can tune their tests by manipulating the order of the word pairings

  17. Diagnostic Rhyme Test • Diagnostic rhyme test was developed by Fairbanks in 1958 • It uses a set of isolated words – 96 word pairs • Tests for consonant intelligibility only in initial position so word pairs differ by a single acoustic feature in the initial consonant • Word pairs evaluate six phonetic characteristics • Listener hears one word at a time, then marks one of two possible answers on a corresponding answering sheet

  18. Response Methods for DRT and MRT • The response methods for both tests are closed. • In standard audiology tests, we look for an open response; listener repeats what he/she thinks to have heard. • A closed response offers the listener some alternative from which a selection has to be made. • This is the case with the modified rhyme test (House et all,1965) where the listener selects a word from a list of 6 possibilities. • The Diagnostic Rhyme Test (DRT) is based on only two alternatives

  19. Response Methods - Considerations • A closed response paradigm has a simple learning curve for listeners. • An open response, especially when used with nonsense words, requires extensive training. • An open response test is reported to offer a better discrimination assessment between various transmission conditions.

  20. Diagnostic Rhyme Test

  21. Diagnostic Rhyme Test

  22. Diagnostic Rhyme Test

  23. Modified Rhyme • The Modified Rhyme Test (MRT) presented by House in 1965. • The test consists of 50 sets of 6 one-syllable words which makes a total set of 300 words. • Closed-response test-listener identifies a single syllable word from a choice of six words

  24. Modified Rhyme • Tests for consonant intelligibility in both initial and ending position so word pairs differ by a single acoustic feature in either the initial consonant or the ending consonant. • Words have the same vowel pattern between the beginning and ending consonant patterns. • For example: went, sent, bent, dent, tent, rent. • same, save, safe, sale, sane, sake

  25. Modified Rhyme • Any of the six words can be the target word and a carrier phrase, such as "Mark the word test word," is usually used. • The carrier sentence assures that the reverberant field is excited prior to the test word being spoken, so that its effects are properly accounted for in the test. • It also allows dynamics processors such as automatic gain controls or compressors to activate and stabilize.

  26. Table 1. The six-word lists of the Modified Rhyme Test

  27. Overview of Test • For this test, there are human speakers and human listeners. • Both types of subjects, speakers and listeners perform this test fully suited in their respective respirator gear. • The auditory testing is administered by human speakers to human listeners. • All participants, speakers and listeners, are physically located within the same test environment. Noise is introduced into this environment during the test.

  28. Testing Setup • Eight human subjects are required for this test • The eight test subjects are divided into a listener group comprised of one female and two males (three subjects) and a speaker group consisting of one female and four males (five subjects). • All test speakers and listeners shall have English as their native language

  29. Testing Setup • Each subject shall is sized and fitted for the CBRN APR per manufacturer's instructions. • The subjects participating as listeners shall have normal hearing as defined in Section 5.3 of ANSI S3.2 - 1989 • A normal hearing test shall be administered by the test administrator to ensure eligibility of human subjects.

  30. Testing Setup • The five test speakers shall not have facial hair or any conditions that may cause interference with the seal of the respirator face piece. • Subjects shall have no obvious or strong regional accents. • Prior to beginning any testing, all measuring equipment to be used must have been calibrated in accordance with the manufacturer's calibration procedure and schedule

  31. Testing Setup • The room selected to perform the MRT shall be of ample size to comfortably house all the test equipment indicated in Figure 1 and the personnel associated with the test. It shall be free of external noise interference and be kept at a comfortable ambient temperature of approximately 72°F/22.°C. • The test equipment shall be arranged in accordance with the diagram of Figure 1. The loudspeakers shall be positioned such that their forward axes are oriented toward one another at a height of approximately 29.5 in (74.9 cm) from the floor and they are 9 ft +0.5/-0 ft (2.7 m +0.2/-0 m) from the center of the sound field between the test speaker and listeners.

  32. Modified Rhyme Test Setup

  33. Testing Setup • The test administrator shall be seated in the center MRT listener's position and instruct the speaker to begin reading the word list using the carrier phrase "The word is (list word)" and a voice level of 75 dBA to 85 dBA as indicated on the sound level meter positioned before them. • The speaker shall be instructed to read without placing unusual emphasis on any stimulus word at a rate of approximately one word every 6 seconds. • During reading of the word list, the test administrator will monitor the "A"-weighted output volume of the speaker at the listening position and provide feedback as to the loudness, clarity, and rate of the speaker's performance throughout the reading of the word list.

  34. Conducting the Test • The test material shall be the reading of one complete MRT word list • Both sound level meters shall be turned on and calibrated prior to subjects entering the test room • The noise generator shall be turned on and set to produce pink noise. The output of the noise generator shall be adjusted to produce a signal strength of 60 dBA as measured by the sound level meter at the listener's head position without listeners present.

  35. Conducting the Test • The three test listeners shall be seated facing a single test speaker at a distance of 10 ft (3.05 m). • A test speaker will be positioned in the speaking position and present one complete MRT word list to the listening panel. • A different speaker shall then be used to present the next MRT trial. Test speakers will continue to rotate among the speaker test panel until all trials have been complete.

  36. Conducting the Test • Data will be obtained without the respirator and with the respirator worn and operated per the manufacturer's instructions by both speakers and listeners. All conditions shall be randomly assigned and a different word list shall be used for each test. An example test matrix of the MRT conditions is provided in Table 2 to assist the test administrator in establishing the sequence of testing.

  37. Conducting the Test

  38. Administering the test • CBRN APR Communication Performance Word List Test Sheets • List I • The word is but • The word is kit • The word is peak • The word is pig • The word is cold • The word is sick • The word is pat • The word is beat • The word is fit

  39. The Scoring Sheet

  40. Conducting the Test • A total of 10 MRT trials shall be performed. The 10 trials will result in a total of 15 MRT scores (five per listener) for the unworn mask condition and 15 scores for the worn condition.

  41. Scoring • Adjusted Score = Number of Correct Listener Response - (No. Wrong Listener Responses)/5 • Determine the Number of Words Spoken Correctly by the speakers from either the Test Administrators notes or if necessary, by listening to the Audio recorder tapes. • Listener performance on the MRT shall be scored in terms of the percentage of words correctly identified using the equation for both the masked and unmasked posture: % Correct = (AdjustedScore/Numberof Words Spoken Correctly) * 100 • Average Unmasked and Average Masked % Correct Scores shall be calculated for each individual listener. • Each individual listener's Average Masked % Correct Score shall be divided by their Average Unmasked % Correct Score to calculate a Performance Rating using the equation: • Performance Rating (%) =(AverageMasked%CorrectScore x 100 • Average Unmasked % Correct Score • The performance rating of all listeners shall then be averaged to determine the Overall Performance Rating of the CBRN APR using the following Equation: • Overall Performance Rating (%) = (Performance Rating (%) L1 + Performance Rating (%) L2 + Performance Rating (%)LI3) /3

  42. Modified Rhyme Test - NIOSH • A candidate CBRN APR* in accordance with the Statement of Standard for Chemical Biological Radiological and Nuclear (CBRN) Full Face piece Air Purifying Respirators (APR), March 7, 2003 with Revision 2, April 4, 2003 must obtain an Overall Performance Rating greater than or equal to 70% to meet the Communication requirement. *Chemical, Biological, Radiological, and Nuclear (CBRN) Full-Face piece Air-Purifying Respirator (APR)

  43. Advantages • The number of stimuli is reduced and the test procedure is not time consuming. • Naive listeners can participate without having to be trained • Reliable results can be obtained with relatively small subject groups, which is usually from 10 to 20. • The learning effects can also be discarded or measured.

  44. Advantages • Rhyme tests are easy and economic to perform. • The obtained measure of intelligibility is simply the number of correctly identified words compared to all words. • Diagnostic information can be given by confusion matrices. • Confusion matrices give information how different phonemes are misidentified and help to localize the problem points for development.

  45. Disadvantages • With monosyllabic words only single consonants are tested • The vocabulary is also fixed and public so system designers may tune their systems for the test. • Listeners might remember the correct answers when participating in the test more than once.

  46. How To Order • ANSI S3.2-1989 (R1999) American National Standard Method for Measuring the Intelligibility of Speech Over Communication Systems • This standard is a revision of the American National Standard Method for Measurement of Monosyllabic Word Intelligibility, ANSI S3.2-1960 (R1982). The standard provides three alternative sets of lists of English words to be spoken by trained talkers over the speech communication system to be evaluated. The selection of the particular set of word lists depends upon the purpose and constraints of the test situation. Trained listeners record the words they hear. The fraction of the words they identify correctly is the measure of the intelligibility of speech over the system. The system may consist of the air and the room or outdoors in face-to-face communications; the equipment and environments used in telephony, public address systems, or ordinary radio; or complex systems of environment, equipment, and air, wire, fiber, radio, and water paths used in some military, space, remote, or emergency communications. The standard specifies test materials that have been thoroughly validated. The standard also specifies methods for selecting and training the talkers and listeners; for designing, controlling, and reporting the test conditions; and for analyzing and reporting the test results. • ANSI S3.2-1989 (R1999)PDF File1-9 - $100.00 • Send orders to: Acoustical Society of America, Publications, P. O. Box 1020, Sewickley, PA 15143-9998; Tel.: 412-741-1979; Fax: 412-741-0609. • http://asa.aip.org/orderform.pdf

  47. References • Fairbanks, G. (1958), ‘Test of phonemic differentiation: The rhyme test’, J. of the Acoustical Society of America 30(7). • House, A. S., Williams, C., Hecker, M. H. L. & Kryter, K. D. (1963), ‘Psychoacoustic speech tests: A modified rhyme test’, J. of the Acoustical Society of America 35(11). • National Institute for Occupational Safety and Health National Personal Protective Technology Laboratory, Pittsburgh, PA, DETERMINATION OF COMMUNICATION PERFORMANCE TEST FOR SPEECH CONVEYANCE AND INTELLIGIBILITY OF CHEMICAL BIOLOGICAL RADIOLOGICAL AND NUCLEAR (CBRN) FULL-FACEPIECE AIR-PURIFYING RESPIRATOR STANDARD test PROCEDURE (STP), Procedure No. CET-APRS-STP-CBRN-0313 • http://www.meyersound.com/support/papers/speech/glossary.htm

  48. The End

More Related