O: orthographic P: phonological

1. methods introduction Recent behavioral research (Grainger et al. 2003) has demonstrated improved auditory target word recognition following rapid (50 ms), pattern-masked, visual presentation of the same word. These masked cross-modal repetition priming effects could be : • the result of visual primes activating phonological representations that are subsequently involved in the processing of auditory targets (this would be a relatively rapid bottom-up, cross-modal influence), or • the result of the recruitment of pre-activated orthographic information during auditory target recognition (presumably a relatively slower lexical or post-lexical influence). Both accounts are shown in the context of a bi-modal interactive activation model (BIAM) in figure 1b. Extending Grainger's work by building on the strength of the continuous on-line sensitivity of event related potentials (ERPs) we tested these two accounts in two cross-modal masked priming experiments. In experiment 1, a semantic categorization task (SCT), participants monitored target words for animal names, and in experiment 2 they performed a lexical decision task (LDT). • experiment 1 • Semantic Categorization Task • Participants were instructed to press a button to all animal names. • 240 TRIALS • 100repeated condition : e.g. courir – COURIR • 50 within modality : visual primes / visual targets • 50 across modalities : visual primes / auditory targets • 100unrelated condition : e.g. paquet – COURIR • 50 within modality : visual primes / visual targets • 50 across modalities : visual primes / auditory targets • 40animal name probe trials • 20 animals as target (10 auditory) • 20 animals as prime • 24 participants • right-handed native speakers of French • 22 female, mean age = 20 years • normal visual and auditory acuity BIAM architecture In the generic bi-modal interactive activation architecture, a printed word stimulus activates a sublexical orthographic code (O-units). This early orthographic code then sends activation onto the central interface between orthography and phonology (O<=>P) that allows sublexical orthographic representations to be mapped onto their corresponding phonological representations, and vice versa. Masked Cross-Modal Repetition Priming: An ERP InvestigationKristi Kiyonaga1, Katherine J. Midgley1,2, Jonathan Grainger2 & Phillip J. Holcomb1Tufts University, Medford, MA1; Laboratoire de Psychologie Cognitive - CNRS, Université de Provence, Aix/Marseille2 • experiment 2 • Lexical Decision Task • Participants were instructed to press one button for words and another for pseudowords. • 400 TRIALS • 100repeated condition : e.g. courir – COURIR • 50 within modality : visual primes / visual targets • 50 across modalities : visual primes / auditory targets • 100unrelated condition : e.g. paquet – COURIR • 50 within modality : visual primes / visual targets • 50 across modalities : visual primes / auditory targets • 200 prime word and target pseudoword • 100 within modality : visual primes / visual targets • 100 across modalities : visual primes / auditory targets • 24 participants • right-handed native speakers of French • 17 female, mean age = 21 years • normal visual and auditory acuity experiment 1 SCT visual targets electrode montage O: orthographic P: phonological figure 4 figure 3 figure 1a.

2. results 2 BIAM accounts experiment 2 LDT findings experiment 1 SCT According to the "bottom up" account, briefly presented visual primes can directly activate sublexical and whole-word phonological representations. This implies that the resulting processing advantage reflects essentially the same mechanism as within-modal priming effects: activation of representations directly recruited during target processing. According to the "resonance" account activation flows to sublexical whole-word orthographic representations, and no further. However, subsequent target processing can benefit from pre-activated orthographic representations via a resonance established across compatible phonological and orthographic representations. In this case, cross-modal priming depends on mechanisms that are distinct from those underlying within-modal priming. references trials Within the visual modality targets produced a robust ERP repetition priming effect starting as early as 200ms post target onset and lasting through the N400 epoch (see figures 4, 5 and 6). These effects were found both in the semantic categorization task and the lexical decision task. Across modalities there was also on ERP repetition priming effect. However this effect was smaller and onset later – on the trailing edge of the N400 effect (figures 7 and 8). These data would appear to best support our second hypothesis proposing that improved auditory target word recognition following visual presentation of the same word is the result of the recruitment of pre-activated orthographic information during auditory target recognition. figure 1b. “bottom up” account word level “resonance” account figure 7 figure 5 • Grainger, J., Diependaele, K. Spinelli, E. Ferrand, L. & Farioli, F. (2003). Masked Repetition and Phonological Priming Within and Across Modalities, Journal of Experimental Psychology: Learning, Memory and Cognition, 29, 1256-1269. • Kouider, S., & Dupoux, E. (2001). A functional disconnection between spoken and visual word recognition: evidence from unconscious priming. Cognition, 82, B35-B49. • Ziegler, J.C., Muneaux, M., & Grainger, J. (2003). Neighborhood effects in auditory word recognition: Phonological competition and orthographic facilitation. Journal of Memory and Language, 48, 779-793. figure 8 figure 6 contact : kj.midgley@tufts.edu figure 2 This research was supported by NIH Grants HD25889 and HD043251 and by the CNRS, France.