Картинки, идиоми, образност и вътрешна симулация: експерименти с време на реакция

1. Картинки, идиоми, образност ивътрешна симулация: експериментис време на реакция Armina Janyan ajanyan@cogs.nbu.bg

2. Janyan, A., Feldman, V., & Tilkidjieva, E. (submitted). Picture makes the difference: Motor simulation in a matching task. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Effector-specific motor simulation in idiom processing. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Motor simulation and verbal association in idiom-idiom verification: Effects of imageability. 33rd Annual Conference of the Cognitive Science Society.

3. Janyan, A., Feldman, V., & Tilkidjieva, E. (submitted). Picture makes the difference: Motor simulation in a matching task. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Effector-specific motor simulation in idiom processing. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Motor simulation and verbal association in idiom-idiom verification: Effects of imageability. 33rd Annual Conference of the Cognitive Science Society.

4. Research questions • How linguistic input and motor knowledge are related? Is understanding of an action (in verbal and pictorial modalities) involved into the same neuronal pattern that is required for the performance of that action?

5. Bergen et al.(2003) – semantic interference effect, motor simulation for verbs referring to actions with a specific effector. пиша (Same) скачам (Diff) режа (Match) ####### Same Diff 1000ms 500 ms RT

6. Same effector Diff effector Predictions >> РИСУВАМ СКАЧАМ • Motor simulation, semantic interference. • Two similar mirror structures inhibit each other.

7. Main effect of effector type (F(1,68)=9.00; p<.01)

8. Conclusion • action-describing verbal input combined with a pictorial representation of an action can produce the semantic interference effect. • Understanding of an action (verbal and pictorial modalities) involves activation of motor neuronal structures responsible for that action => same neuronal structures are used for understanding action and performing the same action.

9. Janyan, A., Feldman, V., & Tilkidjieva, E. (submitted). Picture makes the difference: Motor simulation in a matching task. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Effector-specific motor simulation in idiom processing. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Motor simulation and verbal association in idiom-idiom verification: Effects of imageability. 33rd Annual Conference of the Cognitive Science Society.

10. Aims and hypotheses • The aim of the present research is to test whether figurative language is grounded in sensory-motor experience • If motor simulation in idiom processing occurs, an interference effect is expected. • Imageability would be a very probable candidate for finding an interference effect since it is closely connected to our sensory-motor experience.

11. apple: physical entity,perceptually salient, sensory-motor knowledge / experience(i.e., rich multimodal representation) • Fact: no perceptual representation, unspecified properties apple fact

12. xващам; Match задрасквам; Same Effector тичам;Different Effector • PROCEDURE: хващам бика за рогата ####### 1000ms 500 ms RT TASK: same/different verb Same Diff

13. **

14. Conclusion • Evidence for effector-specific motor simulation was found for idiom processing: Comprehension of highly imageable idioms interferes with comprehension of verbs referring to actions with the same effector thus indicating that the same motor structures may have been activated. BUT: task required a superficial lexical processing: match a verb 

15. Janyan, A., Feldman, V., & Tilkidjieva, E. (submitted). Picture makes the difference: Motor simulation in a matching task. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Effector-specific motor simulation in idiom processing. European Conference on Cognitive Science. • Gradinarova, G., & Janyan, A. (submitted). Motor simulation and verbal association in idiom-idiom verification: Effects of imageability. 33rd Annual Conference of the Cognitive Science Society.

16. Research questions • Sensory-motor experience and processing of two idioms; semantic and familiarity tasks. Semantic interference? • 2 (Effector Matching: Same Effector vs. Different Effector) x 2 (Imageability: High vs. Low)

17. наливам ум в главата хващам му края отритвам късмета си нося някого на ръце хващам бика за рога прехапвам си езика 1500ms 500 ms RT TASK1: same/different idiomatic meaning: нося с вила орехи черпя вода в решето TASK2: familiar/unfamiliar one or both idioms кара си своето магаре простирам уши

18. Semantic task Fs(1, 25)=10.37, p<.01

19. Familiarity task Fs(1, 23)=18.44, p<.001

20. Conclusion • high-imageability idiom processing involves motor simulation during semantic and familiarity tasks. Low-imageability idioms may have mostly/predominantly one representation modality, a verbal one. A superficial idiom familiarity task has, probably, triggered lexical associations within a verbal system of verbs. Hence, verbs that shared an effector (e.g., хващамand стискам) were associatively activated and facilitated overall idiom processing. • Overall, the study showed the differentiation effect of imageability in motor simulation in idiom processing.