240 likes | 395 Views
Imagery and multimedia. Webdesign & Webkommunikation E08 Dag 10 (06/11/08). Today´s goals. To make clear that images are more than illustrations, pynt To get some tools and vocabulary to think about images
E N D
Imagery and multimedia • Webdesign & Webkommunikation E08 • Dag 10 (06/11/08)
Today´s goals • To make clear that images are more than illustrations, pynt • To get some tools and vocabulary to think about images • To understand that ”visualisation” is not a simple matter of translating accross media • To be introduced to the rhetoric possibilities of combinations of images and text • To be introduced to visual grammar
Kress: 1998 • Historic account of text vs image (i.e. newspapers) • Writing as technology • How images goes from being secondary to much more important: from repeating/illustrating to displaying/defining • But do language and text do the same? • What are the risks?
Illustration? Heie
Kress: 1998 • Essential elements of visual representation: display, arrangement, sequentiality • Differences from narrative mode: draw your weekend • How does selection work? • From narrative to display • Language is not the central semiotic mode • Real multimodal texts search integration, this doesnt mean alligned meaning...
Complex interplay of graphic & text Visual rhetoric: the richness is in the gap. Heie
Kress: 2001 • Complex text amplifies the idea of multimodal text needing multiple articulation • Examples of children rooms as multimodal text • To avoid language-centrism, moves up a level and thinks in discourse terms, i.e. ”ethnic conflict”. Same elements can be combined to accord to different discourses
Kress: 2001, concepts beyond monomodality • Discourse: socially situated knowledge/interpretations of reality • Design: conceptualizing a product or event • Production: articulation in material form • Distribution: (also add meaning) • Modes can be realized in different media (i.e. narrative is a mode, cinema is a media)
When you design... Be aware of multimodal discourses & the gap between media
Two perspectives on multimedia BACK: How to read with all senses? (Seeing the multimedia object as a whole) Multisensory reading can allow greater bandwith into the human mind, providing meaning on multiple levels at once (158). Languages comment and complement each other. CUBITT: Multimedia strategies and their shortcomings (Problematizing the status of the multimedia object as a whole) The distinguishing features of writing, painting or music making are lost in digital media. Unity is hard to find.
Back: Multisensory Defines multimedia: text is made of image, sound and physical form, any of which might be dynamic or interactive (158) Prefers term multisensory because she wants the body back! Experience. Multisensory reading (161) Multimodality would be the way we experience a multisensory text. The interface is authored along with content, we shape the format of interaction (158), relationship to metadata (161)
Back: modality It is our way of perceiving as ruled by one sense, for example: visuals, sound, etc. Each modality has submodalities, for example visual includes text, images still and moving and graphic elements Modalities develop and can be learned (own grammars and formalizations) Different modalities at different stages of development from replication of the real world into iconic representation and abstraction (for example text and sound) - music G major - sound tiger - alphabet
Back: visual predominance Text is visual, genre indicates how to interpret (160) a lot of tradition to export into multimedia Even VR chooses to be mostly visual in its representation (164) Important final question: can and should other modalities also be abstract? (page 177) They seem to always need translation into words…, so is the predominance verbal instead of visual?
Cubitt: multimedia Definition more technical: all data can be transformed into one kind of output Convergence of previously distinct media (162-163) Convergence panic related to pure modernist aesthetics • Popular art: comics • High art: painting OLD FASHIONED!
Cubitt: 3 multimedia strategies Historical view The most used They all have strengths but critical flaws to be used in conjunction with digital media
Cubitt: Hierarchical Each medium has a “top” mode of representation (ex. Cinema script, tv sound, web- impossible as too different? Visual?) Related to modernist aesthetics Caption vs Depiction (two modes of combining text and images, 170) the interesting is in the gap Weakness: user intervention breaks hierarchy (167, 171) DOMINANCE of one medium
Cubitt: Organic Different media converge, all data into one unit (ex Wagner), problem that one actually dominates Doctrine of unity in design: branding, everything looks the same (173) Weakness: not appropriate for main mode of web: searching Weakness: unity in multimedia actually hard to find (schizophrenic) (177) DEMOCRACY across media
Cubitt: Montage Dada origins: juxtaposition that has to shock Easier within a medium, difficult across media (cinema ex.) Dialectical concept important Ex. Jodi the official vs the unofficial Weakness: cliché and meaninglessness Although: seems appropriate as catalog/database nature of web creates juxtapositions. CONFLICT of media
Bibliography • Back, Maribeth. 2003. “The Reading Senses. Designing Texts for Multisensory Systems”. In Liestøl et.al. Digital Media Revisited. Cambridge, MA: MIT Press. • Cubitt, Sean. 2000. “Multimedia!. In Swiss, Thomas. Unspun – key concepts for understanding the world wide web. New York: NYU Press. • Heie, Niels. 1999. At Tale til Øjet. København: Grafisk Litteratur. • Kress, Gunther & Van Leeuwen, Theo. 1996. Reading Images. The Grammar of Visual Design. London: Routledge. • McCloud, Scott. 1993. Understanding Comics. The Invisible Art. NY: Harper Collins.