ABSTRACT

Interest in communication beyond written text and spoken language – to include aspects such as gestures, colors, layout, and image – follows observations that everyday life is experienced in multimodal terms – through sight, smell, sound, and so on. There is an increasing amount of work devoted to the analysis of communication from a multimodal perspective, both in interpersonal interactions and mass communication. Gestures, positioning in space, and other forms of embodied communication are recognized as meaning-carrying alongside spoken and written language, while the use of such semiotic resources as image, layout, or the choice of font in print and digital media are analyzed from the perspective of effectiveness of communication and reader/viewer experience. None of the resources included in the composition of a text acts on its own. Rather, the overall meaning of a text is constructed as a whole, taking into account all forms of meaning-making present.