The Structure of Multimodal Documents

The Structure of Multimodal Documents
Author: Tuomo Hiippala
Publisher: Routledge
Total Pages: 250
Release: 2015-06-05
Genre: Language Arts & Disciplines
ISBN: 1317580133

This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.

Multimodality and Genre

Multimodality and Genre
Author: J. Bateman
Publisher: Springer
Total Pages: 331
Release: 2008-04-17
Genre: Language Arts & Disciplines
ISBN: 023058232X

The first systematic, corpus-based and theoretically rigorous approach to the description and analysis of multimodal documents. Drawing on academic research and the experience of designers and production teams, Bateman uses linguistically-based analysis to show how different modes of expression together make up a document with a recognisable genre.

Multimodality

Multimodality
Author: John Bateman
Publisher: Walter de Gruyter GmbH & Co KG
Total Pages: 424
Release: 2017-04-10
Genre: Language Arts & Disciplines
ISBN: 3110480042

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.

Multimodal Film Analysis

Multimodal Film Analysis
Author: John Bateman
Publisher: Routledge
Total Pages: 339
Release: 2013-06-17
Genre: Language Arts & Disciplines
ISBN: 1136467556

This book presents a new basis for the empirical analysis of film. Starting from an established body of work in film theory, the authors show how a close incorporation of the current state of the art in multimodal theory—including accounts of the syntagmatic and paradigmatic axes of organisation, discourse semantics and advanced ‘layout structure’—builds a methodology by which concrete details of film sequences drive mechanisms for constructing filmic discourse structures. The book introduces the necessary background, the open questions raised, and the method by which analysis can proceed step-by-step. Extensive examples are given from a broad range of films. With this new analytic tool set, the reader will approach the study of film organisation with new levels of detail and probe more deeply into the fundamental question of the discipline: just how is it that films reliably communicate meaning?

Building Bridges for Multimodal Research

Building Bridges for Multimodal Research
Author: Janina Wildfeuer
Publisher: Sprache ¿ Medien ¿ Innovationen
Total Pages: 0
Release: 2015
Genre: Communication
ISBN: 9783631662663

The book takes differences in multimodality research as a starting point to discuss old and new theoretical, methodological as well as analytical ideas for building bridges between various disciplines and approaches.

The Structure of Multimodal Dialogue II

The Structure of Multimodal Dialogue II
Author: Martin M. Taylor
Publisher: John Benjamins Publishing
Total Pages: 542
Release: 2000-03-15
Genre: Language Arts & Disciplines
ISBN: 9027273871

Most dialogues are multimodal. When people talk, they use not only their voices, but also facial expressions and other gestures, and perhaps even touch. When computers communicate with people, they use pictures and perhaps sounds, together with textual language, and when people communicate with computers, they are likely to use mouse “gestures” almost as much as words. How are such multimodal dialogues constructed? This is the main question addressed in this selection of papers of the second “Venaco Workshop”, sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).

Discourse and Technology

Discourse and Technology
Author: Philip LeVine
Publisher: Georgetown University Press
Total Pages: 242
Release: 2004-02-16
Genre: Language Arts & Disciplines
ISBN: 9781589013117

The overarching theme of Discourse and Technology is cutting-edge in the field of linguistics: multimodal discourse. This volume opens up a discussion among discourse analysts and others in linguistics and related fields about the two-fold impact of new communication technologies: The impact on how discourse data is collected, transcribed, and analyzed—and the impact that these technologies are having on social interaction and discourse. As inexpensive tape recorders allowed the field to move beyond text, written or printed language, to capture talk—discourse as spoken language—the information explosion (including cell phones, video recorders, Internet chat rooms, online journals, and the like) has moved those in the field to recognize that all discourse is, in various ways, "multimodal," constructed through speech and gesture, as well as through typography, layout, and the materials employed in the making of texts. The contributors have responded to the expanding scope of discourse analysis by asking five key questions: Why should we study discourse and technology and multimodal discourse analysis? What is the role of the World Wide Web in discourse analysis? How does one analyze multimodal discourse in studies of social actions and interactions? How does one analyze multimodal discourse in educational social interactions? and, How does one use multimodal discourse analyses in the workplace? The vitality of these explorations opens windows onto even newer horizons of discourse and discourse analysis.

Design Perspectives on Multimodal Documents

Design Perspectives on Multimodal Documents
Author: Matthew David Lickiss
Publisher: Routledge
Total Pages: 231
Release: 2019-07-01
Genre: Language Arts & Disciplines
ISBN: 135160032X

This volume integrates multimodal theoretical frameworks with those from graphic communication and information design and applies this critical synthesis to the examination of the changes and relationships that occur when multimodal documents are distributed across various means and channels of consumption. Drawing on examples from popular newspapers and store catalogs, the book’s specific focus is on documents as sets, here defined as the collective of all the assorted forms of a document published across multiple mediums and modes. This approach affords a multi-layered analysis of multimodal documents more broadly, in addition to engaging in questions about the very definition of a document and the terminology we use in relation to documents, including genres, mediums, and modes. As both a critical examination of the theoretical frameworks employed in literature on documents and a way forward for new approaches to analyzing multimodal texts, this volume is key reading for students and scholars in multimodality, graphic communication, design, media studies, and information science.

Multimodality Studies in International Contexts

Multimodality Studies in International Contexts
Author: Liliana Vásquez Rocca
Publisher: Taylor & Francis
Total Pages: 285
Release: 2023-12-28
Genre: Language Arts & Disciplines
ISBN: 100382532X

This collection responds to the need for theoretically informed and methodologically grounded empirical research on the global transformations in multimodal human communication and social practices in light of recent widespread change. The volume highlights the need to expand on the established approaches--Social Semiotics, Multimodal Discourse Analysis, and Multimodal (Inter)action Analysis--by complementing them with other analytical frameworks to better understand the impact of unprecedented global challenges, such as Covid-19, on the way humans communicate and make use of meaning-making resources. Bringing together established and emergent scholars from a variety of geographical, cultural, and linguistic contexts, the collection presents studies from both the Global North and Global South, including South Africa, Latin America, Brazil, and the Caribbean, to showcase new perspectives in multimodality research. This innovative book will be of interest to students and scholars in multimodality, social semiotics, and discourse analysis.

Empirical Multimodality Research

Empirical Multimodality Research
Author: Jana Pflaeging
Publisher: Walter de Gruyter GmbH & Co KG
Total Pages: 295
Release: 2021-11-08
Genre: Language Arts & Disciplines
ISBN: 3110725002

This volume advances the data-based study of multimodal artefacts and performances by showcasing methods and results from the latest endeavors in empirical multimodal research, representing a vibrant international and interdisciplinary research community. The collated chapters identify and seek to inspire novel, mixed-method approaches to investigate meaning-making mechanisms in current communicative artifacts, designs, and contexts; while attending to their immersive, aesthetic, and ideological dimensions. Each contribution details innovative aspects of empirical multimodality research, offering insights into challenges evolving from quantitative approaches, particular corpus work, results from eye-tracking and psychological experiments, and analyses of dynamic interactive experiences. The approaches and results presented foreground the inherent multidisciplinary nature and implications of multimodality, renegotiating concepts across linguistics, media studies, (social) semiotics, game studies, and design. With this, the volume will inform both current and future developments in theory, methods, and transdisciplinary contexts and become a landmark reference for anyone interested in the empirical study of multimodality.