The psychology of music in multimedia /
edited by Siu-Lan Tan, Annabel J. Cohen, Scott D. Lipscomb, and Roger A. Kendall.
- First edition.
- xix, 432 pages : illustrations, music ; 24 cm
Includes bibliographical references and indexes.
Introduction : The psychology of music in multimedia / Models and Multidisciplinary Perspectives. Congruence-Association Model of music and multimedia : origin and evolution / Experimental semiotics applied to visual, sound, and musical structures / Integrating media effects research and music psychology / Musical analysis for multimedia : a perspective from music theory / Emotion and music in narrative films : a neuroscientific perspective / Cross-Modal Relations in Multimedia. Perceived congruence between auditory and visual elements in multimedia / How pitch and loudness shape musical space and motion / Cross-modal alignment of accent structures in multimedia / Interpretation and meaning. Music videos and visual influences on music perception and appreciation : Should you want your MTV? / Music and memory in film and other multimedia : The Casablanca effect / Applications : music and sound in multimedia. Children's media : The role of music and audio features / Playing with sound : The role of music and sound effects in gaming / Music in television advertising and other persuasive media / Auditory icons, earcons, and displays : information and expression through sound / Understanding the impact of surround sound in multimedia / Future research directions. Future research directions for music and sound in multimedia / Annabel J. Cohen, Scott D. Lipscomb, Siu-Lan Tan, and Roger A. Kendall -- Annabel J. Cohen ; Roger A. Kendall and Scott D. Lipscomb ; Mark Shevy ; David Bashwiner ; Lars Kuchinke, Hermann Kappelhoff, and Stefan Koelsch -- Shin-ichiro Iwamiya ; Zohar Eitan ; Scott D. Lipscomb -- Marilyn G. Boltz ; Berthold Hoeckner and Howard C. Nusbaum -- Sandra L. Calvert ; Mark Grimshaw, Siu-Lan Tan, and Scott D. Lipscomb ; Mark Shevy and Kineta Hung ; Agnieszka Roginska ; Mark Kerins -- Siu-Lan Tan, Annabel J. Cohen, Scott D. Lipscomb, and Roger A. Kendall.
For most of the history of film-making, music has played an integral role serving many functions - such as conveying emotion, heightening tension, and influencing interpretation and inferences about events and characters. More recently, with the enormous growth of the gaming industry and the Internet, a new role for music has emerged. However, all of these applications of music depend on complex mental processes which are being identified through research on human participants in multimedia contexts. This is the first book dedicated to this fascinating topic. This book presents a wide range of scientific research on the psychological processes involved in the integration of sound and image when engaging with film, television, video, interactive games, and computer interfaces. Collectively, the rich chapters in this edited volume represent a comprehensive treatment of the existing research on the multimedia experience, with the aim of disseminating the current knowledge base and inspiring future scholarship. The focus on empirical research and the strong psychological framework make this book an exceptional and distinctive contribution to the field. The international collection of contributors represents eight countries and a broad range of disciplines including psychology, musicology, neuroscience, media studies, film, and communications. Each chapter includes a comprehensive review of the topic and, where appropriate, identifies models that can be empirically tested. Part One presents contrasting theoretical approaches from cognitive psychology, philosophy, semiotics, communication, musicology, and neuroscience. Part Two reviews research on the structural aspects of music and multimedia, while Part Three focuses on research examining the influence of music on perceived meaning in the multimedia experience. Part Four explores empirical findings in a variety of real-world applications of music in multimedia.