Stephen Travis Pope
Graduate Program in Media Arts and Technology
University of California. Santa Barbara
Volume 1: Multimedia Engineering (280 pages, 1680 slides)
Volume 2: Audio Software (253 pages, 1518 slides)
Volume 3: Audio Hardware (147 pages, 882 slides)
Downloads
- Presentation Files (241 MB zip of PDFs)
- Readers and References (1.7 GB zip of PDFs)
- Example Code and Student Projects 1.3 GB zip of code)
Covers of the 3 volumes
Table of Contents
Volume 1: Multimedia Engineering (Core courses)
A. Survey of Media Engineering &
Technology
EE/CS topics, data/signal/symbol, models and representations, media I/O devices
B. Computing with Media Data
Multimedia programming techniques and APIs, software development topics and tools
C. Sensors and Interfaces for Media Art
Space and gestural interaction, transducers and sensors, Arduino-like microcontrollers
EE/CS topics, data/signal/symbol, models and representations, media I/O devices
B. Computing with Media Data
Multimedia programming techniques and APIs, software development topics and tools
C. Sensors and Interfaces for Media Art
Space and gestural interaction, transducers and sensors, Arduino-like microcontrollers
Volume 2: Audio Software (MAT Digital Audio Programming 6-part Series)
A. Sound IO and Streaming
APIs
Sound I/O libraries for modern computing platforms, audio plug-in APIs
B. The Spectral Domain: Filter and the FFT
Digital filters and frequency transforms, FFT implementations, vocoders, applications
C. Spatial/Surround Sound and Reverb
Formats for spatial- and surround-sound, synthesis of spatial queues, reverberation techniques
D. Sound Synthesis Techniques
Additive, subtractive and non-linear synthesis, physical modeling, granular synthesis, applications
E. Control and Distributed Programming
MIDI and OSC libraries and applications, USB HID programming
F. Databases and Music Information Retrieval
Audio signal analysis and feature extraction, music segmentation, classification, applications
Sound I/O libraries for modern computing platforms, audio plug-in APIs
B. The Spectral Domain: Filter and the FFT
Digital filters and frequency transforms, FFT implementations, vocoders, applications
C. Spatial/Surround Sound and Reverb
Formats for spatial- and surround-sound, synthesis of spatial queues, reverberation techniques
D. Sound Synthesis Techniques
Additive, subtractive and non-linear synthesis, physical modeling, granular synthesis, applications
E. Control and Distributed Programming
MIDI and OSC libraries and applications, USB HID programming
F. Databases and Music Information Retrieval
Audio signal analysis and feature extraction, music segmentation, classification, applications
Volume 3: Audio Hardware
A. Audiophile
Engineering
Principles of HiFi, critical listening, room acoustics, components of the audio signal chain
B. Recording Studio Design
Studios and control rooms, the recording signal processing chain, mixing and mastering, new media systems
Principles of HiFi, critical listening, room acoustics, components of the audio signal chain
B. Recording Studio Design
Studios and control rooms, the recording signal processing chain, mixing and mastering, new media systems
Introduction to the Series “Courseware for Audio & Multimedia Engineering”
Multimedia engineering is a broad and complex topic. It is also one of the fastest-growing and most valuable fields of research and development within electronic technology. The book before you is an anthology of curriculum materials developed over the space of 15 years at the University of California, Santa Barbara for students in UCSB’s Graduate Program in Media Arts and Technology.
TheBigMATBook consists of the presentation slides for eleven ten-week courses, amounting to almost 500 hours of presentation time. For each of the eleven courses, the presentation slides are accompanied by the tables of contents of the course readers, and an overview of the example code archives. These resources are available for down-load from the MAT or HeavenEverywhere web sites (see http://HeavenEverywhere.com/TheBigMATBook).
The multimedia engineering courses included here cover theory and practice, hardware and software, visual and audio media, and arts as well as entertainment applications. Some of the courses (the first two chapters) are required of all MAT graduate students, and thus must target less-technical and also non-audio-centric students. The bulk of this material, though, consists of elective courses that have somewhat higher-level prerequisites and assume basic knowledge of acoustics and some (minimal) programming experience in mainstream programming languages.
TheBigMATBook courses borrow liberally from R&D publications by my friends and colleagues, especially Roger Dannenberg, Julius O. Smith, D. Gareth Loy, F. R. Moore, Perry Cook, Adrian Freed, George Tzanetakis, Ross Bencina and Dan Overholt. I want also to express my deepest thanks to my MAT and Music Dept. colleagues JoAnn Kuchera-Morin, Curtis Roads, Clarence Barlow, Matthew Wright and Matthew Turk, and to the many students who helped these courses evolve, either as course participants or teaching assistants.
Stephen Travis Pope
Santa Barbara, California