DMST 3230

Multimedia Authoring Tools - Winter 08

Catalog Description

Various approaches to multimedia authoring, including animation, interactive scripting, application integration, platform compatibility and Internet delivery. Prerequisites: DMST 3211 or instructor's permission. 4.000 Credit Hours

Return to Top

Course Overview

Multimedia Authoring is a broad category covering everything from DVD menu creation to concert video walls. We explore but two small facets; controllable destruction/recombination of audio/video and hacking out new ways of controlling the computer with physical stimuli. We will build upon programming and interaction knowledge from previous courses, using many of the same tools to acquire and distribute additional control over digital material.

First we will look at how tools such as Flash and Processing allow for manipulation at the millisecond level of image and sound. The lightening fast changes in web technology coupled with the current trends of user submitted content and mashup creation, have created an environment where just serving up a static experience is "so last year." We will look at some of the past and "bleeding edge" applications for manipulating data and think about new directions for information visualization.

The second focus of the course will be on developing new physical interfaces. Each student will work with an Arduino board, allowing easy connection of buttons and sensors with the software running on the computer. After years of fitful starts and stops, we are finally seeing innovative interfaces begin to be accepted in the mainstream populace; the Nintendo Wii, the iphone, and the Microsoft Surface to name a few. We will lay the groundwork for understanding and creating such things, while looking at the practicality and history of interfaces that have since died or gone into hibernation.

Return to Top

Course Objectives

By the end of this course you will:

  • Think critically about interaction and interactivity
  • Have knowledge of the history and future of interaction
  • Consider all facets of HCI in developing your work
  • Have working knowledge of cutting edge tools for interactive media creation
  • Understand the process of planning and executing interactive work
  • Develop new ways to provide input for a computer
  • Understand how the computer can have output beyond sound and video
  • Create meaningful content laden interactive experiences
  • Be able to understand how and when to work interactively without a computer

  • Return to Top


  • The required text for this course is "Processing: A handbook for Visual Designers and Artists" By Casey Reas and Ben Fry. It is available in the University Bookstore
  • You will need at least 1GB of portable storage (flash or thumb drives, ipod, portable hard drive, etc.)
  • You must have or purchase a sketchbook approx. 8.5"x11"
  • Email address and web space through the school or other server
  • As the quarter passes, keep any broken devices, gadgets or toys that might have motors, lights, or other interesting parts you might reuse

  • Return to Top


    This class will combine individual work in the lab with individual and group instruction. Students must come to class prepared to work. Showing up without necessary files or equipment is the same as not attending. Although students may also use their home computers to work on projects, this is not a valid reason to not attend. It will be necessary to work outside of class to complete all projects and assignments. A minimum of eight hours per week of work outside of class is suggested to get an average grade of a C. Computer failure, equipment malfunction, and file corruption are not accepted as excuses for late or unfinished work so BACK UP YOUR WORK. The computer labs are used by many students, so the labs are in high demand. Budget time accordingly as "unavailable computer time" will also not be accepted as an excuse. Participation in all class discussions and critiques as well as constructive use of lab time is considered in the final grade for each project. At any time in the creation process students should be able to produce notes, drawings,charts etc from their sketchbooks, as well as discuss and articulate the nature of their work to their peers as well as to the instructor.

    Attendance is mandatory. Attending class is the responsibility of the student. Lectures and demonstrations may be given or changed without notice and every class will start with professional examples of relevant work so punctuality is essential. An individual who is absent, late or sleeps during class will be responsible for getting the information missed. Students will be allowed two (2) absences without penalty. Any absence in excess of two will result in a 10% grade reduction of the final grade for the course per absence. All absences will be counted. A student who misses 15 minutes or more of a class (late or leave early) is considered absent. A student who sleeps will be considered absent. A student who will acquire absences due to a University sponsored activities must provide necessary documentation from the appropriate office prior to the absence to make any special arrangements for missed work.

    For any absence due to religious beliefs, written notification should be provided in the first two weeks of the quarter; the student is responsible for any missed work. Any special medical or personal problems that occur, where absenteeism will exceed the allowed two, will require verification by a physician or emergency medical association (a letter from Student Affairs merely explains an absence, and will not qualify as an excuse). These situations may require course withdrawal or "Incomplete" status on the final grade. Six absences mandate an automatic grade of "F." Three late arrivals (less than 15 min.) will equal one absence.

    Return to Top


    Grades will consist of the following:

  • Assignments @ 30%
  • Reading Responses @ 10%
  • Project 1 @ 25%
  • Project 2 @ 25%
  • Participation @ 10%
  • Projects and assignments will be graded on the following basis, listed in order of importance.

  • Development, creativity and originality of concept or problem solution
  • Technical development and demonstration of skills
  • Craftsmanship and presentation of work
  • Participation in classroom discussions and critiques in connection with the work
  • Your grade will be calculated according to the following standards:

  • A = Excellent (100-90%)- work pushes far beyond the project stipulations and shows clear evidence of extreme time, dedication, care and thought about the project as evidenced in effective execution of original/thoughtful ideas.
  • B = Good (80-89%)- work exceeds the basic criteria, provides creative solutions to the problems and shows technical proficiency. Student has made the project "theirs" in that they do not need to explain project stipulations before showing the work.
  • C = Average (70-79%)- work fulfills all requirements, does not expand on techniques shown in class, ideas are close derivations of popular culture.
  • D = Unsatisfactory (60-69%)- work might meet basic criteria but in a careless and/or thoughtless way. Technical proficiency is rudimentary and no chances were taken.
  • F = Failure (0-59%)- the work does not meet the basic criteria.
  • Late projects will be penalized a letter grade for every class period they are late. Turning a project in after the beginning of the critique counts as one class day late.

    Return to Top

    Lab Rules

    It is your responsibility to adhere to all rules regarding the use of the DMS labs and equipment. You will be given a sheet stating all rules. Please see Kate Burns in the DMS office before class if you need a form to access the DMS lab.

    Return to Top


    Solutions to assignments you submit will be your own work. A student who is discovered to have plagiarized another's work will immediately receive a grade of F for the course, and a recommendation for disciplinary action will be forwarded to the Dean of Students.

    Return to Top


    While you are not required to purchase the software that we are using, not having the software is no excuse for failing to complete your projects. It is your responsibility to work out times when you can use the DMS labs or to make other arrangements for doing your work. Please do not download and/or install trial versions of this software or any other onto campus computers. Flash can be purchased at academic pricing from online outlets and the University bookstore. Processing is free open source software and available for all three major operating systems.

    Return to Top

    Course Outline

    (The following schedule is open to revision at any point in the quarter.)

    01/03 - Introduction, Processing Intro

    01/08 - Drawing with Code, animating, reading 1 assigned, Assignment

    01/10 - Interaction, Project 1 description, Assignment 2

    01/15 - Functions and arrays, Dynamic files, assignment 3

    01/17 - Text and images, assignment 4, Project 1 Idea, Reading 2

    01/22 - Dealing with video

    01/24 - Dealing with sound

    01/29 - Reading 1 and 2 Discussion

    01/31 - Work in Progress

    02/05 - Project 1 Due

    02/07 - Project 2 Introduced, Arduino Introduction, Reading 3

    02/12 - Sensing Switches, Buttons,and Light

    02/14 - Outputting Sound, Light, Motion, Assignment 4

    02/19 - Hacking ready made devices , Reading 4

    02/21 - Arduino speaks to Processing, Assignment 5

    02/26 - Arduino speaks to Flash, Assignment 6

    02/28 - Gizmology continued

    03/04 - Reading 3 and 4 Discussion

    03/06 - Work in Progress

    03/11 - Final Critique - Project 2 Due

  • Project 1 = Audio makes the Video Star
  • Project 2 = "Hello World" - Real World Edition

  • Return to Top



    - Lecture One

  • Website
  • A Blog that tracks Blogs about Processing
  • First Set of Examples
  • Messa di Voce
  • Jhonny Chung Lee's Wii hacks
  • Perceptive Pixel's Multitouch

  • - Lecture Two

  • Example files from book
  • Jared Tarbell - processing artist

  • - Lecture Three

  • Shape of Song
  • Digital Acoustic Cartography
  • Designer Brendan Dawes
  • Artist Amit Pitaru

  • - Lecture Four

  • Mouse Over example using custom function
  • Mouse Over example using custom class

  • - Lecture Five

  • Second Set of Examples
  • Third set of Examples
  • A Sound Example
  • Sound w/ smoking Houses
  • Minim sound library

  • - Lecture Six

  • Final Music vizualizer w/ drag and Drop
  • Simple Drag and Drop
  • A non working image to sound converter

  • - Lecture Seven

  • A simple sampler machine

  • - Lecture Eight

  • SodaPlay site
  • They Rule
  • Scriptographer
  • The Endless Forest

  • - Lecture Nine

  • Reading #3 - When old Technology was New

  • - Lecture Ten

  • Site for arduino links and info
  • Arduino homepage
  • Arduino tutorials
  • Processing book files for arduino

  • - Lecture Ten

  • Ars Electronica
  • Paul Vanouse
  • Podcast about Tesla
  • VIDA - Art and Artificial Life

  • - Lecture Eleven

  • files to control quicktime movie with POT
  • files to use two POTs to control ellipse on the screen

  • Return to Top