A Demonstration of Integrating Multimedia into Web Pages for Music
Education

Steven G. Estrella, Temple University

    The World Wide Web is rapidly becoming a rich multimedia environment that can be of great use to music educators and their students. Contemporary web sites can include text, photographs, graphics (including music notation), digital audio, MIDI data, animations, and digital video. Music educators, therefore, can now design web sites to teach a variety of topics in music theory and music history, and even demonstrate techniques on a given instrument. Such web sites can be accessed by students in multiple locations using different computer platforms. Thus the expense and compatibility issues inherent in producing and distributing CD-ROM or disk-based multimedia presentations are eliminated in favor of a universal, multiplatform multimedia development environment.
    In the next 30 minutes I will demonstrate techniques for integrating digital audio, MIDI data, notation graphics, music-related animations, and digital video into world wide web pages devoted to music education. The presentation will be cover audio, still images, and moving images.

Audio
    When sound is digitally recorded to a hard disk, a file format is assigned by the recording software. AIFF (Audio Interchange File Format), developed by Apple Computer in 1988, is one of the most commonly used audio file formats on Macintosh, Windows, and even Unix computers. If you use the Internet frequently you have probably also encountered sound files in WAV and AU formats. The WAY format is used by Microsoft Windows and the AU file format is used by computers running the UNIX operating system. Shareware and commercial sound editing programs can create and convert among these and many other file formats.
    The quality of a digital audio file is indicated by its sampling rate and sampling resolution. An analogy to film is useful here. Sampling rate is analogous to frame rate in a movie. Videos display films at 30 frames per second. At less than 15 frames per second the motion looks choppy and unnatural. Similarly the more times per second a sound is measured by an analog to-digital converter chip, the more accurate the reproduction. Sound sampled at forty-four thousand times per second (44 kilohertz or 44 kHz) is much more accurate than sound sampled at 22 or I I kHz. Sampling resolution is analogous to the visual quality of each individual frame of a movie. Color film captures more information per frame than does black and white film. Similarly, 16-bit sampling captures more information per sample than 8-bit sampling.
    The higher the quality of sound, the more space it takes to store the sound. A compact disc can store about 74 minutes of stereo sound recorded at a sampling rate of 44 kHz and a sampling resolution of 16-bits. If you reduce the quality to 22 kHz, 8-bit stereo sound, however, you can store approximately 300 minutes of audio on the same disc. In other words, one minute of stereo sound takes 10 megabytes of storage at 44 kHz, 16-bit quality, and only 2.5 megabytes of storage at 22 kHz, 8-bit quality. When producing sound for use on the Internet, therefore, one must be considerate of the user's needs and limitations. Unless you have a compelling reason to use 44 kHz, 16-bit samples, you should consider using lower quality sound samples to avoid subjecting your users to long download times.
Transcript of Demonstration I
    I have prepared two AIFF files of an excerpt from "Doodlin" by Horace Silver and John Hendricks. The AIFF file recorded at 44 kHz, 16-bit quality is approximately four times as large as the same file recorded at 22 kHz, 8-bit quality. The difference in sound quality, however, is less dramatic (demonstration). The sound quality of the 22 kHz, 8-bit file is adequate for many educational uses. AIFF sound files can be converted into QuickTime movies using MoviePlayer 2.5 and loaded onto any web server. They can then be included in web pages by using the appropriate code found in the "HTML Coding" section of the handout. (End of demonstration)
MIDI
    Sound file formats like AIFF use a lot of disk space because all the information needed to create the sound has to be stored in the file. The Musical Instrument Digital Interface (MIDI) file format, however, stores only a description of a performance. MIDI is a hardware and software standard that, among other things, allows users to record a complete description of a lengthy musical performance using only a small amount of disk space. The information needed to produce different timbres to create the actual sound is stored in a synthesizer attached to the user's computer. Using MIDI, Beethoven's Fifth Symphony uses about 1.3 megabytes of storage and can fit on one floppy disk. Using ~ digital audio file format like AIFF, the same symphony uses more than 300 megabytes of hard disk storage. One problem with MIDI is that the quality of the actual sound will vary depending on the quality of the computer's sound hardware. For educational applications, however, MIDI-generated sound can be used to demonstrate musical ideas quite effectively. Another problem with MIDI in the past was the lack of a standard sound set. A MIDI file designed to be played with piano and flute sounds might be realized with organ and clarinet on another person's computer. This problem was partially solved by the advent of the General NMI standard which created a standard set of 128 sounds. Virtually all MIDI files today are distributed in General MIDI format. Still it was left to the owner of each computer to be sure their sound hardware could play the General MIDI sounds. Apple Computer solved the problem with the latest version of its QuickTime software. Apple Computer's QuickTime Software
    QuickTime began as a set of system extensions to Macintosh System 7 to allow users to play digitized video in a small window on the screen. Today QuickTime is a comprehensive multimedia standard for storing video, animations, and sound in a variety of formats. It is also a cross-platform standard, meaning that QuickTime movies can be viewed and heard using computers running Mac OS, Windows, or even UNIX.
    The latest version of QuickTime, available for free from Apple's web site at www.apple.com, comes with MoviePlayer 2.5. MoviePlayer can convert standard MIDI files into QuickTime movies that can be played back by any Macintosh II or later computer or any PC with a sound card and Windows 3.1 or later. QuickTime MIDI movies use just a little more disk storage space than the MIDI files on which they are based. The actual sound is produced by a software synthesizer that QuickTime installs on the computer's hard disk.
    MoviePlayer can be used to convert audio from compact discs into QuickTime movies that can be used in multimedia presentations. MoviePlayer can be used to add sound and text tracks to digital video. Descriptive voice narrative can be added to a QuickTime MIDI movie containing a full performance of a complex work. For more detailed and advanced editing of video and audio, of course, you might purchase professional software like Adobe Premiere and MacroMedia SoundEdit 16. Using MoviePlayer 2.5 and other free and shareware software, however, you can create many multimedia materials for use on the Internet.
Transcript of Demonstration 2
   
I have prepared a standard MIDI file of Bach's Invention No. 4 in d minor. After launching MoviePlayer 2.5, 1 converted the Invention into a QuickTime movie by choosing "open" from the "File" menu. I then located the MIDI file and clicked the "convert" button. In the resulting "Save As" dialog box, I clicked the "Options" button to make the movie compatible with QuickTime 2.0 and add a little silence at the beginning and end of the movie. I have found that adding a little silence makes the beginning and ending of playback a bit smoother. I then saved the movie to disk using any name that came to mind. Once the movie was saved I selected timbres to be used in the performance by choosing "Get Info" from the "Movie" menu and altering the instruments in the music track. I then chose "Save As" to rename the movie, make it self-contained, and make it playable on non-Apple computers. Since this is the actual file that will be uploaded to my web server, I had to take care to name it properly. All web servers use the file name extension ".mov" to designate QuickTime movies so it is important to save movies with this extension. It is also important to avoid spaces in the file name and limit it to 8 characters before the extension if the file is to be loaded onto a Windows-based web server. Macintosh and UNIX web servers, of course, can recognize much longer file names. The resulting file is quite small, approximately 33k in size, and can be easily downloaded by anyone using the web, even with a slow modem. Conversely, even a low-quality AIFF file of the same piece would be well over a megabyte in size and impractical for modem users to download. QuickTime movie files can be loaded onto any web server and included in web pages by using the appropriate code found in the "HTML Coding" section of the handout. (End of demonstration)

Still Images
    The number of graphic file formats used on various computer platforms far exceeds the number of sound file formats. Fortunately, a standard graphic file format was agreed upon very early in the development of the world wide web. The Graphic Interchange Format (GIF) is the most commonly used format on the web. GIF files are compact in size and offer good image quality. JPEG graphics, however, are used frequently for photographs or high-quality artwork. JPEG files are generally smaller than GIF files of similar quality. GIF files, however, can be prepared in an interlaced file format so that the browser displays the graphic gradually instead of waiting for the entire file to load. GIF files can also contain multiple images which can be displayed in sequence to produce animations. For music notation graphics, small animations, and images other than photographs, choosy webmasters choose GIF.
Demonstration 3
   
I will now demonstrate one method of converting music notation graphics into the GIF format used on the web.
    I created a Finale music notation file of a four-measure excerpt of Bach's Invention No. 4. The excerpt was then converted to an encapsulated postscript (EPS) graphic using the "compile postscript" menu command available within Finale. The EPS file was then edited using SuperPaint and saved as a PICT file. Finally the PICT file was converted to GIF format using Graphic Converter, a shareware graphic conversion program. This method requires a graphics program like SuperPaint or the graphics module of ClarisWorks to convert the EPS files into a PICT file, and a GIF conversion program to convert the PICT file to a GIF file.
    If your music notation program does not allow you to export the notation to an EPS or PICT file, you can use the standard Macintosh screen dump command (Command-Shift-3) to export the entire screen to a PICT file. The PICT file can then be opened, cropped, and converted to GIF format using Graphic Converter. GIF files can be loaded onto any web server and included in web pages by using the appropriate code found in the "HTML Coding" section of the handout. (End of demonstration)

Moving Images (animations and digital video)
    Scrolling notation is one popular technique for enhancing music reading within multimedia presentations. Many music notation programs, like Finale, allow users to watch their notation scroll by on the screen as the music plays in synchronization. By using a screen capture utility, like CameraMan, the scrolling notation can be saved as a QuickTime movie file. MoviePlayer 2.5 can then be used to add a MIDI file, vocal commentary, and text titles to the scrolling notation can be final product can be published on a web site as a QuickTime movie.
Demonstration 4
    To create a scrolling notation movie of Bach's Invention #4, 1 began with a music notation file in Finale. Within Finale, I chose the Playback window and set the playback tempo. I then resized the window so that the notation would scroll in the upper left comer of the screen. Next, I switched to the CameraMan screen-capture software and set the screen capture area to encompass only the notation portion of the screen. I also set the software to NOT record sound because I intended to add MIDI data to the scrolling notation movie. Next, I returned to Finale, tapped a keyboard sequence to begin capturing the screen, and clicked the play button in the playback window. When the piece was finished, I tapped another keyboard sequence to end screen capture and saved the captured movie as "Bach Movie".
    I then switch to MoviePlayer 2.5, opened both "Bach Movie" and "BachInv4.mov" which contains the MIDI file I converted in demonstration 2. The MIDI file used in the creation of that movie, of course, was recorded at the same tempo as that of the scrolling notation in "Bach Movie". I then chose "Select All" from the "Edit" menu and then "Copy" from the "Edit" menu. I then clicked at the beginning of "Bach Movie", held down the "option" key on the keyboard, and selected "Add" from the "Edit" menu. By using the "option" key, I was able to overlay the MIDI data on top of the notation movie. Without the "option" key, the MIDI data would have been inserted before the notation movie. I then saved the file with the name "BachScrolling.mov".
    'Me "Modes" web site, shown here, combines many of the techniques demonstrated above. Notice how Netscape Navigator embeds appropriate controls into the web page in response to the "embed" tag used in the HTML code. The "BachScrolling.mov" file is used to illustrate the minor mode. (End of demonstration)
Using Video to Teach Instrumental Technique and Maintenance
    Music teachers sometimes use video to demonstrate instrumental techniques. Using a computer with video input, video demonstrations can be digitized and made available on a web site. For nonmusical demonstrations, such as instrument maintenance, QuickTime movies can be converted to animated GIF's to save disk space and download time. Any necessary vocal commentary can then be replaced by written text.
Demonstration 5
    Observe a QuickTime movie demonstrating recorder technique. This movie requires synchronized audio and narrative in order for it to achieve its musical purpose. A non-musical demonstration such as instrument maintenance, however, could be achieved through use of a silent animation which loads much more quickly. Using GIFBuilder, an animated GIF file showing the cleaning of a recorder, was created from a series of still pictures. A text block explaining the maintenance was substituted for the voice narrative of the original movie. Animated GIFs are adequate for explaining non-musical processes but QuickTime movies are needed for actually demonstrating musical techniques on an instrument. Although the movies are embedded in this demonstration web page, you should probably avoid embedding large movies because of the prohibitive download times they pose for modem users. Instead, export the first frame of the movie to a PICT file, convert that file to GIF format, and load it on the page with a link to the complete movie.
    Animated GIF files can also be used to simply enhance the appearance of any web page. This page displays an animated GIF of a recorder being swabbed. GIFBuilder software can be used to create animations that loop one or more times or loop continuously. (End of demonstration)

Adding Complex Interactivity
    For more complex interactivity, such as administering and grading tests on-line, it may be necessary to use a traditional multimedia development environment like HyperCard, SuperCard, or Director. Using web browser plugin software, projects created with these development environments can be used by a wide audience on both Macintosh and Windows platforms.
Demonstration 6
    On this web page, I have a demonstration version of a music test I am currently developing. It will be published on the web using the Roadster Plugin for SuperCard by Allegiant Technologies. The test plays back music samples and asks the student to determine if they are the same or different. Students receive their test scores immediately and their responses are sent to me via e-mail for statistical analysis. Creating content that requires the use of plugins limits your audience because not everyone will have the time or skill needed to download and correctly install the plugin software. The alternative to plugins is to learn the complexities of Java programming. Using Java, however, also limits your audience because not all browsers fully support Java applications. For now, the plugin solution seems to be the easiest way to add complex interactivity to web sites. Given the pace of web development, however, it is likely that this situation will change within a year or two. (End of demonstration)

HTML Coding for Multimedia
    The latest versions of Netscape Navigator and Microsoft Internet Explorer both allow content creators the option of referencing (i.e. linking) or embedding multimedia objects. Referencing a multimedia object is similar to referencing a related web site. HTML code similar to the following will display a link to allow visitors to a page to download and experience a sound, movie, or graphic stored in the "multimedia" directory of a server called "www.myserver.edu".

    To reference a sound file:
        <A HREF="http://www.myserver.edu/multimedia/mysound.aiff'>Click here to hear the sound.</A>

    To reference a movie file:
        <A HREF="http://www.myserver.edu/multimedia/mymovie.mov">Click here to see the movie.</A>

    To reference a graphic file:
        <A HREF="http://www.myserver.edu/multimedia/mygraphic.gif">Click here to see the picture.</A>

    Embedding a multimedia object is a bit different in that the movie file is loaded as part of the web page. With QuickTime movies, the embed tag calls the QuickTime Plugin (version 1. 1 is the latest). When the plugin is present, recent versions of Netscape Navigator and Microsoft Internet Explorer respond to the embed tag by displaying appropriate controls for the user to play the QuickTime movie file. HTML code similar to the following will automatically load a movie file stored in the "multimedia" directory of a server called "www.myserver.edu".

    To embed a movie file:
        <EMBED SRC="http://www.myserver.edu/multimedia/mymovie.mov" WIDTH=160 HEIGHT=144>

    In addition to WIDTH and HEIGHT, there are a number of other parameters you can specify in the EMBED tag to control how your movie is presented. These are explained in the QuickTime Webmasters page at http://quicktime.apple.com. One popular option is the AUTOPLAY parameter which can be used to begin playing the movie file as soon as it is loaded.
    Embedding a graphic is fairly straightforward and familiar to even novice webmasters. The width and height tags are optional but recommended. When they are absent, many browsers respond by delaying the display of any text that comes after the graphic. When they are present, all text loads first, followed by the graphics. It is kind to your users to give them something to read while they wait for the graphics to load. Also, use the ALT tag to assist those who browse the web with text-only browsers like lynx.

    To embed a graphic file:
        <IMG SRC="http://www.myserver.edu/multimedia/mygraphic.gif' width=100 height=160 border--O ALT="A picture of my dog.'5

    Some multimedia development environments, like SuperCard by Allegiant Technologies, publish web browser plugins to allow webmasters to include fully interactive applications in their web sites. The basic embed tag is used below. Each development environments plugin will have its own unique parameters which can be added to the basic width and height options.

    To embed a SuperCard project to be played by the Roadster plugin:
        <EMBED SRC="http://www.myserver.edu/multimedia/myproject.sca" WIDTH =512 HEIGHT = 342>