The Development and Testing of an Interactive Listening Guide System for Instructors and Students of Music Appreciation

Derrill Bodley

University of the Pacific , Benerd School of Education and Conservatory of Music

dbodley@uop.edu

The application of modern computer technology to instruction in music appreciation has received very little attention by researchers, particularly in the "interactivation" of instructional approaches used in standard music appreciation textbooks. The transference of instructional strategies embedded in textbooks to analogous or imitative computer-aided instruction appears to some researchers to be a waste of the power of computer technology. However, the effect of a computer-based multimedia system on an instructional process that requires coordination between two different, but equally important, media sources–sound and print–has not been adequately explored.

The current study examined the effectiveness of a researcher-designed, computer-based multimedia software system for music appreciation instruction. This software enables an instructor to make an interactive presentation of two forms of content commonly found in music appreciation textbooks, namely: 1) background information about a piece of music (the composer, performer, historical setting, etc.) and 2) a listening guide for the musical selection, consisting of textual descriptions of the musical elements of the piece as they occur from beginning to end.

Study Design

In this study, 52 subjects were selected from volunteers out of a music appreciation course at an urban community college. Selection was based on the level of participation in study events, including nine sets of factual and listening quizzes, three surveys, and a follow-up student listening guide project. Only the listening guide project was a required, graded assignment for the course. All of the other study events were optional. As a result, participation in the study, even among volunteers, varied considerably. Minimum levels of participation were established in terms of total number of events completed, and 52 of the volunteers participated at these minimum levels.

The study used a two-group, treatment-and-control design to compare the effectiveness of a computer-based system for presenting musical examples from audio CD’s with that of traditional textbook materials. The two screens of the computer-based system which emulated a textbook presentation were:

  1. a "FactSheet" screen, where factual background information about the musical selection or its composer could be given, and
  2. an interactive "ListeningGuide" screen that offered an animated and coordinated display and controls for playing the musical selection in various ways (Figure 1). A moving pointer indicates the relative time location, from beginning to end of the musical selection. Users may use standard audio CD-type controls on screen or begin playing at any point. A list of information about sections in the piece is displayed; the vertical spacing of the items is proportional to the length of time of each item. Each item is highlighted as it occurs during playback of the musical selection. A button appears next to each item, so users may activate a button to listen to only that portion of the musical selection. Special key combinations allow the instructor to create and edit the list of items to be displayed.
  • Figure 1.

     

    The researcher-designed software was developed using Hypercard 2.4.1, by Apple Computer, and Voyager’s CD Audio Toolkit (version 2.0).

    For each of the interactive listening guides used in the current study, the information on the "FactSheet" and "ListeningGuide" screens was taken directly from the textbook for the course, Music and musicians: An introduction (Megill, 1994). Sidebar definitions, for example, were converted to pop-up hypertext links on the "FactSheet" screen; clicking on an underlined word caused a small text box with an elaboration of the word’s meaning or associated information to be displayed. The list timing marks and associated commentary found in the textbook for a musical example were the basis for a matching list and commentary for the "ListeningGuide" screen (as in Figure 1 above), with only minor textual revisions to fit the size of the computer screen.

    The conversion of the function of textbook materials to a more interactive, multimedia format is an example of what is referred to by Allen (1986) as "interactivation". Materials that inherently provide mostly linear access can be "interactivated" to allow more non-linear exploration and greater control of flow by the user.

    The control group in the current study used media resources commonly employed in presentation of music in music listening courses such as music appreciation, music history, and music theory courses. A compact disc player was used to play the same recordings used in the experimental treatment. As musical selections were being played, the instructor wrote timing marks on the board, while students used listening guides printed in the textbook to read the commentary associated with the musical events. The instructor was careful to present the information through lecture and use of the textbook which corresponded to the information contained in the computer-based presentations, which she had also created.

    Implementation and Results

    Prior to the treatment phase of the study, a computer experience-and-attitude survey was given to all subjects. This survey was an adaptation, with only minor revision, of a previously-existing, ten-item Attitude Towards Computers survey by Reece and Gable (1982). Also prior to treatment, two sets of factual and listening quizzes were given. Factual quizzes were based on factual information identified through an immediately-preceding lecture, using the appropriate media for each group. Listening quizzes were based on identification, after hearing a portion of a musical selection, of descriptive terms that were included in the listening guide for the piece. Scoring of these pre-treatment quizzes showed no differences between the groups. However, the experimental, computer-based treatment group showed more of a pre-treatment affinity for computers and computer instruction.

    During the treatment, six sets of factual and listening quizzes were administered, each after a lecture presentation with musical examples being played. In addition, a final factual and listening quiz were given one week after treatment, as well as an attitude survey about the instructional experience. According to the survey, subjects in the experimental group showed a significantly higher appreciation for the instruction than those in the control group (F(1,50)=4.29, p=.04). However, although there was a trend toward higher factual quiz scores for the computer-treatment group, there was not enough data to sustain a claim of significance of the trend.

    In designing the study, it was thought that a useful measure of learning would be the transfer of understanding and experience of the exposure to listening guides in class. An authentic assessment task, according to Hart (1994), is a task related to a student’s current knowledge and experience base and yet still the students are tested "for what we want them to know". The student listening guide project involved students’ self-selecting music of their own choice and creating a paper listening guide for it. Techniques and procedures for doing the assignment using a CD player and watch were demonstrated in class. A scoring rubric was rigorously designed, including 1) four music appreciation instructors agreeing on ranking of five randomly-selected student listening guide products and 2) two instructors developing a quantitative scoring system, using a random sample of five additional student products. Agreement between the two raters exceeded 90%. However, no significant difference in the quality of student listening guides was found between the two groups.

    Limitations

    Specific conditions that may have limited the study’s effectiveness were:

    1. selection of subjects and effects of voluntary participation. Mandatory participation with study events affecting course grades would appear to be ethically appropriate in future implementations of the study, and would provide larger and more general sample populations.
    2. time of day of class sections used as groups for the study. The computer-based treatment section of the course met at 8:00-9:20am, while the textbook treatment section met at 9:30-10:40am. Learning style inventories, such as the Productivity Environmental Preference Survey of Dunn and Dunn (1993), identify time-of-day effects that should be controlled.
    3. length of time and number of events in treatment phase. Of four previous studies involving multimedia effects on music learning (Bauer, 1994; Fortnoy, 1993; Duitman, 1993; Hughes, 1991), those with longer subject exposure tended to observe significant effects.
    4. participation of a single instructor in the study. Although the instructor was apparently skilled at presenting equitable instruction in the two treatment settings, additional research should include a variety of instructional styles.
    5. gathering of data on the background characteristics of subjects. It was not possible to gather personality or learning style inventories, for example, for the current study.
    6. specifications of computer software design. Since the researcher’s intent in the current study was to avoid introducing design elements into the computer-based system that did NOT have analogous elements in textbooks, possible enhancement effects of computer-based instruction may have been omitted.
    7. specifications of musical and factual materials presented. The study was bound by the textbook and musical example resources selected for the course.
    8. selection of musical and factual quiz items. The study did not include evaluation–other than agreement between the researcher and the instructor–of the selection of items for factual and listening quizzes.

    Summary

    The study, then, reached an ambiguous conclusion typical of much research comparing the effect of media on learning: Although the measurements of achievement related to instruction and transfer of learning to related tasks were not apparently affected by the differences in study treatments, the appreciation of the instruction itself was higher for those who experienced the treatment involving computer-based technology. The tendency might be to agree with those who suggest that media do not make a difference (Clark, 1983). However, as Kozma (1991) points out, this view denies the importance of the association of auditory media with the particular symbolic system that music alone embodies. Further, more extensive research is necessary to explore the connection of that symbol system with understandings and verbal content that music appreciation instructors wish their students to consider. Research begun in this study is continuing at the present time, with another set of music appreciation classes.

    References

    Allen, B. S. (1986). A theoretical framework for interactivating linear video. Journal of Computer Based Instruction, 134., 107-12.

    Bauer, W. I. (1994). The relationships among elements of learning style, mode of instruction, and achievement of college music appreciation students. Unpublished Ph.D., Kent State University; 0101.

    Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 534., 445-459.

    Duitman, H. E. (1993). Using hypermedia to enrich the learning experience of college students in a music appreciation course. Unpublished Ph.D., The Ohio State University.

    Dunn, R. S., & Dunn, K. J. (1993). Teaching secondary students through their individual learning styles : practical approaches for grades 7-12. Boston: Allyn and Bacon.

    Fortnoy, P. M. (1993). Learning style and music instruction via an interactive audio CD-ROM: An exploratory study. Unpublished Ph.D., University Of Miami; 0125.

    Hart, Diane (1994). Authentic assessment: A handbook for educators. Menlo Park, CA: Addison-Wesley.

    Hughes, T. E. (1991). A hypermedia listening station for the college music literature class (listening station). Unpublished A.Mus.D., The University Of Arizona; 0009.

    Hypercard (Version 2.4.1) [Computer Program]. Cupertino: Apple Computer.

    Kozma, R. B. (1991). Learning with media. Review of Educational Research, 612., 179-211.

    Megill, D. D. (1994). Music and musicians: An introduction. Englewood Cliffs, NJ: Prentice-Hall.

    Voyager CD Audio Toolkit (Version 2.0) [Computer Program]. (1992). Santa Monica, CA: Voyager.