Applications of SCRIBE: Systematic Observation and Analysis of Teacher
Student Interactions in Music

Robert A. Duke, Janice J. Buckner, Mary Ellen Cavitt, and Elaine Colprit
The University of
Texas at Austin

    Understanding the myriad complexities of the teaching-learning process consumes enormous amounts of time, effort, and energy on the part of those devoted to improving the process of education. For many observers, however, the relationships between students, teachers, subject matters, and environments seem so highly interactive and complex that any efforts to systematically describe the elements of the process are viewed circumspectly and deemed inadequate or reductionist. In fact, many who have found it impossible to construct explanations that can predict learning outcomes with any precision, instead ha\e declared teaching an "art" that, as such, comprises ineffable qualities that are not amenable to empirical investigation or operational definition (Dawe, 1984; Eisner, 1983; Gage, 1984: Rubin. 1985).
    Admittedly, anyone who has attempted to operationally define any single aspect of the teaching-leaning process and to assess its relationship to other variables in the mix %%ill find arguments about the "artistic" nature of teaching persuasive. Unfortunately. however. our inability to identify and describe with accuracy the relevant variables associated with teaching excellence diminishes our ability to assist novice teachers in improving their skills in the classroom or rehearsal hall.
    Years of systematic investigation have resulted in the identification of important variables that seem particularly germane to successful, productive changes in student behavior (Madsen & Duke, 1993); yet, the systematic assessment of specific variables that are associated with effective teaching seems no more reliable an indicator of effectiveness than are more global assessments in which observers simply rate the overall experience on a single scale of quality, for example (Madsen, Standley, Byo, & Cassidy, 1992). Broadly framed definitions of effective teaching certainly have helped narrow the focus of observers' attention, which has proven to be highly idiosyncratic (Duke, 1987; Duke & Blackman, 1991; Duke & Prickett, 1987; Madsen & Duke, 1985a, 1985b; Prickett & Duke, 1992; Standley & Greenfield, 1987), but the precise identification of the critical attributes of effective practice seems more elusive. Although the relative reliability and stability of global evaluations may adequately serve the purpose of identifying exceptionally high and low quality performance among practitioners, there remains the problem of accurately describing the essential qualities of exemplary teacher behavior, both for the purpose of better understanding the instructional process and for the purpose of providing more meaningful prescriptions for the improvement of practice among novices and professionals in need of remediation.
    Methods of systematic observation applied in music research and elsewhere include (1) a wide variety of time-sampling observation instruments designed to record specific aspects of teacher and student behavior and instructional progress (Duke & Madsen, 199 1; Madsen & Madsen, 1974; Madsen & Yarbrough, 1980), (2) written typescripts of verbalizations that include event timing and behavior categorization in terms of sequential patterns of instruction (Byo, 1994; Jellison & Wolfe, 1987; Price, 1983; Yarbrough & Price, 1981, 1989), (3) coded analyses of scripted curricula in which teacher and student behavior are categorized in terms of "learn units" (Greer, McCorkle, & Williams, 1989; Ingham & Greer, 1992), (4) calculation of timing and event probabilities associated with patterns of teacher and student behavior (Hawkins, Sharpe, & Ray, 1994), and (5) computerized recording of teacher and student behavior and the timing of progress toward instructional goals (Buckner, 1997; Duke, 1991; Siebenaler, in press; Younger Flores, 1995). Still other research has approached the observation and analysis of teaching and conducting from what is perhaps the broadest perspective possible, considering overall, or global, evaluations of effective teaching and rehearsing (Byo, 1990; Cassidy, 1990; Madsen & Geringer, 1989; Madsen, Standley, Byo, & Cassidy, 1992).
    Observers for decades have searched for elegant methods to describe the critical attributes of effective teaching, and their efforts to capture the process of education have viewed teachers and learners through many different lenses, each focused on different aspects of the process itself and obtaining varying degrees of clarity and resolution (Duke, 1994). Although it has been demonstrated that more- and less-effective teaching can be identified with a high measure of consistency, specification of the precise nature of effective teaching behavior-precise in the sense that the information is useful for the purposes of prescription-remains an elusive goal.

The problem [in providing useful and meaningful prescriptions] does not arise because of difficulty in observing effective teachers in their natural settings and determining what it is they do that is effective or ineffective; nor does the problem arise because specific effective ingredients are not subjected to experimental testing and subsequent confirmation; the problem comes from trying to put the best of research findings together in order to instruct future teachers. (Madsen & Duke, 1993, p. 10)

    The body of research literature devoted to instructional feedback is expansive, as is the research base concerning issues related to instructional presentation (e.g., curriculum, sequence of instruction). Likewise, the planning and implementation of instruction and the delivery of feedback are prominent components of teacher education curricula. Less attention has been directed toward the timing of instructional variables, however, although timing is central to nearly all aspects of human interaction. Time has a great deal to do with what's funny, what's considerate, what's expressive, what's interesting, what's useful, what's reinforcing, and what's memorable. Of course, the list of human behaviors that are affected by timing is virtually limitless. Often, when things happen is as important as what happens (Madsen, 1996).    Much research in human and other animal behavior has focused on the issue of timing with regard to learning and behavior change. Systematic measurement of temporal relationships among various aspects of human behavior has revealed reliable principles of learning and behavior that have predictive as well as explanatory implications. The subject of reinforcement schedules and their effects on operant behavior is perhaps the most widely and systematically studied topic encompassing the timing of events and its effect on learning (Cameron & Pierce, 1994). The prominence of time as an element in all known theories and principles of classical and operant conditioning is instructive. To speak of relationships between conditioned and unconditioned stimuli, or between reinforcement, punishment, and operant behavior absent consideration of the timing of events is to ignore what is perhaps the most basic mechanism in the learning process. Most systematic measurements of individual aspects of teaching performance (e.g., questions, feedback), however, are expressed in terms of frequency or proportion; less often are rate and mean duration included as explicit components of measurement (Yarbrough, 1988).
    Observation instruments designed to record the behavior of teachers and students may be thought of as lenses through which observers view the teaching-leaning process. This issue is extremely important, because an observer is likely to see only what the instrument or methodology permits him to see. Since every observational procedure includes some a priori determination of what will be observed, the familiar adage, "When all you've got is a hammer, everything around you starts to look like a nail," seems particularly relevant with regard to the tools of observation.
    When it comes to observing teaching, in particular, this issue becomes highly problematic, because there are so many things to look at and so many ways of looking at them. Teachers and students do lots of different things. How should all this behavior be categorized? Once categories have been determined, how should the now-categorized behaviors be measured? According to frequency, rate, duration, magnitude, proportion? Should certain behaviors be measured in relation to other behaviors? If so, which ones? The complexity of the interactions between teachers and students engaged in the process of education precludes simple answers to these questions, but their critical nature is apparent. Whatever decisions are made concerning the definitions of observation will illuminate certain aspects of the process and obscure certain others.
    Clearly, defining the relevant variables associated with effective teaching and offering meaningful prescriptive information to teachers at all levels of expertise are daunting goals, which require considerably more research that takes account of the aspect of time in the teaching-learning process. It seems that research concerning these questions would be facilitated by the application of usable tools that permit researchers, pedagogues, and novice teachers to gather relevant timing data quickly and easily.
    For this presentation, we describe several applications of an observation program, SCRIBE, which was designed explicitly for recording event 
timings in teacher-student interactions (Duke & Farra, 1996). The design of the program affords teachers and teacher educators a view of interactions between students and teachers that, heretofore, has been impractical or impossible to obtain. Based on current work with this type of analysis, the information provided by the system can change dramatically teachers' perceptions of their interactions with students and provide a systematic means of analyzing progress in the development of teaching skills. The software embodies two major innovations in observation and analysis of behavior through the application of computer technology: First, the opportunity for observers (e.g., student teachers and teacher educators) to design and "draw" customized "observation forms" (on-screen input windows) that focus on pertinent aspects of teacher and student behavior and that permit the input of observation data using the mouse and keyboard; second, the ability to obtain a pictographic representation of a teaching episode displayed along a time line, so that the relationships and timing between teacher and student behavior may be studied in detail. The timeline graph depicts the sequence and duration of each recorded behavior according to codes selected by the user.
    We describe applications of the program in several classes over the past two years and in several recent research investigations here at our own institution. It seems likely that this program will be applicable to any field that deals with analysis of human interactions. including clinical and experimental psychology, sociology, and business, as well as education. Classroom interactions in music are multifaceted and complex, which makes the task of systematic assessment of music teaching difficult at best. The search for appropriate dependent measures that may serve not only as evaluative assessments but also as sources of prescriptive information remains one of the most important challenges for research in music education.

References

Buckner, J. L. J. (1997). Assessment of teacher and student behavior in relation to the accomplishment of performance goals in piano lessons. Unpublished doctoral dissertation, The University of Texas at Austin.

Byo, J. L. (1990). Recognition of intensity contrasts in the gestures of beginning conductors. Journal of Research in Music Education, 38, 157-163.

Byo, J. L. (1994). Tracing the evolution of a research line: The role of sequential patterns in structuring the rehearsal. Journal of the World Association of Symphonic Bands and Ensembles, 1, 67-79.

Cameron, J., & Pierce, W. D. (1994). Reinforcement, reward, and intrinsic motivation: A meta-analysis. Review of Educational Research, 64, 
363-423.

Cassidy, J. W. (1990). Effect of intensity training of preservice teachers' instruction accuracy and delivery effectiveness. Journal of Research in 
Music Education,
38, 164-174.

Dawe, H. A. (1984). Teaching: Social science or performing art? Harvard Educational Review, 54, 111 - 114.

Duke, R. A. (1987). Observation of applied music instruction: The perceptions of trained and untrained observers. In C. K. Madsen & C. A. Prickett (Eds.), Applications of research in music behavior (pp. 115-124). Tuscaloosa, AL: The University of Alabama Press.

Duke, R. A. (199 1, November). Observation of instructional procedures in music: Documentation of temporal relationships between teacher and student behavior. Research presented at the meeting of the National Association for Music Therapy, San Diego, CA.

Duke, R. A. (1994). Bringing the art of rehearsing into focus: The rehearsal frame as a model for prescriptive analysis of rehearsal conducting. Journal of Band Research, 30(l), 78-95.

Duke, R. A., & Blackman, M. D. (1991). The relationship between observers' recorded teacher behavior and evaluation of music instruction. Journal of Research in Music Education, 39, 290-297.

Duke, R. A., & Farra, Y. (1996). SCRIBE: Simple Computer Recording Interface for Behavioral Evaluation [Computer program]. Austin, TX Learning and Behavior Resources.

Duke, R. A., & Madsen, C. K. (1991). Proactive versus reactive teaching: Focusing observation on specific aspects of instruction. Bulletin of the Council for Research in Music Education, 108, 1-14.

Duke, R. A., & Prickett, C. A. (1987). The effect of differentially focused observation on evaluation of instruction. Journal of Research in Music Education, 35, 27-37.

Eisner, E. W. (1983). The art and craft of teaching. Educational Leadership, 40, 4-13.

Gage, N. L. (1984). What do we know about teaching effectiveness? Phi Delta Kappan, 66, 87-90.

Greer, R. D., McCorkle, N., & Williams, G. (1989). A sustained analysis of the behaviors of schooling. Behavioral Residential Treatment, 4, 113-141.

Hawkins, A., Sharpe, T., & Ray, R. Toward instructional process measurability: An interbehavioral field systems perspective. In R. Gardner, III, D. M. Sainato, J. 0. Cooper, T. E. Heron, W. L. Heward, J. W. Eshleman, & T. A. Grossi (Eds.), Behavior analysis in education: Focus on measurably superior instruction (pp. 241-255). Pacific Grove, CA: Brooks/Cole Publishing

Ingham, M., & Greer, R. D. (1992). Functional relationships between supervisors' observations of teachers in observed and generalized 
settings. Journal of Applied Behavior Analysis, 25, 153-164.

Jellison, J. A., & Wolfe, D. E. (1987). Verbal training effects on teaching units: An exploratory study of music teaching antecedents and consequents. In C. K. 
Madsen & C. A. Prickett (Eds.), Applications of Research in Music Behavior (pp. 135-148). Tuscaloosa, AL: The University of Alabama Press.

Madsen, C. H., Jr., & Madsen, C. K. (1974). Teaching/Discipline: A positive approach for educational development (Expanded second edition for professionals). Boston: Allyn & Bacon.

Madsen, C. K. (1996). A matter of time. Unpublished manuscript.

Madsen, C. K., & Duke, R. A. (1985a). Observation of teacher/student interactions in music: Observer perceptions versus actual events. Journal of Research in Music Education, 33, 205-214.

Madsen, C. K., &Duke, R. A. (1985b). Perception of approval/disapproval in music. Council for Research in Music Education Bulletin, 85, 119-130.

Madsen, C. K., & Duke, R. A. (1993). Selection and development of prospective music teachers. Journal of Music Teacher Education, 3(l), 5-11.

Madsen, C. K., & Geringer, J. M. (1989). The relationship of teacher "on-task" to intensity and effective teaching. Canadian Music Educator, 30, 87-94.

Madsen, C. K., & Yarbrough, C. (1980). Competency-based music education. Englewood Cliffs, NJ: Prentice-Hall, Inc.

Madsen, C. K., Standley, J. M., Byo, J. L., & Cassidy, J. W. (1992). Assessment of effective teaching by instrumental music student teachers and experts. Update: Applications of Research in Music Education, 10(2), 20-24.

Price, H. E. (1983). The effect of conductor academic task presentation, conductor reinforcement, and ensemble practice on performers' musical achievement, attentiveness, and attitude. Journal of Research in Music Education, 31, 245-257.

Prickett, C. A., & Duke, R. A. (1992). Evaluation of music instruction by musicians and nonmusicians assigned differential observation tasks. Bulletin of the Council for Research in Music Education, 113, 41-50.

Rubin, L. J. (1985). Artistry in teaching. New York: Random House.

Siebenaler, D. J. (in press). Analysis of teacher-student interactions in the piano lessons of children and adults. Journal of Research in Music Education.

Standley, J. M., & Greenfield, D. G. (1987). The effect of a focused observation task and its transfer on the analysis of a kindergarten music class by pre-senior versus pre-internship music education/therapy majors. In C. K. Madsen & C. A. Prickett (Eds.), Applications of research in music behavior (pp. 99-114). Tuscaloosa, AL: The University of Alabama Press.

Yarbrough, C. (1988). Pacing and content in music teaching. Proceedings of Current Issues in Music Education Symposium, Ohio State University, 13, 9-28.

Yarbrough, C., & Price, H. E. (1981). Prediction of performer attentiveness based on rehearsal activity. Journal of Research in Music Education, 29, 209-217.

Yarbrough, C., & Price, H. E. (1989). Sequential patterns of instruction in music. Journal of Research in Music Education, 37, 179-187.

Younger Flores, K. (1995, April). Comparison of a computer assisted systematic observation instrument to independent, global measures of instructional effectiveness. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.