Robert A. Duke, Janice J.
Buckner, Mary Ellen Cavitt, and Elaine Colprit
The University of Texas
at Austin
Understanding the myriad complexities of the teaching-learning
process consumes enormous amounts of time, effort, and energy on the
part of those devoted to improving the process of education. For many
observers, however, the relationships between students, teachers,
subject matters, and environments seem so highly interactive and
complex that any efforts to systematically describe the elements of
the process are viewed circumspectly and deemed inadequate or
reductionist. In fact, many who have found it impossible to construct
explanations that can predict learning outcomes with any precision,
instead ha\e declared teaching an "art" that, as such, comprises
ineffable qualities that are not amenable to empirical investigation
or operational definition (Dawe, 1984; Eisner, 1983; Gage, 1984:
Rubin. 1985).
Admittedly, anyone who has attempted to operationally define any
single aspect of the teaching-leaning process and to assess its
relationship to other variables in the mix %%ill find arguments about
the "artistic" nature of teaching persuasive. Unfortunately. however.
our inability to identify and describe with accuracy the relevant
variables associated with teaching excellence diminishes our ability
to assist novice teachers in improving their skills in the classroom
or rehearsal hall.
Years of
systematic investigation have resulted in the identification of
important variables that seem particularly germane to successful,
productive changes in student behavior (Madsen & Duke, 1993);
yet, the systematic assessment of specific variables that are
associated with effective teaching seems no more reliable an
indicator of effectiveness than are more global assessments in which
observers simply rate the overall experience on a single scale of
quality, for example (Madsen, Standley, Byo, & Cassidy, 1992).
Broadly framed definitions of effective teaching certainly have
helped narrow the focus of observers' attention, which has proven to
be highly idiosyncratic (Duke, 1987; Duke & Blackman, 1991; Duke
& Prickett, 1987; Madsen & Duke, 1985a, 1985b; Prickett &
Duke, 1992; Standley & Greenfield, 1987), but the precise
identification of the critical attributes of effective practice seems
more elusive. Although the relative reliability and stability of
global evaluations may adequately serve the purpose of identifying
exceptionally high and low quality performance among practitioners,
there remains the problem of accurately describing the essential
qualities of exemplary teacher behavior, both for the purpose of
better understanding the instructional process and for the purpose of
providing more meaningful prescriptions for the improvement of
practice among novices and professionals in need of
remediation.
Methods
of systematic observation applied in music research and elsewhere
include (1) a wide variety of time-sampling observation instruments
designed to record specific aspects of teacher and student behavior
and instructional progress (Duke & Madsen, 199 1; Madsen &
Madsen, 1974; Madsen & Yarbrough, 1980), (2) written typescripts
of verbalizations that include event timing and behavior
categorization in terms of sequential patterns of instruction (Byo,
1994; Jellison & Wolfe, 1987; Price, 1983; Yarbrough & Price,
1981, 1989), (3) coded analyses of scripted curricula in which
teacher and student behavior are categorized in terms of "learn
units" (Greer, McCorkle, & Williams, 1989; Ingham & Greer,
1992), (4) calculation of timing and event probabilities associated
with patterns of teacher and student behavior (Hawkins, Sharpe, &
Ray, 1994), and (5) computerized recording of teacher and student
behavior and the timing of progress toward instructional goals
(Buckner, 1997; Duke, 1991; Siebenaler, in press; Younger Flores,
1995). Still other research has approached the observation and
analysis of teaching and conducting from what is perhaps the broadest
perspective possible, considering overall, or global, evaluations of
effective teaching and rehearsing (Byo, 1990; Cassidy, 1990; Madsen
& Geringer, 1989; Madsen, Standley, Byo, & Cassidy,
1992).
Observers
for decades have searched for elegant methods to describe the
critical attributes of effective teaching, and their efforts to
capture the process of education have viewed teachers and learners
through many different lenses, each focused on different aspects of
the process itself and obtaining varying degrees of clarity and
resolution (Duke, 1994). Although it has been demonstrated that more-
and less-effective teaching can be identified with a high measure of
consistency, specification of the precise nature of effective
teaching behavior-precise in the sense that the information is useful
for the purposes of prescription-remains an elusive goal.
The problem [in providing useful and meaningful prescriptions] does not arise because of difficulty in observing effective teachers in their natural settings and determining what it is they do that is effective or ineffective; nor does the problem arise because specific effective ingredients are not subjected to experimental testing and subsequent confirmation; the problem comes from trying to put the best of research findings together in order to instruct future teachers. (Madsen & Duke, 1993, p. 10)
The
body of research literature devoted to instructional feedback is
expansive, as is the research base concerning issues related to
instructional presentation (e.g., curriculum, sequence of
instruction). Likewise, the planning and implementation of
instruction and the delivery of feedback are prominent components of
teacher education curricula. Less attention has been directed toward
the timing of instructional variables, however, although timing is
central to nearly all aspects of human interaction. Time has a great
deal to do with what's funny, what's considerate, what's expressive,
what's interesting, what's useful, what's reinforcing, and what's
memorable. Of course, the list of human behaviors that are affected
by timing is virtually limitless. Often, when things happen is
as important as what happens (Madsen,
1996). Much research in human and other
animal behavior has focused on the issue of timing with regard to
learning and behavior change. Systematic measurement of temporal
relationships among various aspects of human behavior has revealed
reliable principles of learning and behavior that have predictive as
well as explanatory implications. The subject of reinforcement
schedules and their effects on operant behavior is perhaps the most
widely and systematically studied topic encompassing the timing of
events and its effect on learning (Cameron & Pierce, 1994). The
prominence of time as an element in all known theories and principles
of classical and operant conditioning is instructive. To speak of
relationships between conditioned and unconditioned stimuli, or
between reinforcement, punishment, and operant behavior absent
consideration of the timing of events is to ignore what is perhaps
the most basic mechanism in the learning process. Most systematic
measurements of individual aspects of teaching performance (e.g.,
questions, feedback), however, are expressed in terms of frequency or
proportion; less often are rate and mean duration included as
explicit components of measurement (Yarbrough, 1988).
Observation instruments designed to record the
behavior of teachers and students may be thought of as lenses through
which observers view the teaching-leaning process. This issue is
extremely important, because an observer is likely to see only what
the instrument or methodology permits him to see. Since every
observational procedure includes some a priori determination of what
will be observed, the familiar adage, "When all you've got is a
hammer, everything around you starts to look like a nail," seems
particularly relevant with regard to the tools of observation.
When it comes to observing teaching, in
particular, this issue becomes highly problematic, because there are
so many things to look at and so many ways of looking at them.
Teachers and students do lots of different things. How should all
this behavior be categorized? Once categories have been determined,
how should the now-categorized behaviors be measured? According to
frequency, rate, duration, magnitude, proportion? Should certain
behaviors be measured in relation to other behaviors? If so, which
ones? The complexity of the interactions between teachers and
students engaged in the process of education precludes simple answers
to these questions, but their critical nature is apparent. Whatever
decisions are made concerning the definitions of observation will
illuminate certain aspects of the process and obscure certain
others.
Clearly, defining the relevant variables
associated with effective teaching and offering meaningful
prescriptive information to teachers at all levels of expertise are
daunting goals, which require considerably more research that takes
account of the aspect of time in the teaching-learning process. It
seems that research concerning these questions would be facilitated
by the application of usable tools that permit researchers,
pedagogues, and novice teachers to gather relevant timing data
quickly and easily.
For this presentation, we describe several
applications of an observation program, SCRIBE, which was designed
explicitly for recording event
timings in teacher-student interactions (Duke & Farra, 1996). The
design of the program affords teachers and teacher educators a view
of interactions between students and teachers that, heretofore, has
been impractical or impossible to obtain. Based on current work with
this type of analysis, the information provided by the system can
change dramatically teachers' perceptions of their interactions with
students and provide a systematic means of analyzing progress in the
development of teaching skills. The software embodies two major
innovations in observation and analysis of behavior through the
application of computer technology: First, the opportunity for
observers (e.g., student teachers and teacher educators) to design
and "draw" customized "observation forms" (on-screen input windows)
that focus on pertinent aspects of teacher and student behavior and
that permit the input of observation data using the mouse and
keyboard; second, the ability to obtain a pictographic representation
of a teaching episode displayed along a time line, so that the
relationships and timing between teacher and student behavior may be
studied in detail. The timeline graph depicts the sequence and
duration of each recorded behavior according to codes selected by the
user.
We describe applications of the program in several
classes over the past two years and in several recent research
investigations here at our own institution. It seems likely that this
program will be applicable to any field that deals with analysis of
human interactions. including clinical and experimental psychology,
sociology, and business, as well as education. Classroom interactions
in music are multifaceted and complex, which makes the task of
systematic assessment of music teaching difficult at best. The search
for appropriate dependent measures that may serve not only as
evaluative assessments but also as sources of prescriptive
information remains one of the most important challenges for research
in music education.
References
Buckner, J. L. J. (1997). Assessment of teacher and student
behavior in relation to the accomplishment of performance goals in
piano lessons. Unpublished doctoral dissertation, The University
of Texas at Austin.
Byo, J. L. (1990). Recognition of intensity contrasts in the gestures
of beginning conductors. Journal of Research in Music
Education, 38, 157-163.
Byo, J. L. (1994). Tracing the evolution of a research line: The role
of sequential patterns in structuring the rehearsal. Journal of
the World Association of Symphonic Bands and Ensembles, 1,
67-79.
Cameron, J., & Pierce, W. D. (1994). Reinforcement, reward, and
intrinsic motivation: A meta-analysis. Review of Educational
Research, 64,
363-423.
Cassidy, J. W. (1990). Effect of intensity training of preservice
teachers' instruction accuracy and delivery effectiveness. Journal
of Research in
Music Education, 38, 164-174.
Dawe, H. A. (1984). Teaching: Social science or performing art?
Harvard Educational Review, 54, 111 - 114.
Duke, R. A. (1987). Observation of applied music instruction: The
perceptions of trained and untrained observers. In C. K. Madsen &
C. A. Prickett (Eds.), Applications of research in music
behavior (pp. 115-124). Tuscaloosa, AL: The University of Alabama
Press.
Duke, R. A. (199 1, November). Observation of instructional
procedures in music: Documentation of temporal relationships between
teacher and student behavior. Research presented at the meeting
of the National Association for Music Therapy, San Diego, CA.
Duke, R. A. (1994). Bringing the art of rehearsing into focus: The
rehearsal frame as a model for prescriptive analysis of rehearsal
conducting. Journal of Band Research, 30(l), 78-95.
Duke, R. A., & Blackman, M. D. (1991). The relationship between
observers' recorded teacher behavior and evaluation of music
instruction. Journal of Research in Music Education, 39,
290-297.
Duke, R. A., & Farra, Y. (1996). SCRIBE: Simple Computer
Recording Interface for Behavioral Evaluation [Computer
program]. Austin, TX Learning and Behavior Resources.
Duke, R. A., & Madsen, C. K. (1991). Proactive versus reactive
teaching: Focusing observation on specific aspects of instruction.
Bulletin of the Council for Research in Music Education, 108,
1-14.
Duke, R. A., & Prickett, C. A. (1987). The effect of
differentially focused observation on evaluation of instruction.
Journal of Research in Music Education, 35, 27-37.
Eisner, E. W. (1983). The art and craft of teaching. Educational
Leadership, 40, 4-13.
Gage, N. L. (1984). What do we know about teaching effectiveness?
Phi Delta Kappan, 66, 87-90.
Greer, R. D., McCorkle, N., & Williams, G. (1989). A sustained
analysis of the behaviors of schooling. Behavioral Residential
Treatment, 4, 113-141.
Hawkins, A., Sharpe, T., & Ray, R. Toward instructional process
measurability: An interbehavioral field systems perspective. In R.
Gardner, III, D. M. Sainato, J. 0. Cooper, T. E. Heron, W. L. Heward,
J. W. Eshleman, & T. A. Grossi (Eds.), Behavior analysis in
education: Focus on measurably superior instruction (pp.
241-255). Pacific Grove, CA: Brooks/Cole Publishing
Ingham, M., & Greer, R. D. (1992). Functional relationships
between supervisors' observations of teachers in observed and
generalized
settings. Journal of Applied Behavior Analysis, 25,
153-164.
Jellison, J. A., & Wolfe, D. E. (1987). Verbal training effects
on teaching units: An exploratory study of music teaching antecedents
and consequents. In C. K.
Madsen & C. A. Prickett (Eds.), Applications of Research in
Music Behavior (pp. 135-148). Tuscaloosa, AL: The University of
Alabama Press.
Madsen, C. H., Jr., & Madsen, C. K. (1974).
Teaching/Discipline: A positive approach for educational
development (Expanded second edition for professionals). Boston:
Allyn & Bacon.
Madsen, C. K. (1996). A matter of time. Unpublished
manuscript.
Madsen, C. K., & Duke, R. A. (1985a). Observation of
teacher/student interactions in music: Observer perceptions versus
actual events. Journal of Research in Music Education, 33,
205-214.
Madsen, C. K., &Duke, R. A. (1985b). Perception of
approval/disapproval in music. Council for Research in Music
Education Bulletin, 85, 119-130.
Madsen, C. K., & Duke, R. A. (1993). Selection and development of
prospective music teachers. Journal of Music Teacher
Education, 3(l), 5-11.
Madsen, C. K., & Geringer, J. M. (1989). The relationship of
teacher "on-task" to intensity and effective teaching. Canadian
Music Educator, 30, 87-94.
Madsen, C. K., & Yarbrough, C. (1980). Competency-based music
education. Englewood Cliffs, NJ: Prentice-Hall, Inc.
Madsen, C. K., Standley, J. M., Byo, J. L., & Cassidy, J. W.
(1992). Assessment of effective teaching by instrumental music
student teachers and experts. Update: Applications of Research in
Music Education, 10(2), 20-24.
Price, H. E. (1983). The effect of conductor academic task
presentation, conductor reinforcement, and ensemble practice on
performers' musical achievement, attentiveness, and attitude.
Journal of Research in Music Education, 31, 245-257.
Prickett, C. A., & Duke, R. A. (1992). Evaluation of music
instruction by musicians and nonmusicians assigned differential
observation tasks. Bulletin of the Council for Research in Music
Education, 113, 41-50.
Rubin, L. J. (1985). Artistry in teaching. New York: Random
House.
Siebenaler, D. J. (in press). Analysis of teacher-student
interactions in the piano lessons of children and adults. Journal
of Research in Music Education.
Standley, J. M., & Greenfield, D. G. (1987). The effect of a
focused observation task and its transfer on the analysis of a
kindergarten music class by pre-senior versus pre-internship music
education/therapy majors. In C. K. Madsen & C. A. Prickett
(Eds.), Applications of research in music behavior (pp.
99-114). Tuscaloosa, AL: The University of Alabama Press.
Yarbrough, C. (1988). Pacing and content in music teaching.
Proceedings of Current Issues in Music Education Symposium, Ohio
State University, 13, 9-28.
Yarbrough, C., & Price, H. E. (1981). Prediction of performer
attentiveness based on rehearsal activity. Journal of Research in
Music Education, 29, 209-217.
Yarbrough, C., & Price, H. E. (1989). Sequential patterns of
instruction in music. Journal of Research in Music Education,
37, 179-187.
Younger Flores, K. (1995, April). Comparison of a computer
assisted systematic observation instrument to independent, global
measures of instructional effectiveness. Paper presented at the
annual meeting of the American Educational Research Association, San
Francisco, CA.