CAI: Does It Have an Effect on Aural Skills Performances?

Jolene Davis

University of Georgia School of Music

jrdavis@rameau.music.uga.edu

The incorporation of computer-assisted instruction (CAI) into the aural skills curriculum has been a part of college music theory classes for some time (Eddis, 1981). Typically, the CAI component supplements the usual dictation and sight-singing drill of the classroom. As a patient provider of interval, rhythmic, harmonic, and melodic drill, the computer program can provide an "assistant" to play multiple and varied patterns for the student to practice.

Students vary in their appreciation of the strengths of the CAI components of aural-skills courses. Many students are not only positive about those components, but also enjoy the challenges they present. Other students complain about the lack of humanity in the computer; some are frustrated by the computer skills necessary to participate in CAI components; and some are unconvinced that CAI lab work has any major positive impact on the overall aural skills necessary for adequate performance in a music degree plan. Students who are successful in the CAI lab sometimes feel frustrated when the CAI units are competency-based, requiring them to complete a certain number of problems in a limited amount of time (Hofstetter, 1981; Killam, 1984).

College music theory programs include CAI components based on the assumption that the CAI drill will improve students' dictation and sightsinging skills. Anecdotal evidence and implicit theory has been used to justify the inclusion of these components. Many early studies during the 1970's and early 80's documented the positive effect of CAI on aural skills outcomes (Diehl, 1971; Herold, 1974; Gross, Griffin, 1982). More recent studies have measured the effect of computer assisted drill on beginning solfege (Ozeas, 1992), have compared computer-generated materials to pre-taped exercises (Garton, 1982), and have compared kinesthetic and aural reinforcement in CAI instruction (Polot, 1992). Substituting an entirely computer-based training program for a standard classroom curriculum supplemented with CAI was the subject of another recent study (Hess,1997). However, despite the advancement of computer technology and the increasingly common computer skills of current college students, the author could find no recent statistical study relating outcomes in aural skills exams to CAI supplemental instruction.

At the University of Georgia, the aural skills portion of music theory has been supplemented by a CAI program called GUIDO (Graded Units for Interactive Dictation Operations). Each music theory course has an assigned set of units to be completed successfully (Table 1). If the required units for a particular course are not completed, the student's final grade is lowered by one letter. No credit is given for completing a portion of the required units.

Table 1: GUIDO Unit Requirements by Course and Type.


 
Course
Intervals
Chords
Harmony
Melody
Rhythmic Melody
Rhythm
Freshman Theory:
MUS 110 (Fall)
10
5
0
1-5
0
1-5
MUS 111 (Winter)
14
10, 13
1-4
6-10
1-5
7-11
MUS 112 (Spring)
22
15, 21
9-10
15-16
6-11
13-22
MUSI 1120/30 (Spring)
22
29
13-21
17-18
10-13
23, 25-26
Sophomore Theory:
MUS 212 (Fall)
26
29, 30
15-21
17-20
16-17
24-28
MUS 213 (Winter)
0
33-36
22-26
21-22
18-21
29-32
MUS 214 (Spring)
0
37-39
27-31
23-26
26-27
33-34
MUSI 2100/10 (Fall)
0
34, 36
25-31
21-26
16-19
31, 32

Seventeen freshman/sophomore music theory classes at the University of Georgia School of Music between 1994 and 1999 were surveyed to ascertain if the student's completion of required computer units had any effect on their final exam grades in aural skills and their final averages in written theory. Grades were compiled from 1247 students, all taught by the author (Table 2). These students comprised over half of all students enrolled in freshman/sophomore music theory courses at the University of Georgia during this period. Theory courses taught by other faculty during this time maintained similar standards and performances.

Table 2: Enrollment for Courses Used in Statistical Analysis

Academic years
94-95
95-96
96-97
97-98
98-99
99-00
Freshman Theory
Quarter system:
MUS 110
105
83
86
108
n/a
n/a
MUS 111
91
80
78
__
n/a
n/a
MUS 112
85
78
__
__
n/a
n/a
Semester system:
MUSI 1120/30
n/a
n/a
n/a
n/a
80
n/a
Sophomore Theory
Quarter system:
MUS 212
__
__
29
__
n/a
n/a
MUS 213
__
__
32
67
n/a
n/a
MUS 214
__
__
31
65
n/a
n/a
Semester system:
MUSI 2100/10
n/a
n/a
n/a
n/a
90
59

(Dashes indicate that the author did not teach the courses during those quarters/semesters.)

All data was analyzed using the SAS statistical package. An initial set of analyses was done in which correlation was computed between completion rates of GUIDO and final aural skills exam grades (sightsinging and dictation) and written music theory averages.

In the first set of analyses, some courses showed a strong correlation between satisfactory GUIDO completion and final exam grades, while in other courses, the correlation was considerably smaller Ö and, in some instances, negligible (Table 3).

Table 3: GUIDO Completion Correlations with Performance on Dictation Final, Sightsinging Final, and Theory Average


 
Class
Dictation
Sightsinging
Theory
110F94
.41*
.41*
.52*
110F95
.08
.29*
.40*
110F96
.21
.25*
.24*
110F97
.44*
.21*
.30*
111W95
.28*
.20
.35*
111W96
.17
.31*
.33*
111W97
.49*
.33*
.36*
112S95
.27*
.38*
.41*
112S96
.33*
.32*
.40*
212F96
.37*
.43*
.30
213W97
.35*
.35*
.38*
213W98
.66*
.38*
.40*
214S97
.19
.13
.15
214S98
.25*
.21
.46*
1120/30S98
59*
.48*
.51*
2100/10F98
47*
.20
.42*
2100/10F99
63*
.32*
.57*

*Statistical Significance at Alpha 2.05

In all aural skills courses, there are many factors that impact a studentís ultimate degree of accomplishment. Prior musical experience and training influences aural discrimination skills (Rogers, Watkins, 1986). Measures of musical aptitude and academic ability impact sightsinging and eartraining skills (Harrison, 1991; Butterworth, Fogarty, Rorke, 1993). Motivation also effects aural skills results. Thus, the actual benefit of experiences offered by GUIDO can be masked by differences among students on those factors. This would be the case even for something as seemingly straightforward as students' performances on the dictation or sightsinging final. Ideally, if one could adjust the estimate of the correlation between GUIDO completion and performance on aural skills final exams for such factors, one could obtain a far more sensitive assessment of that relationship.

Overall performance on the written theory component of the course was available in the compiled data. This should also be strongly affected by prior musical experience, student ability, and motivation, but it reflects a different set of skills than those that should be affected directly by student interaction with GUIDO. Using written theory performance as a proxy for those other student characteristics that cloud the relationship between GUIDO completion and performance on the dictation final gives a clearer relationship between GUIDO completion and higher grades on the aural skills final exams.

Accordingly, a set of multiple regression analyses was carried out relating performance on the dictation final with both theory performance and GUIDO completion.

In the second set of analyses (Table 4), using a student's music theory average as a regression coefficient made the impact of GUIDO completion on students' final grades much clearer. Nine of the seventeen estimated regression coefficients relating GUIDO completion to performance on the dictation final controlling for theory performance were statistically significant. Even more importantly, all but one of the estimated regression coefficients was positive. Thus the overall evidence for GUIDO completion leading to better performance on the dictation final seems quite clear. Furthermore, the regression coefficients themselves can be interpreted as the unique contribution of GUIDO completion to points earned on the dictation final. Across all seventeen classes this averages an increase of 9.4% in student's grades.

Table 4: Regression Coefficients for Predicting Performance on the Dictation Final From GUIDO Completion Status and Theory Average Performance


 
Class
Intercept
Theory Average
GUIDO completion
110F94
42.26
.44*
6.60*
110F95
37.40
.54*
-1.62
110F96
1.66
.88*
3.94
110F97
27.16
.51*
14.42*
111W95
56.38
.30
6.31
111W96
39.05
.46
3.21
111W97
17.37
.63*
12.00*
112S95
49.43
.28
8.73
112S96
74.12
-0.04
11.30*
212F96
36.43
.53
5.98
213W97
94.65
-.22
8.83*
213W98
59.30
.07
27.50*
214S97
75.62
.06
3.99
214S98
75.78
.05
6.58
1120/30S99
59.49
.13
18.61*
2100/10F98
18.01
.63*
10.17*
2100/10F99
-2.25
.93*
13.30*

*Statistical Significance at Alpha 2.05

As might be expected, the influence of GUIDO completion on sightsinging exam finals is less compelling, since the skills necessary for GUIDO completion are more directly related to dictation skills. However, another set of multiple regression analyses was carried out relating performance on the sightsinging final with theory performance and GUIDO completion. The analysis (Table 5) shows a statistically significant increase of scores in seven of the seventeen classes, and an average increase of 5% in the students' grades.

Table 5: Regression Coefficients for Predicting Performance on the Sightsinging Final From GUIDO Completion Status and Theory Average Performance


 
Class
Intercept
Theory Average
GUIDO completion
110F94
41.15
.47
5.89*
110F95
61.81
.27*
4.08
110F96
21.87
.66*
5.95
110F97
64.78
.12
6.80
111W95
41.53
.42*
3.19
111W96
30.98
.53
6.78
111W97
50.60
.33
7.05
112S95
36.29
.47*
7.43*
112S96
44.40
.44*
4.60
212F96
70.84
.17
4.66
213W97
87.45
-.03
7.21
213W98
69.60
.14
5.43*
214S97
72.64
.21
1.29
214S98
85.24
-.05*
4.67
1120/30S99
63.41
.25*
6.53*
2100/10F98
67.16
.27*
.80
2100/10F99
82.81
.13
2.74

*Statistical Significance at Alpha 2.05

This study showed that successful GUIDO completion translated into higher scores overall in sightsinging and dictation final exams when controlled by written theory averages. The dictation final was affected by 9%, which is close to a letter grade. The increase in sightsinging grades, at 5%, is still significant. The overall success in GUIDO completion definitely translates into higher scores on the aural skills final exam. This confirms intuitive beliefs of teachers that CAI-based requirements used to supplement the aural skills courses taught at the university level actually have a significant positive benefit.

Additional studies should be done to see if significant improvement is made using different software programs. While one might assume that the improvements in outcomes would be similar for all aural skills software packages, different approaches from different software companies might significantly affect the improvement in grades.

References:

Butterworth, Louise, Fogarty, Gerard, and Rorke, Peter. Predicting aural performance in a tertiary music training programme. Psychology of Music, 21, 114-126.

Diehl, Ned. Computer-assisted-instruction and instrumental music: Implications for teaching and research. Journal of Research in Music Education, 19, 299-306.

Eddis, John. A brief history of computer assisted instructions in music. College Music Symposium, 21, 7-14.

Garton, Janet. The efficacy of computer-based and tape-recorded assistance in second-semester freshman ear-training instruction (Doctoral dissertation, Louisiana State University). Dissertation Abstracts International-A, 42, 4756A-7A.

Gross, Dorothy and Griffin, Wendy. Implementation and evaluation of a computer-assisted course in musical aural skills. AEDS Journal, Spring, 1982.

Harrison, Carole. Analyses of relationships between aural skills and background variables: LISREL versus multiple regression. The Quarterly Journal of Music Teaching and Learning, 2, 10-20.

Hess, George Jr. Strategies for integrating computer-based training in college music theory courses. Educational Multimedia and Hypermedia, 1994.

Herold, Rebecca. Computer assisted instruction: A study of student performance in CAI ear training programs. DMA project, Stanford University, 1974.

Hofstetter, Fred. Applications of the GUIDO system to aural skills research, 1975-80. College Music Symposium, 21, 46-53.

Hofstetter, Fred. The GUIDO Music Learning System: Ear-Training Lessons. University of Delaware.

Killam, Rosemary. An effective computer-assisted learning environment for aural skill development. Music Theory Spectrum, 6, 52-62.

Ozeas, Natalie. The effect of the use of a computer assisted drill program on the aural skill development of students in beginning solfege (Doctoral Dissertation, University of Pittsburgh). Dissertation Abstracts International-A, 53-05A:1320.

Polot, Barton. Aural reinforcement and kinesthetic reinforcement as variants of the response mode in computer-assisted harmonic aural skills training (Doctoral dissertation, University of Michigan). Dissertation Abstracts International-A, 53-05A:1320.

Rogers, George and Watkins, Rosemary. The relationship between prior musical training and aural discrimination skills of elementary education majors. Contributions to Music Education, 13, 48-55.