The Japanese Journal of Psychology 2004, Vol. 74, No. 6, 540-546 Recognition of vocal expression of emotion and its acoustic attributes Sumi Shigeno (Department of Psychology, College of Literature, Aoyama Gakuin University Shibuya, Shibuya-ku, Tokyo 150-8366) The vocal expression of emotion was examined with both an auditory experiment and objective acoustic analyses. In the auditory experiment the stimuli were words or short sentences with six basic emotions expressed by two actors. Forty-five undergraduate and graduate students participated in the experiment. The results showed that the vocal expression of emotion was strongly identified, except in the case of fear, and that the six basic emotions could be plotted in a psychological space with two dimensions calculated from multidimensional scaling. The plot formed a roughly circular surface, with locations very similar to those of the facial expressions. One dimension was considered to represent the element of pleasantness-unpleasantness. The actors' voices were then acoustically analyzed. The results suggested that the mean fundamental frequency (F0), the standard deviation (SD) of F0, and the SD of the energy are the important factors that define the characteristics of the vocal expression of emotions. To determine the most important parameter (s) and explain the two dimensions of the psychological space, canonical correlation analysis was conducted. The analysis indicated that Fo was correlated with the pleasantness unpleasantness dimension. Key words: recognition of emotion, vocal expression of emotion, speech analysis, six basic emotions.

Figure 1. Percentages of correct responses and standard deviations of the six basic emotions. Figure 2. Two-dimensional psychological space obtained from the MDS analysis of the perceptual results.

Figure 3, Two-dimensional psychological spaces for (a) Speaker A and (b) Speaker B.

Table 1 Statistical results from ANOVA **** p<.0001 *** p<.001, ** p<.01, * p<.05, +,05<p<1.0.

Banse, R., & Scherer, K. R. 1996 Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636. Dawes, R. M., & Kramer, E. 1966 A proximity anal ysis of vocally expressed emotion. Perceptual and Motor Skills, 22, 571-574. Ekman, P. 1985 Telling lies. New York; Norton. (Ekman, P., & Friesen, W V. 1975 Unmasking the face. Englewood Cliffs, NJ: Prentice-Hall.) Ekman, P., Friesen, W. V., & Ellsworth, P. 1972 Emotion in the human face Guidelines for research and an integration of findings. New York: Per gamon Press. Fairbanks, G., & Hoaglin, L. W, 1941 An experi mental study of the durational characteristics of the voice during the expression of emotion. Speech Monographs, $, 85-90. Fairbanks, G., & Pronovost, W. 1939 An experimen tal study of the pitch characteristics of the voice during the expression of emotion. Speech Mono graphs, 6, 87-104. Ladd, D. R., Silverman, K. A., Tolkmitt, F., Bergmann, G., & Scherer, K. R. 1985 Evidence for the in dependent function of intonation contour type, voice quality, and Fo range in signaling speaker affect. Journal of the Acoustical Society of America, 78, 435-444. (Maiya, K., & Takigami, Y.) Murray, I. R., & Arnott, J. L. 1993 Toward the simu lation of emotion in synthetic speech: A review of the literature on human vocal emotion. Journal of the Acoustical Society of America, 93, 1097-1108. Russell, J. A. 1980 A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178. Russell, J. A., & Bullock, M. 1985 Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults. Journal of Personality and Social Psychology, 48, 1290-1298. Scherer, K. R. 1986 Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143-165. Schlosberg, H. 1941 A scale for the judgment of facial expressions. Journal of Experimental Psym chology, 29, 497-510. Schlosberg, H. 1952 The description of facial expres sion in terms of two dimensions. Journal of Experi mental Psychology, 44, 229-237. Schlosberg, H. 1954 Three dimensions of emotion. Psychological Review, 61, 81-88. (Shigeno, S. 1998 Influence of visual information upon the recognition of speech sounds. Transactions of Technical Committee of Psychological and Physiological Acoustics, H-98-8, 1-7.) (Shigeno, S. 2001 Recognition of emotion in voice. AGU Journal of Psychology, 1, 37-43.) (Utsuki, N. 1996 Roles of vocal behavior in inter personal communication. Behavioral Science Research, 34, 37-47.) Williams, C. E., & Stevens, K. N. 1972 Emotions and speech: Some acoustical correlates. Journal of the Acoustical Society of America, 52, 1238-1250. Woodworth, R. S. 1938 Experimental psychology. New York: Henry Holt.