Perception of facial and vocal affect by people with schizophrenia in early and late stages of illness

Katarzyna Kucharska-Pietura, PhD

Section of Cognitive Neuropsychiatry, Neuroscience and Emotion, Institute of Psychiatry, London, UK, and Department of Psychiatry, Lublin University Medical School, Poland

Anthony S. David, MD

Section of Cognitive Neuropsychiatry, Division of Psychological Medicine, Institute of Psychiatry, London, UK

Marek Masiak, MD

Department of Psychiatry, Lublin University Medical School, Poland

Mary L. Phillips, MD

Section of Neuroscience and Emotion, Division of Psychological Medicine, Institute of Psychiatry, London, UK

Correspondence: Professor Mary Phillips, Institute of Psychiatry, Department of Psychological Medicine, De Crespigny Park, Denmark Hill, London SE5 8AF. E-mail: m.phillips{at}iop.kcl.ac.uk

Declaration of interest None. K.K.-P. was funded by the Wellcome Trust.


   ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
Background Emotion recognition impairments have been demonstrated in schizophrenia, but few studies have examined whether these reflect generalised or specific perceptual deficits or are associated with illness course.

Aims To examine the nature of emotion recognition abnormalities in patients with schizophrenia at different stages of illness.

Method We examined the performance of 50 in-patients with early-stage schizophrenia, 50 with chronic schizophrenia and 50 healthy controls on the Benton Facial Recognition Test, Facial Emotion Recognition Test and Voice Emotion Recognition Test.

Results Patients with chronic schizophrenia were significantly more impaired than other groups on the emotional tasks, even after controlling for impairments in non-emotional stimuli. Individual emotion recognition accuracy for the two sensory modalities was not significantly positively correlated for either group with schizophrenia.

Conclusions Emotion recognition deficits in schizophrenia are trait features of the disorder and increase with illness duration.


   INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
Impaired emotion identification has been repeatedly demonstrated in patients with schizophrenia (Dougherty et al, 1974; Kerr & Neale, 1993; Borod, 2000; Edwards et al, 2001; Silver et al, 2002) and may contribute to the dysfunction in social communication observed in this population (Hooker & Park, 2002; Pinkham et al, 2003). However, several findings require further clarification. We therefore examined emotion recognition impairments in schizophrenia in order to determine whether: (a) these were independent of any deficits in the identification of non-emotional facial and vocal stimuli; (b) the magnitudes of positive and negative emotion recognition impairments in either modality were comparable; (c) these impairments were stable or progressive; (d) these impairments were significantly correlated with symptom severity, demographic factors or neuroleptic dose.


   METHOD
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
Participants
Participants were 100 in-patients from Lublin University Psychiatric Hospital with schizophrenia in remission (diagnosed on the basis of clinical interview according to DSM–IV criteria; American Psychiatric Association, 1994); 50 patients (25 male) were recruited during the first or second episode of illness (≤2 episodes; mean duration of illness=2.0 years (s.d.=1.3)) and 50 (26 male) during later stages of illness (>2 episodes; mean duration of illness=13.2 years (s.d.=6.6)). All patients were clinically stable after 4 weeks of neuroleptic treatment (65% atypical antipsychotics) and were aged between 18 and 60 years. The mean daily dose in chlorpromazine equivalents was 365 mg (s.d.=165).

The 30-item Positive and Negative Syndrome Scale (PANSS; Kay et al, 1987) was administered to all patients by a trained rater (K. K.-P.) at the time of recruitment (Table 1). Controls were 50 healthy individuals (24 male; mean age=36.8 years (s.d.=13.4)) with no history of psychiatric illness recruited from the non-professional staff at Lublin University Medical School and Lublin Psychiatric Hospital.


View this table:
[in this window]
[in a new window]
 
Table 1 Demographic and clinical data for the three groups
 

All participants were right-handed (Annett, 1970). Exclusion criteria included the presence of a neurological disorder (e.g. epilepsy, dementia), habitual drug or alcohol misuse and cognitive impairment (a minimum score <24 out of 30 on the Mini-Mental State Examination; Folstein et al, 1975). Those who had difficulties with vision (including poor acuity and lack of correction) or hearing (threshold greater than 35 dB at any frequency using a free-field voice test; Browning, 1998) were also excluded. Informed consent was obtained prior to participation in the study. Approval for the study was obtained from the ethics committee of the Psychiatry Department of Lublin University Medical School. Six patients with schizophrenia who volunteered to take part in the study were not included in the final sample because either they were unable to complete the full set of tests owing to akathisia (three) or agitation (one) or they were discharged before completing the three experimental sessions (two).

Procedures
All participants undertook three facial recognition tasks and an emotion prosody task on three separate occasions. Individuals rated their mood at the time of testing on a 10 cm scale ranging from ‘most depressed ever’ on the extreme left (scoring 0) to ‘most happy ever’ on the right (scoring 100). The midpoint was not indicated on the scale (David, 1989).

Facial Emotion Recognition Test
The Facial Emotion Recognition Test (FERT) consists of a set of 36 photographs of human ‘emotional’ faces standardised and cross-validated on an independent group of healthy volunteers. These photographs were presented in slide form on the screen for approximately 10 s each, with an interval of 10 s between photographs. The projector was positioned 2 m away from the participant. Before this test, participants were provided with a written list and definitions of nine fundamental emotions: interest/excitement, enjoyment/joy, surprise/startle, distress/anguish, disgust, contempt, anger/rage, shame/humiliation, fear/terror, and were asked to study the names and definitions. After each slide participants selected the one emotion from the list that best described the photograph and wrote the number of this photograph in the appropriate space under the defined emotion category (Izard, 1971). The order of the items in both emotion facial tasks was randomised across participants.

Benton Facial Recognition Test
The Benton Facial Recognition Test (BFRT) is a standardised objective procedure for the assessment of the ability to identify and discriminate photographs of unfamiliar, non-emotional human faces. The long version of the test, comprising 54 response items, was employed in this study (Benton et al, 1994).

Voice Emotion Recognition Test
In the Voice Emotion Recognition Test (VERT) participants were presented with a series of five semantically neutral sentences (e.g. ‘In winter there are short days and long nights’, ‘They will go first, the others will follow them’).

Each sentence was spoken aloud by a professional male actor in such a manner as to convey one of the six basic emotions: happiness, sadness, fear, anger, surprise and disgust, in addition to a neutral tone of voice. Thirty-five sentences were recorded, digitised and normalised for average amplitude in a recording studio. Each of five sentences was presented in the six emotional and neutral states in a randomised order (interstimulus interval=7 s; total time=20 min). Participants listened to each sentence then circled on an answer sheet which of the six emotions or neutral state best described the speaker’s tone of voice. The presentation order of all 35 sentences was randomised across participants. Internal consistency was determined on a sample of 101 students (48 males; mean age=34.2 (s.d.=3.2) years) on which the test was first validated (Cronbach’s {alpha}=0.614). Retest was performed after 3 days under the same experimental conditions; test–retest reliability was 0.96 (Kucharska-Pietura et al, 2003).

Analyses
The emotion items were grouped into two valence categories. Happiness (enjoyment), interest and surprise were categorised as ‘positive’ and sadness (distress), anger, fear, shame, contempt and disgust as ‘negative’ for both facial and vocal stimuli (Izard, 1971). The mean recognition accuracy (percentage correct) was computed for each valence category for each stimulus type for each group of participants. A repeated-measures analysis of variance (ANOVA) was employed to determine the main effects of group, emotion category and individual emotion, and interactions between these factors, on both facial and vocal tasks. Post hoc Tukey tests were then employed to examine specific differences in performance between groups. The influence of independent variables (e.g. age, education and current mood) on the performance of the perception tasks was controlled via analyses of covariance (ANCOVAs). Finally, Pearson correlations were performed between mean accuracy scores and clinical variables (e.g. PANSS score, neuroleptic dose, number of admissions).


   RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
Clinical and demographic data
Patients in the early stages of schizophrenia were significantly younger than healthy controls (P<0.001); there was no significant age difference between patients with chronic schizophrenia and healthy controls (P=0.90). Furthermore, healthy controls had more years of education than patients in the early stages of illness (P<0.05); other group comparisons were not statistically significant (Table 1).

Benton Facial Recognition Test
Analysis of variance revealed a main effect of group on performance on this task (F=16.85; d.f.=2,147; P<0.001). Patients in later stages of schizophrenia were less accurate than those in the early stages of illness (mean difference=4.63; P<0.05) and healthy controls (mean difference=10.18; P<0.001); patients in the early stages of schizophrenia were more impaired than healthy controls (mean difference=5.55; P<0.01; Table 1).

Analysis of covariance (mean score as dependent variable) were carried out with age, education and current mood as covariates. The effect of group upon performance on this test remained highly significant (F=16.17; d.f.=2,15; P<0.001) after controlling for these covariates. Years of education, current mood, severity of illness, neuroleptic dose, duration of illness and number of prior admissions did not correlate significantly with mean BFRT score in patients. Performance of males and females did not differ significantly on this test in any of the groups.

Facial Emotion Recognition Test
The effect of group
A significant main effect of group was found for performance on the FERT (F=51.34; d.f.=2,147; P<0.001). Patients in later stages of schizophrenia demonstrated a significantly greater impairment in their recognition of facial emotions compared with those in the early stages of illness (mean difference=8.33; P<0.001) and healthy controls (mean difference=21.74; P<0.001). A significantly greater impairment was found in patients in the early stages of schizophrenia compared with healthy controls (mean difference=13.41; P<0.001; Table 2).


View this table:
[in this window]
[in a new window]
 
Table 2 Facial expression recognition accuracy for the three groups
 

The effect of valence
Mean recognition accuracy was computed for both valence categories (positive and negative) for the FERT. There was a main effect of valence for recognition (F=144.93; d.f.=1,147; P<0.001), with mean accuracy scores higher for positive emotions (Table 2).

Individual emotions
Over all participants, there was a significant main effect for expression on the recognition task (F=132.37; d.f.=8,140; P<0.001). There was a significant interaction between group and facial expression on the recognition task (F=2.62; d.f.=16,280; P<0.01).

Taken together, these findings indicated that patients in the early and later stages of schizophrenia were more impaired on the FERT for both positive and negative expressions than healthy controls, and that those with chronic schizophrenia were generally more impaired than those in the early stages of illness (Table 2).

BFRT performance, clinical and demographic variables as covariates and gender effect
Analyses of covariance were carried out to determine whether in patients with schizophrenia the impairment on the FERT occurred independently of the impairment on the BFRT, and with clinical and demographic variables (age, current mood and years of education) as covariates. The main effect of group remained highly significant even after controlling for variables (F=32.77; d.f.=2,149; P<0.001), for the recognition of positive (F=21.40; d.f.=2,149; P<0.001) and negative (F=24.72; d.f.=2,149; P<0.001) emotions.

There were no significant correlations between PANSS score, illness course, or neuroleptic dose and performance on the FERT in either patient group.

After covarying for the above factors, univariate analysis of variance was performed to determine the effect of gender upon performance on the FERT. This revealed a main effect of gender on the overall performance on the FERT (F=15.44; d.f.=1,149; P<0.001). Overall, females were more accurate than males on the FERT (t=3.74; d.f.=148; P<0.001). There were also t-test gender differences among patients in the early stages of schizophrenia and healthy volunteers, but not among those with chronic schizophrenia, with females in the early stages of illness and female controls more accurate on the test than the males in each group (t=2.12; d.f.=48; P<0.05 and t=6.49; d.f.=48; P<0.001).

Voice Emotion Recognition Test
Effect of group
One-way ANOVA revealed a main effect of group (F=108.77; d.f.=2,147; P<0.001) on the total performance on the VERT.

Patients with chronic schizophrenia were significantly more impaired than patients in the early stages of illness (mean difference=12.62; P<0.001), and both patient groups were significantly more impaired than healthy controls (mean difference>27.94; P<0.001 for both comparisons) on this task (Table 3; Fig. 1).


View this table:
[in this window]
[in a new window]
 
Table 3 Prosody recognition accuracy for the three groups
 


View larger version (17K):
[in this window]
[in a new window]
 
Fig. 1. Facial and vocal emotion recognition (% correct) in healthy controls ({blacksquare}), patients in early stages of schizophrenia () and patients in late stages of illness ({square}).

 

The effect of valence
There was a main effect of valence on the task (F=157.67; d.f.=1,147; P<0.001), with mean accuracy scores ordered as positive and negative vocal expressions (Table 3; Fig. 1). There was a significant group-by-valence interaction (F=21.64; d.f.=2,147; P<0.001; Table 3).

Individual emotions
There was a significant interaction between group and the categories of vocal expression (F=5.25; d.f.=10, 286; P<0.001).

Both groups of patients were significantly impaired compared with healthy controls in the identification of all vocal expressions (P<0.001 for all comparisons between each patient group and healthy controls), but patients in the later stages of schizophrenia were significantly more impaired than those in the early stages in the identification of all vocal expressions except fear (P<0.34; Table 3).

Neutral tone and clinical and demographic variables as covariates
When the neutral tone of voice, age, years of education and current mood were taken into account, the effect of group remained highly significant (F=72.25; d.f.=2,149; P<0.001). The adjusted mean difference between patients with chronic schizophrenia and those in the early stages of illness was -7.12 (95% CI -12.39 to -1.85); the difference between those with chronic schizophrenia and healthy controls was -28.78 (95% CI -33.60 to -23.88) and that between patients in the early stages of schizophrenia and healthy controls was -21.60 (95% CI -26.93 to -16.38).

Furthermore, the main effect of group remained highly significant after controlling for all these variables for recognition of positive (F=14.16; d.f.=2,149; P<0.001) and negative emotions (F=77.13; d.f.=2,149; P<0.001).

Pearson correlations between the mean score on the VERT and neuroleptic dose, PANSS score, duration of illness, and number of prior admissions were not significant in either of the two patient groups.

Finally, there was no significant effect of gender on VERT performance after covarying for the above variables (F=1.76; d.f.=1,149; P=0.18).

Correlation between facial and vocal emotion recognition tasks
After covarying for the above variables, correlational analyses were performed to examine any association between performance on facial and vocal emotion recognition tests. A significant but small positive correlation between performance on the FERT and VERT was found in each group (patients with early schizophrenia: Pearson’s r=0.27; P=0.05; patients with chronic schizophrenia: Pearson’s r=0.39; P=0.005; healthy controls: Pearson’s r=0.46; P=0.001). Further correlation matrices were constructed to examine the strength of association between processing of individual emotion categories in the two modalities (i.e. facial and vocal emotion recognition). In the healthy control group the only significant cross-modal correlation was in the recognition of anger in faces and voices (r=0.49; P<0.01). In both patient groups there were no significant correlations between performance on individual emotion recognition in facial and vocal recognition tests.


   DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
We aimed to examine the nature of facial and vocal emotion recognition abnormalities in patients with schizophrenia at different stages of illness. Four major findings emerged from the study.

Cross-modal emotion recognition impairment
First, all patients with schizophrenia were impaired in the recognition of emotional and non-emotional facial and vocal stimuli, supporting findings from previous studies demonstrating a generalised perceptual deficit in schizophrenia (Kerr & Neale, 1993; Mandal et al, 1998; Hooker & Park, 2002). The deficit in emotion recognition in all patients with schizophrenia remained significant even after covarying for the impairment in non-emotional face and voice recognition, supporting previous data indicating a specific deficit in emotion identification in schizophrenia (Silver et al, 2002). The presence of deficits in more than one sensory modality (Kee et al, 1998; Edwards et al, 2001; Hooker & Park, 2002) suggests a cross-modal emotion processing deficit. The right hemisphere has been linked with face and emotion processing (Borod, 2000). Our findings may therefore suggest a role for right hemisphere dysfunction in schizophrenia.

Interestingly, there were only small positive correlations between the magnitude of the overall deficits in emotion recognition for stimuli of each sensory modality in both healthy controls and patients. These were not present for individual emotions in either group, however. It is therefore possible that different emotions are displayed and recognised more easily in different sensory modalities, e.g. happiness may be recognised more easily from a face than a voice.

Impairments in positive and negative emotion recognition
Second, patients with schizophrenia demonstrated marked impairments overall in the recognition of negative and positive emotions, consistent with some (Schneider et al, 1995) but not all previous findings (Mandal et al, 1998; Borod, 2000). We also examined the ability of patients with schizophrenia to identify individual emotions. Overall, all patients were significantly less accurate than healthy volunteers in recognising all emotional stimuli, but were relatively less impaired in the identification of happiness, particularly from faces. Others have also demonstrated greater accuracy in the recognition of happiness than negative emotions by patients with schizophrenia (Dougherty et al, 1974), and a relatively greater impairment in the identification of negative compared with positive emotional stimuli in these patients in facial (Mandal et al, 1998) and non-visual modalities (Borod, 2000; Edwards et al, 2001).

Greater impairment in later stages of illness
Third, our findings also demonstrated that patients in later stages of schizophrenia were significantly impaired compared with those in the early stages of illness and healthy controls (Silver et al, 2002) in recognising all examined expressions. This suggests a progressive impairment in emotion identification in schizophrenia, which may have resulted from treatment with typical antipsychotics, institutionalisation or the illness itself. We concede, however, that only a prospective design would allow us to determine whether emotion perception deficits were truly progressive in schizophrenia. An alternative explanation is that individuals in later stages of illness represented a distinct subgroup of patients, and would support the presence of heterogeneity within schizophrenia rather than illness progression. These two possibilities are not mutually exclusive, however.

No correlation between symptom severity and emotion recognition deficits
Finally, we did not demonstrate significant correlations between performance on any of the emotion recognition tasks and the examined clinical variables. This might be explained by some recent models that advocate progressive, essentially neurodegenerative processes involving excitotoxicity in addition to neurodevelopmental processes (Garver et al, 1999). Here, illness duration rather than symptom ratings would then be predicted to be correlated with task performance deficits. We did not, however, demonstrate such a correlation either; rather we merely demonstrated that individuals in the later stages of illness were more impaired than those in earlier stages.

Deficits in emotion recognition and social dysfunction
We have provided evidence for the presence of pervasive deficits in emotion recognition in more than one sensory modality in schizophrenia, which appears to increase with illness chronicity. These deficits are not specifically related to positive or negative symptoms, medication or current mood state. Our results are some of the first to suggest that in schizophrenia there might be progressive emotion processing deficits, which appear to be unrelated to specific symptom profiles but may be responsible for the social dysfunction observed in people with this disorder.


   Clinical Implications and Limitations
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
CLINICAL IMPLICATIONS

LIMITATIONS


   REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHOD
 RESULTS
 DISCUSSION
 Clinical Implications and...
 REFERENCES
 
American Psychiatric Association (1994) Diagnostic and Statistical Manual of Mental Disorders (4th edn) (DSM–IV) . Washington, DC: APA.

Annett, M. (1970) Classification of hand preference by association analysis. British journal of Psychology, 61, 303 -321.[Medline]

Benton, A. L., Sivan, A. B., Hamsher, K. deS., et al (1994) Contributions to Neuropsychological Assessment: A Clinical Manual. New York: Oxford University Press.

Borod, J. C. (2000) The Neuropsychology of Emotion. New York: Oxford University Press.

Browning, G. G. (1998) Is there an evidence based for practice of ENT surgery? Clinical Otolaryngology and Allied Science, 23, 1 -2.[CrossRef]

David, A. S. (1989) Perceptual asymmetry for happy–sad chimeric faces: effects of mood. Neuropsychologia, 27, 1289 -1300.[CrossRef][Medline]

Dougherty, F. E., Bartlett, E. S. & Izard, C. E. (1974) Response of schizophrenics to expressions of the fundamental emotions. Journal of Clinical Psychology, 30, 243 -246.[Medline]

Edwards, J., Pattison, P. E., Jackson, H. J., et al (2001) Facial affect and affective prosody recognition in first-episode schizophrenia. Schizophrenia Research, 48, 235 -253.[CrossRef][Medline]

Folstein, M. F., Folstein, S. E. & McHugh, P. R. (1975) "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189 -198.[CrossRef][Medline]

Garver, D. L., Nair, T. R., Christensen, J. D., et al (1999) Atrophic and static (neurodevelopmental) schizophrenic psychoses: premorbid functioning, symptoms, and neuroleptic response. Neuropsychology, 21, 82 -92.

Hooker, C. & Park, S. (2002) Emotion processing and its relationship to social functioning in schizophrenia patients. Psychiatry Research, 112, 41-50.[CrossRef][Medline]

Izard, C. (1971) The Face of Emotion. NewYork: Appleton–Century–Crofts.

Kay, S. R., Opler, L. A. & Fiszbein, A. (1987) Positive and Negative Syndrome Scale (PANSS) Rating Manual. San Rafael, CA: Karger.

Kee, K. S., Kern, R. S., Marshall, B. D., et al (1998) Risperidone versus haloperidol for perception of emotion in treatment-resistant schizophrenia: preliminary findings. Schizophrenia Research, 31, 59-65.

Kerr, S. L. & Neale, J. M. (1993) Emotion perception in schizophrenia: specific deficit or further evidence of generalized poor performance? Journal of Abnormal Psychology, 102, 312 -318.[CrossRef][Medline]

Kucharska-Pietura K., Phillips, M., Gernand, W., et al (2003) Perception of emotions from faces and voices following unilateral brain damage. Neuropsychologia, 41, 1082 -1090.[CrossRef][Medline]

Mandal, M. K., Pandey, R. & Prasad, A. B. (1998) Facial expressions of emotions and schizophrenia: a review. Schizophrenia Bulletin, 24, 399 -412.[Medline]

Pinkham, A. E., Penn, D. L., Perkins, D. O., et al (2003) Implications for the neural basis of social cognition for the study of schizophrenia. American Journal of Psychiatry, 160, 815 -824.[Abstract/Free Full Text]

Schneider, F., Gur, R. C., Gur, R. E., et al (1995) Emotional processing in schizophrenia: neurobehavioral probes in relation to psychopathology. Schizophrenia Research, 17, 67 -75.[CrossRef][Medline]

Silver, H., Shlomo, N., Turner, T., et al (2002) Perception of happy and sad facial expressions in chronic schizophrenia: evidence for two evaluative systems. Schizophrenia Research, 55, 171 -177.[CrossRef][Medline]

Received for publication December 8, 2003. Revision received January 27, 2005. Accepted for publication February 4, 2005.


Related articles in BJP:

Highlights of this issue
Kimberlie Dean
BJP 2005 187: 495. [Full Text]  




This Article
Abstract
Full Text (PDF)
Submit a response
Alert me when this article is cited
Alert me when eLetters are posted
Alert me if a correction is posted
Services
Email this article to a friend
Related articles in BJP
Similar articles in this journal
Similar articles in PubMed
Alert me to new issues of the journal
Download to citation manager
Google Scholar
Articles by Kucharska-Pietura, K.
Articles by Phillips, M. L.
PubMed
PubMed Citation
Articles by Kucharska-Pietura, K.
Articles by Phillips, M. L.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Psychiatric Bulletin Advances in Psychiatric Treatment All RCPsych Journals