Bethlem Royal Hospital, Monks Orchard Road, Beckenham, Kent BR3 3DX
See pp. 497502, this
issue.
![]() |
THE COMMUNITY MENTAL HEALTH TEAM: WHAT WE KNOW AND WHAT WE DO NOT KNOW |
---|
![]() ![]() ![]() |
---|
The key elements of a meta-analysis are: the identification of the research question; undertaking a comprehensive search of the literature to find studies that address the question; identifying studies that meet pre-set methodological standards; and manipulating and combining the data using standard statistical techniques. The result is a robust synthesis of the included methodologically adequate studies. For questions of treatment, a meta-analysis of randomised controlled trials (RCTs) is recognised as the best available evidence (Geddes, 1999).
What is the research question?
Using a sophisticated search strategy, the authors identified 1200
citations from which they winnowed five methodologically adequate studies that
compared the CMHT approach with standard care
(Tyrer et al, 2000).
This paucity of evidence is highly disappointing for professionals and
policymakers alike, given the centrality of the CMHT to contemporary mental
health care (Tansella,
1998).
The casual reader would be forgiven for assuming that Simmonds et al are reporting studies of an active agent (analogous to a pharmaceutical compound) versus placebo, the active agent in this case being the CMHT. This is far from the case. Indeed, only recently have attempts been made to provide a typology of CMHTs (Thornicroft et al, 1999). Not surprising, therefore, is the massive heterogeneity of the five chosen studies of CMHT management, which long predate such attempts at systematising. Two of the studies date back to 1970s Canada (Fenton et al, 1979) and Australia (Hoult et al, 1981), both of them comparing an innovative community team with hospital-based care for people presenting for admission. As such, they figure in the Cochrane Collaboration review of Crisis intervention for those with severe mental illnesses (Joy et al, 1998). These two early studies focused on admission diversion and address an important but distinct research question about the utility of dedicated community teams in avoiding in-patient admission and saving bed days. They contribute heavily to Simmonds et al's finding of a significant overall saving of bed days with the CMHT condition.
The other three studies are of London in the 1990s. One of the studies (Merson et al, 1992) compared over the short term the value of a dedicated community team against traditional hospital-based care for patients presenting in psychiatric crisis to the accident and emergency department of an inner-London teaching hospital. The second study (Burns et al, 1993) reports an intriguing comparison of two models of response to routine and emergency referrals to catchment area services, within which the active condition was a home-based multi-disciplinary assessment. A generally clinic-based uni-disciplinary assessment provided the comparator. The third study (Tyrer et al, 1998) acquired cases at the time of discharge from acute in-patient units and compared standard care with CMHTs. Each is addressing a different research question with a different service model applied to patients acquired at different points in their illness career. Crucially, the control condition also has varied significantly between the studies.
Only two of the five studies included in the meta-analysis (Burns et al, 1993; Tyrer et al, 1998) approximate to the investigation of the functioning of a comprehensive CMHT with responsibility for the total service to a defined catchment area. The research question as posed by Tyrer et al (2000) is, in any case, of rather little relevance to contemporary mental health services in the UK. Here the CMHT, mandated to provide follow-up to all vulnerable patients under the Care Programme Approach (Kingdon, 1994), is the standard. The key policy-relevant issue is the value of adding to this now standard pattern assertive outreach, crisis and early psychosis services (Department of Health, 1999).
What studies to include and exclude?
A key issue in any meta-analysis is how to select relevant research
studies. This introduces surprising subjectivity into the process, which
cannot be overcome by subsequent statistical rigour. In their search strategy
Simmonds et al report that they excluded studies of assertive
community treatment and case management, which have been reported on in
separate Cochrane Collaboration reviews (Marshall, 1998, 1999). However, they
included the Hoult et al
(1981) study, which not only
forms an important element in the admission-diversion literature
(Joy et al, 1998) but
is generally seen as belonging to the literature on assertive community
treatment (Mueser et al,
1998).
Some studies that provide evidence on the efficacy of the CMHT approach must be excluded from a meta-analysis for methodological reasons because they are not RCTs. When they existed in the UK, psychiatric case registers could be used to track changes in service utilisation over time within an epidemiological framework. Tyrer et al (1989) presented data on admissions in Nottingham over a 10-year period, finding a marked decrease that coincided with the introduction of sectorised CMHTs to the city. No such decrease occurred in England as a whole. Gater et al (1997) used cluster randomisation, where the unit of analysis was not the individual patient but a general practice. They found that a primary-care-based CMHT provided better quality of care than a traditional hospital-based service. Both studies provide evidence that favours models of CMHT against historical standard care. In contrast, the PRiSM study compared two models of community mental health care serving similar catchment areas by following up all known patients with a psychosis from the two areas (Thornicroft et al, 1998). It found little or no evidence in favour of a service model that included two well-resourced community teams (focused on crisis intervention and long-term care) compared with a less well-resourced generic CMHT.
Other studies are excluded from the meta-analysis, despite being RCTs. An example is the seminal UK700 study (Burns et al, 1999), which assessed the additional value of low case-load in services that already espoused the sorts of best practice inherent in the CMHT approach. Process measurement showed increased patient contact in the intensive case management condition (Burns et al, 2000) without resultant improved clinical or social outcomes (Burns et al, 1999). In routine clinical practice within well-organised CMHTs, small, at least below a limit, is not necessarily beautiful for case-load size (Tyrer, 2000).
What does this meta-analysis tell us?
This heterogeneous set of well-conducted studies of community care provides
some consistent findings, notably that these arrangements result in fewer
cases lost to follow-up. This is fully consistent with the case management
literature (Marshall et al,
1998,
1999;
Mueser et al, 1998)
and now would be seen to be something of a truism. If you are keen to follow
people up, you tend to succeed. The paper does not, however, inform us in any
meaningful way about the appropriate staffing, skill-mix, training, policies,
procedures, practices and management of the CMHT.
Metaphorically Simmonds et al have carried out a careful meta-analysis of fruit growing. This has compared four baskets of two old varieties of apple (Fenton et al, 1979; Hoult et al, 1981), two baskets of grapes (Merson et al, 1992) and four baskets of oranges (Burns et al, 1993; Tyrer et al, 1998) blended into two fruit salads. They have found that a fruit salad prepared from fruit grown by enthusiastic, well-capitalised and careful horticulturalists tastes rather better than one prepared from fruit grown in a variety of comparative conditions that include poor soil, aphids and dreadful weather. Possibly these results provide useful information about fruit-growing in general that could not be found by studying the culture of the individual fruit in more detail. More plausibly, important lessons about fruit-growing have been lost in the mixture.
Simmonds et al provide little information of direct relevance to the practitioner, service manager or purchaser tasked with improving community mental health care. Indeed, the apparatus of the meta-analysis potentially obscures the really important findings that are not amenable to the RCT methodology. These relate to such issues as the acceptability of interventions, applicability in non-experimental situations, generalisability to long-term routine clinical practice, long-term sustainability, the impact of service changes at an epidemiological level and the causes of variance between treatment sites. A good example of variance occurs in the details of the Tyrer et al (1998) study, which found significant, if modest, cost advantages of the CMHT approach over standard care in the follow-up of discharged in-patients. These advantages were dwarfed by differences between the two experimental sites, with the CMHT having little or no impact in the site lacking adequate in-patient resources, where costs were very much higher owing to inefficient overspill of patients into out-of-area and private-sector beds.
Conclusions
Applying the apparatus of a meta-analysis to such an ill-defined concept as
the CMHT is perhaps premature. Arguably it is unnecessary because the generic
comprehensive CMHT is set to become extinct in the UK in favour of the North
Birmingham model of a plethora of specialist teams
(Peck, 1999). The monopoly
buyer of health services in the UK, the Department of Health, has chosen more
exotic fruit than Simmonds et al included in their meta-analysis.
There are cogent reasons for concern over the apparent abandonment of the
generic CMHT (see Burns, 2001,
for a thoughtful discussion of the issues). Sadly, Simmonds et al
contribute little to this important policy debate.
There is an enormous research agenda for mental health services, an agenda that can be pursued only in part by means of the RCT, which is suitable for addressing only a subset of the questions for which answers are urgently required (Richardson et al, 2000). The next generation of RCTs in mental health services research should be more focused about the questions being asked and be supplemented by a range of other empirical studies using a whole variety of methodologies that are relevant to the complex questions that service commissioners and providers face.
![]() |
REFERENCES |
---|
![]() ![]() ![]() |
---|
Burns, T., Beadsmore, A., Bhat, A., et al (1993) A controlled trial of home-based acute psychiatric services. I. Clinical and social outcome. British Journal of Psychiatry, 163, 49-54.[Abstract]
Burns, T., Creed, F., Fahy, T., et al (1999) Intensive versus standard case management for severe psychotic illness: a randomised trial. Lancet, 353, 2185-2189.[CrossRef][Medline]
Burns, T., Fiander, M., Kent, A., et al
(2000) Effects of caseload size on the process of care of
patients with severe psychotic illness. Report from the UK700 trial.
British Journal of Psychiatry,
177,
427-433.
Department of Health (1999) The National Service Framework for Mental Health. Modern Standards and Service Models. London: Department of Health.
Fenton, F. R., Tessier, L. & Streuning, E. L. (1979) A comparative trial of home and hospital psychiatric care: one-year follow-up. Archives of General Psychiatry, 36, 1073-1079.[Abstract]
Gater, R., Goldberg, G., Jackson, G., et al (1997) The care of patients with chronic schizophrenia: a comparison between two services. Psychological Medicine, 27, 1325-1336.[CrossRef][Medline]
Geddes, J. (1999) Asking structured and focused
clinical questions: essential first step of evidence-based practice.
Evidence-Based Mental Health,
2, 35-36.
Hoult, J., Reynolds, I., Charbonneau-Powis, M., et al (1981) A controlled study of psychiatric hospital versus community treatment - the effect on relatives. Australia and New Zealand Journal of Psychiatry, 15, 323-328.
Joy, C. B., Adams, C. E. & Rice, K. (1998) Crisis intervention for those with severe mental illnesses (Cochrane Review). In The Cochrane Library, Issue 4. Oxford: Update Software.
Kingdon, D. (1994) Care programme approach. Psychiatric Bulletin, 18, 68-70.
Marshall, M. & Lockwood, A. (1999) Assertive community treatment for people with severe mental disorders. Cochrane Library, issue 4. Oxford: Update Software.
Marshall, M., Gray, A., Lockwood, A., et al (1998) Case management for people with severe mental disorders. Cochrane Library, issue 4. Oxford: Update Software.
Merson, S., Tyrer, P., Onyett, S., et al (1992) Early intervention in psychiatric emergencies: a controlled trial. Lancet, 339, 1311-1314.[Medline]
Mueser, K. T., Bond, G. R., Drake, R. E., et al (1998) Models of community care for severe mental illness: a review of research on case management. Schizophrenia Bulletin, 24, 37-74.[Medline]
Peck, E. (1999) Introduction to special section on community mental health teams. Journal of Mental Health, 8, 215-216.[CrossRef]
Richardson, A., Baker, M., Burns, T., et al (2000) Reflections on methodological issues in mental health research. Journal of Mental Health, 9, 463-470.[CrossRef]
Simmonds, S., Coid, J., Joseph, P., et al
(2001) Community mental health team management in severe
mental illness: a systematic review. British Journal of
Psychiatry, 178,
497-502.
Tansella, M. (1998) Commentary on: Community
mental health team management for adults with severe mental illnesses
increases satisfaction with care. Evidence-based Mental
Health, 1,
62.
Thornicroft, G., Wykes, T., Holloway, F., et al (1998) From efficacy to effectiveness in community mental health services. PRiSM Psychosis Study 10. British Journal of Psychiatry, 173, 423-427.[Abstract]
Thornicroft, G., Becker, T., Holloway, F., et al (1999) Community mental health teams: evidence or belief? British Journal of Psychiatry, 175, 508-513.[Medline]
Tyrer, P. (2000) Are small case-loads beautiful
in severe mental illness? British Journal of
Psychiatry, 177,
386-387.
Tyrer, P., Turner, R. & Johnson, A. L. (1989) Integrated hospital and community psychiatric services and use of inpatient beds. British Medical Journal, 299, 298-300.[Medline]
Tyrer, P., Evans, K., Gandhi, N., et al
(1998) Randomised controlled trial of two models of care for
discharged psychiatric patients. British Medical
Journal, 316,
106-109.
Tyrer, P., Coid, J., Simmonds, S., et al (2000) Community mental health team management for those with severe mental illness and disordered personality. Cochrane Library, issue 3. Oxford: Update Software.
Related articles in BJP: