1 Cochrane Menstrual Disorders & Subfertility Group Editorial Base, 2 University of Auckland, and 3 Fertility Plus, Obstetrics & Gynaecology Department, National Womens Hospital, Auckland, New Zealand
4 To whom correspondence should be addressed at: The University Department of Obstetrics & Gynaecology, National Womens Hospital, Claude Road, Epsom, Auckland, New Zealand. e-mail: n.johnson{at}auckland.ac.nz
![]() |
Abstract |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Key words: Cochrane systematic review/evidence-based/gaps/infertility/subfertility
![]() |
Introduction |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
The goal of the Cochrane Collaboration is to improve decision making in health care by "preparing, maintaining and promoting the accessibility of systematic reviews of the effects of health care interventions". In addition to providing up to date, unbiased evidence on health care, systematic reviews can also identify gaps where there is insufficient or no evidence. Gaps in the evidence for clinical decision making may arise for a number of reasonswhere no research has been performed; where trials of insufficient power to determine an important treatment effect have been undertaken, but no meta-analysis has been performed; and where there is insufficient evidence from trials even after a thorough systematic review and meta-analysis.
The first comprehensive review of robust evidence for fertility treatments (Vandekerckhove et al., 1993) was published a decade ago. This report aims to summarize the findings of the Menstrual Disorders and Subfertility Group (MDSG) reviews in the field of subfertility, to assess qualitatively how successful MDSG membership has been in the coverage of this field and to assess where gaps in the evidence remain.
![]() |
Methods |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
(A) Where there is evidence of effectiveness or harm from a meta-analysis of trial data. The term relative effectiveness was used when two interventions were compared and the term effectiveness was used when the treatment was compared with either placebo or no treatment.
(B) Where there is insufficient evidence of effectiveness and the review authors have called for further research.
(C) Where there is insufficient evidence of effectiveness and the review authors have not called for further research.
Those reviews withdrawn from publication by virtue of not having been updated for at least 2 years have been highlighted in Tables IVI by suffixw.
|
![]() |
Results |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Two of the three reviews, which did not find evidence of effectiveness and where the reviewers did not feel that further research was warranted, have now been withdrawn from publication on the Cochrane Library because they had not been updated for >2 years.
Unexplained infertility
From eight reviews of unexplained infertility, two meta-analyses provided evidence to answer the clinical question and there was insufficient evidence in six reviews, four of which called for further research (Table I). In unexplained infertility, there was evidence of effectiveness of clomiphene citrate (CC) for women (Hughes et al., 2003a) and of tubal flushing with oil-soluble contrast media, although there was insufficient evidence for the relative efficacy of oil-soluble versus water-soluble media (Johnson et al., 2003a
). There was insufficient evidence of the effectiveness of bromocriptine (Hughes et al., 2003b
) and danazol (Hughes et al., 2003c
) for women and kinin-enhancing drugs for men (Vandekerckhove et al., 2003a
). There was also insufficient evidence for oral versus injectable ovulation induction agents for controlled ovarian stimulation (Athaullah et al., 2003
), for double versus single intrauterine insemination (IUI) (Cantineau et al., 2003
) and for the relative effectiveness of IVF versus expectant management, IUI with or without ovarian stimulation and gamete intrafallopian transfer (GIFT) (Pandian et al., 2003
).
Tubal infertility
In the five reviews of tubal infertility, one meta-analysis provided evidence of effectiveness and there was insufficient evidence in four reviews (Table II). In tubal infertility, there was evidence of effectiveness of laparoscopic salpingectomy for hydrosalpinges prior to IVF (Johnson et al., 2003b). Although there was evidence of effectiveness of Interceed, Gore-tex and Seprafilm adhesion barriers and of superiority of Gore-tex over Interceed in terms of adhesion reduction, there was no evidence these interventions were associated with an increased chance of pregnancy (Farquhar et al., 2003a
). There was insufficient evidence for various microsurgical techniques (Watson et al., 2003a
), various intra-operative liquid and fluid agents for adhesion prevention following subfertility surgery (Watson et al., 2003b
) and post-operative hydrotubation or laparoscopic adhesiolysis following pelvic reproductive surgery (Johnson and Watson, 2003
).
|
|
Other female causes of infertility
The one review in this category (Table IV), provided evidence of effectiveness of laparoscopic surgical treatment of endometriosis for increasing the chance of pregnancy (Jacobson et al., 2003).
|
|
|
![]() |
Discussion |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
There is a perception that Cochrane reviews rarely give a clear answer to a clinical question. This is clearly not the case since almost one third (12 out of 38) of the subfertility reviews did provide evidence of effectiveness of the interventions studied. Furthermore, the conclusion not enough evidence is important to emphasise the need for further research before adopting a new treatment that might be more invasive or expensive.
A common mistake of authors of trials and systematic reviews is to conclude that there is no difference or no effect of a treatment (Alderson and Chalmers, 2003). The preferred terminology is no evidence of effectiveness (Alderson and Chalmers, 2003
) since the null hypothesis can never be proved, only disproved, and there is always some uncertainty around the estimates of a treatment effect. In this report, where reviewers have concluded no evidence of effectiveness but suggested that no further research is required, this implies that the review has ruled out a pre-specified clinically important effect of the treatment based on the numbers included in the meta-analysis. Reviewers should only draw this conclusion if the individual trials are adequately powered or if clinically important differences between treatments have been excluded. The width of the confidence intervals around the point estimate may also give some indication of whether or not there is a need for further research. However the methodology for power calculations in systematic reviews (unlike power calculations in RCTs) is not well established.
There are particular methodological challenges for subfertility trials and in particular, many trials do not report live-birth outcomes, clearly the most important outcome to a couple with a fertility problem (Vail and Gardener, 2003). Whilst awareness of the likelihood of conceiving after one cycle of treatment is of some interest, the one piece of information that a woman or a couple really want is the likelihood of having a baby at the end of a course of treatment, not necessarily after each cycle. Yet there has been a preference to report implantation rates or per cycle data in subfertility trials. Per woman or per couple data are not always reported but reporting and pooling of per cycle data is statistically inappropriate when it is women or couples who are randomized in trials, as many of the women will have undergone more than one cycle. Furthermore, few trials report by intention-to-treat; the inappropriate use of cross-over trial design and the failure to use a secure method of randomization is also common (Vail and Gardener, 2003
). The design of future clinical trials needs to consider these issues in order to improve the utility of the research undertaken.
Whilst this paper may serve as a reference for the best available evidence for infertility treatments, indiscriminate use of the summary tables is not appropriate. The strength of systematic review evidence inevitably reflects the quality of the original trials within the review. Vandekerckhove et al. (1993a) noted the poor quality, or even lack, of true randomization, a major potential source of bias. Thus each trial contributing to a systematic review must be scrutinized in detail.
Cochrane review work can help to plug gaps in the evidence. Firstly, a meta-analysis may demonstrate effectiveness of an intervention where the relevant primary trials had not shown a significant effect. Secondly, conclusions of insufficient evidence assist with the definition of a research agenda and may lead to the commissioning of trials. There are numerous examples of trials being commenced after a Cochrane systematic review has highlighted deficiencies in the evidence. Indeed, there is a compelling argument in favour of performing a systematic review prior to the design of any new trial. Thirdly, a strategic appraisal of the coverage of the scope of a collaborative review group enables reviews to plug other gapsthis is the principle of registering titles through the editorial base of a Cochrane Collaborative Review Group to minimize the likelihood of duplication and overlap within reviews. Table VII summarizes the published protocols, registered titles and proposed titles on subfertility within the MDSG. Those interested in registering a review title for a clinical question in subfertility not covered by the titles, protocols and reviews outlined in this paper should contact Michelle Proctor, Collaborative Review Group Co-ordinator, on e-mail m.proctor@auckland.ac.nz. In conclusion, there are many gaps in the evidence for clinical decision making in subfertility and Cochrane review work has eliminated some gaps in the evidence and highlighted others.
|
![]() |
Acknowledgements |
---|
![]() |
References |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Alderson, P. and Chalmers, I. (2003) Survey of claims of no effect in abstracts of Cochrane reviews. Brit. Med. J., 326, 475.
Albuquerque, L.E., Saconato, H. and Maciel, M.C. (2003) Depot versus daily administration of gonadotrophin releasing hormone agonist protocols for pituitary desensitisation in assisted reproduction cycles (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Al-Inany, H. and Aboulghar, M. (2003) Gonadotrophin-releasing hormone antagonists for assisted conception (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Athaullah, N., Proctor, M. and Johnson N.P. (2003) Oral versus injectable ovulation induction agents for unexplained subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Bayram, N., van Wely, M., Vandekerckhove, P., Lilford, R. and van der Veen, F. (2003a) Pulsatile luteinising hormone releasing hormone for ovulation induction in subfertility associated with polycystic ovary syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Bayram, N., van Wely, M. and van der Veen, F. (2003b) Recombinant FSH versus urinary gonadotrophins or recombinant FSH for ovulation induction in subfertility associated with polycystic ovary syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Blake, D., Proctor, M., Johnson, N. and Olive, D. (2003) Cleavage stage versus blastocyst stage embryo transfer in assisted conception (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Cantineau, A.E.P., Heineman, M.J. and Cohlen, B.J. (2003) Single versus double insemination (IUI) in stimulated cycles for subfertile couples (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Cohlen, B.J., Vandekerckhove, P., te Velde, E.R. and Habbema, J.D.F. (2003) Timed intercourse versus intra-uterine insemination with or without ovarian hyperstimulation for subfertility in men (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Cochrane, A.L. (1979) 19311971: a critical review with particular reference to the medical profession. In: Teeliz Smith, G. (ed) Medicines for the Year 2000. Office of Health Economics, London, UK. pp. 111.
DAngelo, A. and Amso, N. (2003a) Embryo freezing for preventing ovarian hyperstimulation syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
DAngelo, A. and Amso, N. (2003b) Coasting (withholding gonadotrophins) for preventing ovarian hyperstimulation syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Daya, S. (2003a) Follicle-stimulating hormone and human menopausal gonadotropin for ovarian stimulation in assisted reproduction cycles (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Daya, S. (2003b) Gonadotrophin-releasing hormone agonist protocols for pituitary desensitization in in vitro fertilization and gamete intrafallopian transfer cycles (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Daya, S. and Gunby, J. (2003) Recombinant versus urinary follicle stimulating hormone for ovarian stimulation in assisted reproduction cycles (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Evers, J.L.H., Collins, J.A. and Vandekerckhove, P. (2003) Surgery or embolisation for varicocele in subfertile men (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Farquhar, C., Vandekerckhove, P., Watson, A., Vail, A. and Wiseman, D. (2003a) Barrier agents for preventing adhesions after surgery for subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Farquhar, C., Vandekerckhove, P. and Lilford, R. (2003b) Laparoscopic drilling by diathermy or laser for ovulation induction in anovulatory polycystic ovary syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Hughes, E., Collins, J. and Vandekerckhove, P. (2003a) Clomiphene citrate for unexplained subfertility in women (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Hughes, E., Collins, J. and Vandekerckhove, P. (2003b) Bromocriptine for unexplained subfertility in women (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Hughes, E., Tiffin, G. and Vandekerckhove, P. (2003c) Danazol for unexplained infertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Hughes, E., Collins, J. and Vandekerckhove, P. (2003d) Clomiphene citrate for ovulation induction in women with oligo-amenorrhoea Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Hughes, E., Collins, J. and Vandekerckhove, P. (2003e) Gonadotrophin-releasing hormone analogue as an adjunct to gonadotropin therapy for clomiphene-resistant polycystic ovarian syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Jacobson, T.Z., Barlow, D.H., Koninckx, P.R., Olive, D. and Farquhar, C. (2003) Laparoscopic surgery for subfertility associated with endometriosis (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Johnson, N.P. and Watson, A. (2003) Postoperative procedures for improving fertility following pelvic reproductive surgery (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Johnson, N., Vandekerckhove, P., Watson, A., Lilford, R., Harada, T. and Hughes E. (2003a) Tubal flushing for subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Johnson, N.P., Mak, W. and Sowter, M.C. (2003b) Surgical treatment for tubal disease in women due to undergo in vitro fertilisation (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Kotarba, D., Kotarba, J. and Hughes, E. (2003) Growth hormone for in vitro fertilization (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Nugent, D., Vandekerckhove, P., Hughes, E., Arnot. M. and Lilford, R. (2003) Gonadotrophin therapy for ovulation induction in subfertility associated with polycystic ovary syndrome (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
OBrien, P. and Vandekerckhove, P. (2003) Intra-uterine versus cervical insemination of donor sperm for subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Pandian, Z., Bhattacharya, S., Nikolaou, D., Vale, L. and Templeton, A. (2003) In vitro fertilisation for unexplained subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Vail, A. and Gardener, E. (2003) Common statistical errors in the design and analysis of subfertility trials. Hum. Reprod., 18, in press.
Vandekerckhove, P., ODonovan, P.A., Lilford, R.J. and Harada, T.W. (1993) Infertility treatment: from cookery to science. The epidemiology of randomised controlled trials. Brit. J. Obstet. Gynecol., 100, 10051036.[ISI][Medline]
Vandekerckhove, P., Lilford, R., Vail, A. and Hughes, E. (2003a) Kinin-enhancing drugs for unexplained subfertility in men (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Vandekerckhove, P., Lilford, R., Vail, A. and Hughes, E. (2003b) Clomiphene or tamoxifen for idiopathic oligo/asthenospermia (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Vandekerckhove, P., Lilford, R., Vail, A. and Hughes, E. (2003c) Androgens versus placebo or no treatment for idiopathic oligo/asthenospermia (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Vandekerckhove, P., Lilford, R., Vail, A. and Hughes, E. (2003d) Bromocriptine for idiopathic oligo/asthenospermia (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Van Perperstraten, A.M., Proctor, M.L., Phillipson, G. and Johnson, N.P. (2003) Techniques for surgical retrieval of sperm prior to ICSI for azoospermia (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Van Rumste, M.M.E., Evers, J.L.H., Farquhar, C.M. and Blake, D.A. (2003) Intra-cytoplasmic sperm injection versus partial zona dissection, subzonal insemination and conventional techniques for oocyte insemination during in vitro fertilisation (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Van Wely, M., Westergaard, L.G., Bossuyt, P.M.M. and Van der Veen, F. (2003) Human menopausal gonadotrophin versus recombinant follicle stimulating hormone for ovarian stimulation in assisted reproductive cycles (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Watson, A., Vandekerckhove, P. and Lilford, R. (2003a) Techniques for pelvic surgery in subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Watson, A., Vandekerckhove, P. and Lilford, R. (2003b) Liquid and fluid agents for preventing adhesions after surgery for subfertility (Cochrane Review). In The Cochrane Library, Issue 1. Oxford Update Software.
Submitted on January 10, 2003; accepted on March 3, 2003.