Monash Institute of Health Services Research, Monash University, Clayton, Victoria 3168, Australia.
Correspondence to: D. Ilic, Monash Institute of Health Services Research, Level 1 Block E, Monash Medical Centre, Clayton, VIC 3168, Australia. E-mail: dragan.ilic{at}med.monash.edu.au
![]() |
Abstract |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Methods. Keywords relevant to osteoarthritis were searched across 15 search engines representing medical, general and meta-search engines. Search engine efficiency was defined as the percentage of unique and relevant websites from all websites returned by each search engine. The quality of relevant information was appraised using the DISCERN tool and the concordance of the information offered by the website with the available evidence about osteoarthritis determined.
Results. A total of 3443 websites were retrieved, of which 344 were identified as unique and providing information relevant to osteoarthritis. The overall quality of website information was poor. There was no significant difference between types of search engine in sourcing relevant information; however, the information retrieved from medical search engines was of a higher quality. Fewer than a third of the websites identified as offering relevant information cited evidence to support their recommendations.
Conclusions. Although the overall quality of website information about osteoarthritis was poor, medical search engines may provide consumers with the opportunity to source high-quality health information on the Internet. In the era of evidence-based medicine, one of the main obstacles to the Internet reaching its potential as a medical resource is the failure of websites to incorporate and attribute evidence-based information.
KEY WORDS: Osteoarthritis, Quality of information, Internet, e-Health, Patient education
![]() |
Introduction |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
The Internet is continually evolving as a global communications network. Several hundred million people worldwide use the Internet, of whom 37% use it as a source of health information [3, 4]. It is not only health-care consumers who are turning to the Internet as a resource for self-education; clinicians are increasingly relying on the Internet to update their clinical knowledge [5]. The speed with which new technologies and treatments are being developed means that many clinicians are dependent on the Internet to access information to guide their practice. This is particularly the case for those in rural and remote areas. The use of the Internet to inform and influence health care, termed e-health, has significant potential to inform health-care decisions, improve health management and produce better patient outcomes.
General search engines have been designed to help source information on the Internet. Meta-search engines have been developed in the attempt to provide a more specific return of results from the initial search query by performing simultaneous searches across designated general search engines and collating the results. Medical search engines attempt to locate website information relevant to users needs by only indexing online information within a medical context. Subsequently, the medical search engine index is not as large as general search engines and may help consumers identify relevant information.
The greatest barrier to the Internet reaching its potential to inform health care is not the difficulty in finding information, rather finding valid, reliable information. Many factors affect the quality of web-based information. Lack of governance is both a strength and weakness of the Internet as a communications system. Proprietors of health-care websites are competing for sales and market share, which can often lead to selective disclosure of evidence and the presentation of inaccurate information. Unlike print media, there is no editorial control to protect consumers. Additionally, website creators can influence search results through sponsorship of search engines or by manipulating their website characteristics to increase their visibility to the searching engine.
Several initiatives have been introduced in an attempt to improve the quality of Internet-based health information. Organizational controls such as the Health on the Net (HON) code offer a certain form of regulation by providing a stamp of approval for websites adhering to agreed quality principles. Similar models include the rating of website information by independent third parties offering consumers access to filtered quality information. The main drawback facing these initiatives is that new information appears faster than it can be appraised due to the decentralized nature and continued growth of the Internet [6]. An alternative form of control is to place greater responsibility on the Internet user by providing access to tools, such as the DISCERN tool, which gives a mechanism to consumers for appraising web-based health information, up-skilling and empowering them to recognize valid and reliable information [79].
This study aims to evaluate the Internet as a source of information for patients and consumers about osteoarthritis by (i) determining the comparative efficiency of medical, general and meta-search engines in retrieving relevant information and (ii) assessing the quality of the relevant information retrieved, and its concordance with the evidence base underpinning the management of osteoarthritis.
As this was a study of published information and involved no participants no ethics approval was required.
![]() |
Methods |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
|
Assessment of website quality
The quality of website information was assessed by one investigator using the DISCERN tool. To ensure reliability, a subset of websites was assessed by a second investigator. The DISCERN tool has been designed to help consumers appraise health information on the Internet. The tool examines website information against 16 key criteria, resulting in an overall assessment of quality on a five-point Likert scale ranging from 1 (the publication is poor) to 5 (the publication is good quality and is a useful and appropriate source of information about treatment choices) [7, 8]. Websites were also assessed for the presence or absence of 10 key criteria, previously identified as indicators of quality website information (Table 2) [11, 12]. Whether websites cited evidence, and the level of evidence used to underpin any recommendations (based on the National Health and Medical Research Council levels of evidence) was extracted [13]. The target audience of the website (consumer, health professional or both) was extracted.
|
![]() |
Results |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
The overall quality of website information was poor, with the mean DISCERN quality rating score being 1.70 ± 0.67. Only 3% of websites rated above 3 on the DISCERN scale (i.e. provided potentially important information but with no serious shortcomings). The quality of websites sourced by medical search engines was of a significantly higher quality than those sourced by general or meta-search engines (P = 0.0001). The HealthInsite medical search engine sourced websites of the highest quality. The quality of information was significantly lower in websites that provided a direct service, such as selling of an arthritis-related product. Conversely, websites that demonstrated currency of information, had links to other sources, cited evidence, recognized authorship, had external source approval or recorded updating were more likely to have a significantly higher quality of information (Table 2). Higher-quality information was also associated with websites that provided information to both consumers and health-care professionals.
![]() |
Discussion |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Previous studies examining search engine efficiency support our findings that medical search engines are no more efficient than general or meta-search engines in sourcing relevant health information [11, 12]. These studies, which searched for information on androgen deficiency in the ageing male (ADAM) and prostate cancer screening, are in direct contrast to the findings of this study with respect to the value of medical search engines in identifying higher-quality information. This difference in the quality of websites retrieved by medical search engines may be related to the lack of a definitive evidence base regarding ADAM and prostate cancer screening. For topics where evidence is clear, such as osteoarthritis, medical search engines appear to be meeting their goal of filtering the Internet to retrieve less, but more valid, information. However, in conditions that lack a definitive evidence base search engines appear less likely to retrieve relevant websites offering high-quality information.
While medical search engines may in some cases be helping, the Internet is currently falling short of its potential to facilitate evidence-based decision-making. Even in the presence of the strong evidence base for osteoarthritis, online information is rarely supported by evidence. In this study fewer than a third of relevant websites cited evidence to support their recommendations. Many websites made claims unsupported by the literature, whilst others, whose recommendations concurred with the evidence, made no reference to existing literature.
Consumers are generally not aware of characteristics that indicate quality information on the Internet [14]. Education about quality indicators such as (i) a clear statement of the purpose and target audience for the website, (ii) core standards for information provision such as authorship, disclosure, attribution and currency, (iii) citation of the best available evidence, (iv) acknowledgement of risks, other treatments and the effect of no treatment, (v) references to further sources and (vi) clear disclosure of sponsorship, affiliations or conflicts of interest, has the potential to increase consumer ability to access and resource quality information, providing a means of consumer empowerment and up-skilling. Bringing governance and editorial control to ensure the validity of Internet-based health information is an impossible task. Empowering and educating consumers to find and recognize valid health information may therefore be the only way for the Internet to reach its potential to inform, rather than mislead, health-care decisions.
This study assessed the nature, accessibility and quality of website information about osteoarthritis. Due to the dynamic nature of the Internet and the variation between the evidence base of different clinical conditions, the findings of this study may not be generalizable to other clinical areas. Future research could be directed towards investigating the value of medical search engines for other common conditions to determine if the results are consistent across other conditions with a strong evidence base.
|
![]() |
Acknowledgments |
---|
The authors have declared no conflicts of interest.
![]() |
References |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
|