Online urological educational material for medical students: can search engines be trusted?

To determine the credibility of online urological information that medical students are likely to encounter, determine possible discrepancies between the credibility of information pertaining to different areas within urology (especially those less relevant to patients), and assess trends in the sponsorship of online urological educational material.

Health on the Net (HON) principles were used as a validated benchmark to assess the reliability of websites that appeared in the first 150 results of a search using the Google search engine. A variety of urological search terms were used, grouped into three broad categories with varying relevance to patients and medical students. Further analysis focussed on the sponsorship of assessed websites.

A total of 5400 websites were assessed for validation over a set of 36 search terms. Only 843/5400 (15.6%) of these were HONcode accredited, indicating a large proportion of unverified and potentially unreliable information. Search engine rankings usually favoured accredited websites (P = 0.009), and accreditation peaked at 51.1% (184/360) in the first page of results, but sorting became weaker outside the highest search results. The percentage of accredited websites varied significantly between different subcategories of search terms such as conditions (18.3% [329/1800], P = 0.003) and procedures (13.5% [243/1800], P = 0.043). Governmental/educational and commercial sources supported the majority of websites assessed for sponsorship (21% [31/150] and 33% [49/150], respectively), and the former were more likely to rank highly in search results.

Online urological information frequently lacks validation and is often of indeterminate credibility. There is a marked decrease in the proportion of accredited websites beyond the highest-ranked results and when considering search categories more relevant to students and less relevant to patients. Students cannot necessarily rely on free online sources for accurate information and could benefit from the development of more rigorous novel tools and platforms.