The reliability of methodological ratings for speechBITE using the PEDro-P scale

Area of Science:

• Speech-language pathology research
• Evidence-based practice in allied health

Background:

• speechBITE is an online database providing over 3000 journal references for speech and language therapists.
• It includes methodological ratings using the PEDro-P scale to assess the quality of randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs).
• The reliability of the original PEDro scale is established, but the PEDro-P scale's reliability on speechBITE was previously unreported.

Purpose of the Study:

• To evaluate the reliability of PEDro-P scale ratings conducted by raters on the speechBITE database.
• To compare these reliability results with published data for the original PEDro scale.
• Analysis included both the total PEDro-P score and individual item scores.

Main Methods:

• Seventeen volunteer raters from the speechBITE network assessed the first 100 RCTs and NRCTs available on the database.
• Ratings included criterion and overall scores, which were compared to existing PEDro scale reliability studies.
• Intra-class correlations and percentage agreement were used to establish and benchmark reliability.

Main Results:

• The reliability of speechBITE's PEDro-P ratings ranged from fair to excellent for both total scores and individual items.
• The established reliability was found to be comparable to that reported for other allied health databases using the PEDro scale.
• This indicates consistent and dependable quality assessments within the speechBITE database.

Conclusions:

• Speech and language therapists can be confident in the reliability of the methodological ratings provided on the speechBITE website.
• The findings support the use of speechBITE for accessing high-quality research to inform clinical decisions.
• Further discussion addresses potential differences between this study and prior PEDro scale reliability research.