Café Scout: Development and Pilot Evaluation of a Real-Time Tool for Assessing and Planning Improvements to the Healthiness of Food Service Environments

Community-based foodservice outlets (eg, cafés in sporting centers or health care settings) have the potential to support population health, but currently these outlets predominantly encourage less healthy food purchases. No tools exist to rapidly assess the healthiness of the in-store food environments in foodservice outlets from the "4 Ps of marketing" perspective (product, placement, price, and promotion) while providing real-time feedback to support the planning and implementation of healthy changes.

This study aimed to adapt the "Store Scout App," originally developed for grocery stores, to assess the healthiness of in-store food environments in Australian foodservice outlets and to evaluate the validity and reliability of the new tool.

A 2-stage approach was used to develop "Café Scout": (1) tool development (convening a working group, identifying tool requirements, and developing an initial prototype; February 2022-February 2023); and (2) tool refinement and validity evaluation (pilot testing-"Round 1"; tool updates, training development, and extended testing-"Round 2"; February 2023-December 2023).

Tool testers included health promotion or local government officers (n = 12), food outlet managers (n = 3), researchers (n = 3), and university nutrition placement students (n = 5), all based in Victoria, Australia. The tool was tested across 27 foodservice outlets in community-based sporting centers in regional and metropolitan areas of Victoria.

Interrater reliability, validity (construct, concurrent criterion, and face validity), and usability were assessed.

Gwet's Agreement Coefficients were used to assess interrater reliability, Pearson correlation to assess construct and concurrent validity, and descriptive analysis to assess face validity and usability based on user feedback.

"Café Scout," with up to 278 Yes/No questions, was developed to assess food outlet marketing practices across 8 food and drink product categories. Evaluation showed good interrater reliability (mean Gwet's agreement coefficient, 0.70 [95% confidence interval (CI), 0.64-0.76]), strong alignment between tool scores and product healthiness (eg, total score vs healthiest product availability, r = 0.70, P < .001), and moderate alignment between tool scores and the healthiness of customer drink purchases (eg, mean drink score vs healthiest drink purchases, r = 0.60, P = .01). User feedback (n = 13 surveys) highlighted the tool's value in supporting healthy changes.

Café Scout can rapidly assess the in-store food environments and provide real-time feedback, facilitating the continuous monitoring and planning of healthy changes in foodservice outlets to support healthier food choices and population health.