A multi-level usability evaluation of mobile health applications: A case study

Area of Science:

• Health Informatics
• Human-Computer Interaction
• Software Engineering

Background:

• Mobile health (mHealth) applications offer significant potential for patient self-management.
• Developing usable mHealth applications requires robust evaluation frameworks.
• Existing usability frameworks may not fully capture the complexities of mHealth contexts.

Purpose of the Study:

• To propose and illustrate a methodological approach for developing usable mHealth applications.
• To adapt a 3-level health information technology (IT) usability evaluation framework for mHealth app development.
• To guide the iterative refinement of mHealth app content, functionality, and interface.

Main Methods:

• A 3-level stratified usability evaluation framework was employed.
• Card sorting technique for information architecture at Level 1 (user-task).
• Laboratory usability testing and heuristic evaluation at Level 2 (user-task-system).
• Real-world usability evaluation during a 3-month trial at Level 3 (user-task-system-environment).

Main Results:

• The 3-level framework facilitated in-depth exploration of user-task-system-environment interactions.
• Iterative refinement based on usability findings improved the mHealth app's suitability.
• Card sorting, lab testing, and real-world trials provided comprehensive usability data.

Conclusions:

• The 3-level health IT usability evaluation framework is effective for designing, developing, and evaluating mHealth apps.
• Methodological recommendations derived from this framework can inform future mHealth usability studies.
• This approach enhances the development of user-centered mHealth solutions.