Related Experiment Video
Updated: Sep 29, 2025
08:27
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
Published on: September 27, 2019
7.0K
Designing Formulae for Ranking Search Results: Mixed Methods Evaluation Study.
Laura Douze1,2, Sylvia Pelayo1,2, Nassir Messaadi3
1Inserm, Centre d'Investigation Clinique pour les Innovations Technologiques 1403, Institut Coeur-Poumon, Lille, France.
JMIR Human Factors
|March 25, 2022
Summary
This study improved the LiSSa search engine by incorporating user feedback to enhance its ranking formula. Prioritizing consensus articles and clinical relevance led to more user-tailored health literature search results.
Area of Science:
- Health Informatics
- Information Retrieval
- Medical Informatics
Background:
- Search engine success hinges on result relevance, necessitating effective ranking formula evaluation.
- Current evaluation methods primarily use quantitative data, neglecting qualitative insights for user-centric improvements.
- Understanding user needs is crucial for tailoring search algorithms to end-users.
Purpose of the Study:
- To evaluate two parameter settings of the LiSSa (scientific literature in health care) ranking formula.
- To adapt the LiSSa ranking formula to better meet the needs of its end-users.
- To improve the relevance and usability of health scientific literature search results.
Main Methods:
- User tests were conducted with general practitioners and registrars to gather quantitative and qualitative data.
- Participants assessed search result relevance and rated the ranking criteria of two different formulae.
- Verbalizations were analyzed to characterize the criteria used by users in evaluating search results.
Main Results:
- A ranking formula prioritizing articles representing a consensus in the field was preferred by users.
- Users evaluate an article's relevance based on its topic, methodology, and clinical practice value.
- Qualitative data revealed specific user preferences for ranking criteria.
Conclusions:
- Improvements were implemented to prioritize topic relevance and down-weight less scientifically valuable articles.
- Qualitative methodology provided valuable user input for refining the ranking formula.
- The study demonstrated that user-centered qualitative data can significantly enhance search engine usability.
Keywords:
human factorsinformation retrievalsearch enginesearch result rankingtopical relevanceuser testingMore Related Videos
13:54A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
Published on: August 18, 2023
5.1K
05:34Applying Cheminformatics to Develop a Structure Searchable Database of Analytical Methods
Published on: June 6, 2025
840
Related Concept Videos
01:02Ranks
294
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
294
01:21Friedman Two-way Analysis of Variance by Ranks
319
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
319
02:01Factorial Design
13.3K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.3K
01:15Study Design in Statistics
9.4K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
9.4K
02:37Experimental Determination of Chemical Formula
41.1K
The elemental makeup of a compound defines its chemical identity, and chemical formulas are the most concise way of representing this elemental makeup. When a compound’s formula is unknown, measuring the mass of its constituent elements is often the first step in determining the formula experimentally.
41.1K
01:16Experimental Designs
15.7K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
15.7K