Related Experiment Video
Updated: Aug 14, 2026
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Searching the Literature by Meaning: Benchmarking Free and Commercial Word Embedding Models on Social Work Text
Brian E Perron1, Miao Wang2, Nanyi Deng3
1School of Social Work, University of Michigan, Ann Arbor, Michigan, USA.
Journal of Evidence-Based Social Work (2019)
|August 13, 2026
Summary
Free artificial intelligence (AI) embedding models can effectively search social work literature, matching or surpassing paid services. These accessible tools offer high-quality, meaning-based searches without subscriptions or external data sharing.
Area of Science:
- Information Science
- Social Work Research
- Artificial Intelligence
Background:
- Traditional literature searches rely on keyword matching, which can be limiting.
- Commercial AI embedding models offer meaning-based search but come with costs.
- The need for accessible, high-quality search tools in social work is significant.
Purpose of the Study:
- To evaluate free embedding models for searching social work literature.
- To compare the performance of free models against commercial standards.
- To determine the necessity and impact of rerankers in search.
Main Methods:
- Tested twelve free and two commercial AI embedding models on 64,956 social work records.
- Utilized 150 curated queries and conducted over 50,000 blind head-to-head comparisons judged by AI.
- Validated results using a judge-free known-item test and expert human evaluation.
Main Results:
- Free embedding models matched or exceeded the performance of commercial options.
- One free model, with a reranker, achieved the best overall search configuration.
- Keyword search significantly underperformed all tested embedding models.
Conclusions:
- High-quality, meaning-based literature search is feasible using free AI tools on standard hardware.
- The choice of embedding model should consider factors like size, speed, cost, and privacy.
- Accessible AI-powered search democratizes evidence-based practice in social work.
Related Concept Videos
02:34Empathy
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor.
02:16Stereotype Content Model
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence categorization, a person will feel...
02:06Social Exchange Theory
We have discussed why we form relationships, what attracts us to others, and different types of love. But what determines whether we are satisfied with and stay in a relationship? One theory that provides an explanation is social exchange theory. According to social exchange theory, we act as naïve economists in keeping a tally of the ratio of costs and benefits of forming and maintaining a relationship with others (Rusbult & Van Lange, 2003).
01:16Models, Theories, and Laws
Scientists frequently use models to help them comprehend a specific collection of phenomena. In physics, a model is a condensed version of a physical system that is too complex to study thoroughly. One such example is the light wave model; unlike water waves, light waves are typically invisible to us. Nonetheless, it is helpful to think of light as being composed of waves, since investigations show that light behaves like water waves. Since it is impossible to visually see what is genuinely...
01:56Ethics in Research
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
01:50Cross-Sectional Research
In cross-sectional research, a researcher compares multiple segments of the population at the same time. If they were interested in people's dietary habits, the researcher might directly compare different groups of people by age. Instead of following a group of people for 20 years to see how their dietary habits changed from decade to decade, the researcher would study a group of 20-year-old individuals and compare them to a group of 30-year-old individuals and a group of 40-year-old...