Related Experiment Video
Updated: Mar 14, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
LLM-based keyword augmentation for title-driven evidence selection: A practical approach
1Department of Forensic Sciences, Sungkyunkwan University, Seoul, South Korea.
Abstract:
Keyword-based search is widely used in digital forensic investigations, yet its effectiveness depends strongly on investigator experience, leading to inconsistent results and missed evidence. While previous studies have explored machine learning and large language models (LLMs) to address this, practical deployment is often constrained by confidentiality requirements and the infrastructure costs of maintaining high-performance models locally. We propose a practical LLM-based keyword augmentation method that expands investigator-supplied seed keywords, whether single words or multiple words, while restricting inputs to non-sensitive case context. This enables rapid evidence triage using file names without transmitting primary evidence content to external services. We validate the approach in three stages: (i) using 426 documents, we confirm that file names correlate with document bodies through semantic similarity and keyword coverage analyses, showing clear separation from randomized file name-content pairings; (ii) in a benchmark of 1500 file names comprising 500 relevant cases and 1000 controls, prompt-only keyword generation using ChatGPT models demonstrates effective retrieval performance, with ChatGPT-4.1 achieving the best overall balance; and (iii) in a usability study involving 20 digital forensic investigators, augmented keywords improve evidence detection, with junior investigators showing statistically significant gains as assessed by the Wilcoxon signed-rank test. Overall, the method supports efficient triage in geographically distributed and large-scale investigations by applying LLM-augmented keywords, thereby reducing experience-related performance gaps.
More Related Videos
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
Related Concept Videos
The Evidence for Evolution
Lateralization
Randomized Experiments
Simple randomization
Simple...
Amplifying Signals via Enzymatic Cascade
Lumber
Initially, the surfaces of these lumber pieces are rough, and their dimensions may vary slightly from one end to...
Ligand Binding and Linkage