Aggregate web activity dataset for user-agent behavior classification
Related Experiment Video
Updated: Apr 25, 2026

Design and Evaluation of Smart Glasses for Food Intake and Physical Activity Classification
Published on: February 14, 2018
Geza Lucz1, Bertalan Forstner1
1Department of Automation and Applied Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Műegyetem rkp. 3., H-1111 Budapest, Hungary.
Abstract:
600 million web access requests made to multiple servers have been collected between 2019 and 2023. The 4-year automated collection spans over 8000 domains and had iteratively been upgraded with extra data fields up until its closure in March of 2023. The dataset is normalized and highly expandable though the fractal tree index facilities provided by MySQL and the TokuDB storage engine. It is suitable for researching web browser user-agent information-based behavior and constructing or verifying strategies for exploit and bot identification. The large sample size makes it a good choice for AI training and provides a unique opportunity to track the long-term evolution of specific user-agents and their originating IP address ranges.
More Related Videos
Related Concept Videos
What is Behavior?
Force Classification
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Classification of Systems-I
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Aggregates Classification
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Behaviorism
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...

