On the public citation graph
An investigation of web crawler behavior: characterization and metrics
0 signed · 98 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1002/047120644xopenalex-snapshot
Self‐Similar Network Traffic and Performance Evaluation
inferredcites →https://doi.org/10.1002/047120644x.ch15openalex-snapshot
Characteristics of TCP Connection Arrivals
inferredcites →https://doi.org/10.1007/3-540-45431-4_6openalex-snapshot
Design and Implementation of a Distributed Crawler and Filtering Processor
inferredcites →https://doi.org/10.1007/3-540-46506-5openalex-snapshot
Performance Evaluation: Origins and Directions
inferredcites →https://doi.org/10.1007/3-540-46506-5_9openalex-snapshot
Performance Characteristics of the World Wide Web
inferredcites →https://doi.org/10.1007/978-3-540-45229-4_36openalex-snapshot
Characterizing Crawler Behavior from Web Server Access Logs
inferredcites →https://doi.org/10.1016/j.comcom.2004.04.010openalex-snapshot
A distributed middleware infrastructure for personalized services
inferredcites →https://doi.org/10.1016/s0004-3702(99)00098-3openalex-snapshot
Towards adaptive Web sites: Conceptual framework and case study
inferredcites →https://doi.org/10.1016/s0169-7552(98)00110-xopenalex-snapshot
The anatomy of a large-scale hypertextual Web search engine
inferredcites →https://doi.org/10.1016/s1389-1286(99)00052-3openalex-snapshot
Focused crawling: a new approach to topic-specific Web resource discovery
inferredcites →https://doi.org/10.1023/a:1013228602957openalex-snapshot
Discovery of Web Robot Sessions Based on their Navigational Patterns
inferredcites →https://doi.org/10.1023/a:1019236319752openalex-snapshot
Changes in Web client access patterns: Characteristics and caching implications
inferredcites →https://doi.org/10.1109/65.844498openalex-snapshot
A workload characterization study of the 1998 World Cup Web site
inferredcites →https://doi.org/10.1109/90.650143openalex-snapshot
Self-similarity in World Wide Web traffic: evidence and possible causes
inferredcites →https://doi.org/10.1109/infcom.1999.749260openalex-snapshot
Web caching and Zipf-like distributions: evidence and implications
inferredcites →https://doi.org/10.1145/233008.233034openalex-snapshot
Web server workload characterization
inferredcites →https://doi.org/10.1145/233013.233034openalex-snapshot
Web server workload characterization
inferredcites →https://doi.org/10.1145/233013.233038openalex-snapshot
Self-similarity in World Wide Web traffic
inferredcites →https://doi.org/10.1145/277851.277897openalex-snapshot
Generating representative Web workloads for network and server performance evaluation
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1007/978-1-4471-4594-3_44openalex-snapshot
Temporal Analysis of Crawling Activities of Commercial Web Robots
inferred← citeshttps://doi.org/10.1007/978-3-031-70890-9_8openalex-snapshot
CRATOR a CRAwler for TOR: Turning Dark Web Pages into Open Source INTelligence
inferred← citeshttps://doi.org/10.1007/978-3-032-12801-0_23openalex-snapshot
Mouse Pointing Endpoint Prediction to Distinguish Between Human and Bot Using Kinematic Template Matching
inferred← citeshttps://doi.org/10.1007/978-3-319-03584-0_1openalex-snapshot
A Crawler Guard for Quickly Blocking Unauthorized Web Robot
inferred← citeshttps://doi.org/10.1007/978-3-540-72524-4_29openalex-snapshot
A Probabilistic Reasoning Approach for Discovering Web Crawler Sessions
inferred← citeshttps://doi.org/10.1007/978-3-540-74819-9_28openalex-snapshot
RSS-Based Blog Agents for Educational Applications
inferred← citeshttps://doi.org/10.1007/978-3-540-89985-3_57openalex-snapshot
Challenges in Using Peer-to-Peer Structures in Order to Design a Large-Scale Web Search Engine
inferred← citeshttps://doi.org/10.1007/978-3-642-25575-5_19openalex-snapshot
Analysis of Web Logs: Challenges and Findings
inferred← citeshttps://doi.org/10.1007/978-981-13-0923-6_47openalex-snapshot
Performance Evaluation of Large Data Clustering Techniques on Web Robot Session Data
inferred← citeshttps://doi.org/10.1007/978-981-15-8083-3_7openalex-snapshot
A Novel Thematic Network Data Collector Based on Simulated Annealing Hybrid Genetic Algorithm
inferred← citeshttps://doi.org/10.1007/s00799-014-0111-5openalex-snapshot
Who and what links to the Internet Archive
inferred← citeshttps://doi.org/10.1007/s10618-010-0180-zopenalex-snapshot
Web robot detection techniques: overview and limitations
inferred← citeshttps://doi.org/10.1007/s11042-020-10250-8openalex-snapshot
An optimized crawling technique for maintaining fresh repositories
inferred← citeshttps://doi.org/10.1007/s13042-023-01905-7openalex-snapshot
FRS-SIFS: fuzzy rough set session identification and feature selection in web robot detection
inferred← citeshttps://doi.org/10.1016/j.aci.2017.04.002openalex-snapshot
Detection of attack-targeted scans from the Apache HTTP Server access logs
inferred← citeshttps://doi.org/10.1016/j.comnet.2008.09.021openalex-snapshot
Web robot detection: A probabilistic reasoning approach
inferred← citeshttps://doi.org/10.1016/j.cose.2009.05.004openalex-snapshot
Classification of web robots: An empirical study based on over one billion requests
inferred← citeshttps://doi.org/10.1016/j.eswa.2017.06.004openalex-snapshot
A soft computing approach for benign and malicious web robot detection
inferred← citeshttps://doi.org/10.1016/j.knosys.2021.107074openalex-snapshot
Efficient on-the-fly Web bot detection
inferred← citeshttps://doi.org/10.1016/j.neucom.2022.11.059openalex-snapshot
Reinforcement learning based web crawler detection for diversity and dynamics
inferred← citeshttps://doi.org/10.1049/iet-its.2019.0054openalex-snapshot
Natural language processing approach for appraisal of passenger satisfaction and service quality of public transportation
inferred← citeshttps://doi.org/10.1109/bec.2010.5631006openalex-snapshot
Effective EFSM generation for HW/SW-design verification
inferred← citeshttps://doi.org/10.1109/ciss.2018.8362266openalex-snapshot
Some (Non-)universal features of Web robot traffic
inferred← citeshttps://doi.org/10.1109/cts.2011.5898963openalex-snapshot
Real-time web crawler detection
inferred← citeshttps://doi.org/10.1109/dese.2011.83openalex-snapshot
Web Crawlers on a Health Related Portal: Detection, Characterisation and Implications
inferred← citeshttps://doi.org/10.1109/hpcc.2014.146openalex-snapshot
Analysis of Header Usage Patterns of HTTP Request Messages
inferred← citeshttps://doi.org/10.1109/hpcc/smartcity/dss.2018.00252openalex-snapshot
Online Web Bot Detection Using a Sequential Classification Approach
inferred← citeshttps://doi.org/10.1109/icacat.2018.8933587openalex-snapshot
Framework for Preprocessing and Feature Extraction from Weblogs for Identification of HTTP Flood Request Attacks
inferred← citeshttps://doi.org/10.1109/icc.2017.7996685openalex-snapshot
Protecting web contents against persistent distributed crawlers
inferred← citeshttps://doi.org/10.1109/iccet.2010.5485230openalex-snapshot
Detecting capability evaluate of spider detection techniques
inferred← citeshttps://doi.org/10.1109/icfcc.2010.5497315openalex-snapshot
An evaluating method of spider detection techniques by trap
inferred← citeshttps://doi.org/10.1109/icirca.2018.8597200openalex-snapshot
Categorization Performance of Unsupervised Learning Techniques for Web Robots Sessions
inferred← citeshttps://doi.org/10.1109/icisp.2006.7openalex-snapshot
Crawler Detection: A Bayesian Approach
inferred← citeshttps://doi.org/10.1109/icmla.2012.11openalex-snapshot
Detecting Web Robots Using Resource Request Patterns
inferred← citeshttps://doi.org/10.1109/icmla.2015.53openalex-snapshot
Request Type Prediction for Web Robot and Internet of Things Traffic
inferred← citeshttps://doi.org/10.1109/icmla.2017.0-161openalex-snapshot
Realistic Traffic Generation for Web Robots
inferred← citeshttps://doi.org/10.1109/icmult.2010.5630859openalex-snapshot
Study of Self-Similar Traffic Control of Campus Network
inferred← citeshttps://doi.org/10.1109/itc-egypt58155.2023.10206217openalex-snapshot
Green Computing and Security Practices for Optimizing Crawler Efficiency
inferred← citeshttps://doi.org/10.1109/nca.2008.47openalex-snapshot
Discovering New Trends in Web Robot Traffic Through Functional Classification
inferred← citeshttps://doi.org/10.1109/qest.2010.42openalex-snapshot
Searching for Heavy Tails in Web Robot Traffic
inferred← citeshttps://doi.org/10.1109/sp40001.2021.00079openalex-snapshot
Good Bot, Bad Bot: Characterizing Automated Browsing Activity
inferred← citeshttps://doi.org/10.1109/wcins.2010.5541838openalex-snapshot
Objective evaluation of Spider Detection Techniques
inferred← citeshttps://doi.org/10.1109/wi-iat.2010.316openalex-snapshot
The Ethicality of Web Crawlers
inferred← citeshttps://doi.org/10.1109/wict.2012.6409078openalex-snapshot
Defense response of search engine websites to non cooperating crawlers
inferred← citeshttps://doi.org/10.1111/exsy.12184openalex-snapshot
An integrated method for real time and offline web robot detection
inferred← citeshttps://doi.org/10.1145/1145581.1145634openalex-snapshot
Catching web crawlers in the act
inferred← citeshttps://doi.org/10.1145/1367497.1367617openalex-snapshot
Characterizing typical and atypical user sessions in clickstreams
inferred← citeshttps://doi.org/10.1145/2187836.2187860openalex-snapshot
Surviving a search engine overload
inferred← citeshttps://doi.org/10.1145/2467696.2467722openalex-snapshot
Access patterns for robots and humans in web archives
inferred← citeshttps://doi.org/10.1145/2492517.2500239openalex-snapshot
A comparison of web robot and human requests
inferred← citeshttps://doi.org/10.1145/2539150.2539161openalex-snapshot
An extensive study of Web robots traffic
inferred← citeshttps://doi.org/10.11575/prism/28501openalex-snapshot
Traffic Analysis of Two Scientific Web Sites
inferred← citeshttps://doi.org/10.1177/0165551507087237openalex-snapshot
Web robot detection in the scholarly information environment
inferred← citeshttps://doi.org/10.1177/0165551508089396openalex-snapshot
A three-year study on the freshness of web search engine databases
inferred← citeshttps://doi.org/10.1186/s42400-019-0023-1openalex-snapshot
PathMarker: protecting web contents against inside crawlers
inferred← citeshttps://doi.org/10.12691/ajss-3-2-1openalex-snapshot
A Comparative Analysis of Browsing Behavior of Human Visitors and Automatic Software Agents
inferred← citeshttps://doi.org/10.12720/jcm.13.8.473-481openalex-snapshot
Contrasting Web Robot and Human Behaviors with Network Models
inferred← citeshttps://doi.org/10.15439/2014f346openalex-snapshot
Analysis of Aggregated Bot and Human Traffic on E-Commerce Site
inferred← citeshttps://doi.org/10.18178/jacn.2017.5.2.242openalex-snapshot
An Efficient Multi-Threaded Web Crawler Using HashMaps
inferred← citeshttps://doi.org/10.18297/etd/1499openalex-snapshot
Click fraud : how to spot it, how to stop it?
inferred← citeshttps://doi.org/10.22401/jnus.19.2.20openalex-snapshot
Web Pages Retrieval by Using Proposed Focused Crawler
inferred← citeshttps://doi.org/10.3390/su15086768openalex-snapshot
From Web Catalogs to Google: A Retrospective Study of Web Search Engines Sustainable Development
inferred← citeshttps://doi.org/10.3724/sp.j.1087.2010.01782openalex-snapshot
Spider detection based on trap techniques
inferred← citeshttps://doi.org/10.4018/978-1-5225-3870-7.ch012openalex-snapshot
Web Access Patterns of Actual Human Visitors and Web Robots
inferred← citeshttps://doi.org/10.4236/jdaip.2015.31001openalex-snapshot
Agglomerative Approach for Identification and Elimination of Web Robots from Web Server Logs to Extract Knowledge about Actual Visitors
inferred← citeshttps://doi.org/10.48550/arxiv.1309.4009openalex-snapshot
Access Patterns for Robots and Humans in Web Archives
inferred← citeshttps://doi.org/10.5121/ijwest.2013.4201openalex-snapshot
Using Exclusive Web Crawlers to Store Better Results in Search Engines'Database
inferred← citeshttps://doi.org/10.7148/2017-0605openalex-snapshot
Modeling A Session-Based Bots’ Arrival Process At A Web Server
inferred← citeshttps://doi.org/10.7148/2019-0434openalex-snapshot
Improving Clustering Of Web Bot And Human Sessions By Applying Principal Component Analysis
inferred← citeshttps://doi.org/10.7287/peerj.preprints.1386v1openalex-snapshot
Request type prediction for Web robot and Internet of Things traffic
inferred← citeshttps://doi.org/10.9781/ijimai.2017.449openalex-snapshot
Exploring the Relevance of Search Engines: An Overview of Google as a Case Study
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.