On the public citation graph

Quality Metrics in Recommender Systems: Do We Calculate Metrics Consistently?

0 signed · 102 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/s10791-020-09371-3openalex-snapshot
Offline evaluation options for recommender systems
inferredcites →https://doi.org/10.1016/s0031-3203(96)00142-2openalex-snapshot
The use of the area under the ROC curve in the evaluation of machine learning algorithms
inferredcites →https://doi.org/10.1109/icdm.2011.134openalex-snapshot
SLIM: Sparse Linear Methods for Top-N Recommender Systems
inferredcites →https://doi.org/10.1145/2556195.2556259openalex-snapshot
Personalized entity recommendation
inferredcites →https://doi.org/10.1145/2783258.2783273openalex-snapshot
Collaborative Deep Learning for Recommender Systems
inferredcites →https://doi.org/10.1145/2806416.2806504openalex-snapshot
TriRank
inferredcites →https://doi.org/10.1145/3038912.3052569openalex-snapshot
Neural Collaborative Filtering
inferredcites →https://doi.org/10.1145/3097983.3098077openalex-snapshot
Collaborative Variational Autoencoder for Recommender Systems
inferredcites →https://doi.org/10.1145/3159652.3159681openalex-snapshot
OpenRec
inferredcites →https://doi.org/10.1145/3159652.3159687openalex-snapshot
Offline A/B Testing for Recommender Systems
inferredcites →https://doi.org/10.1145/3178876.3186150openalex-snapshot
Variational Autoencoders for Collaborative Filtering
inferredcites →https://doi.org/10.1145/3178876.3186154openalex-snapshot
Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking
inferredcites →https://doi.org/10.1145/3209978.3209991openalex-snapshot
Collaborative Memory Network for Recommendation Systems
inferredcites →https://doi.org/10.1145/3219819.3219965openalex-snapshot
Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model
inferredcites →https://doi.org/10.1145/3240323.3240343openalex-snapshot
Spectral collaborative filtering
inferredcites →https://doi.org/10.1145/3298689openalex-snapshot
Proceedings of the 13th ACM Conference on Recommender Systems
inferredcites →https://doi.org/10.1145/3298689.3347058openalex-snapshot
Are we really making much progress? A worrying analysis of recent neural recommendation approaches
inferredcites →https://doi.org/10.1145/3308558.3313710openalex-snapshot
Embarrassingly Shallow Autoencoders for Sparse Data
inferredcites →https://doi.org/10.1145/3341105openalex-snapshot
Proceedings of the 35th Annual ACM Symposium on Applied Computing
inferredcites →https://doi.org/10.1145/3341105.3375759openalex-snapshot
Debiased offline evaluation of recommender systems
inferredcites →https://doi.org/10.1145/3343413openalex-snapshot
Proceedings of the 2020 Conference on Human Information Interaction and Retrieval
inferredcites →https://doi.org/10.1145/3383313.3411524openalex-snapshot
BETA-Rec: Build, Evaluate and Tune Automated Recommender Systems
inferredcites →https://doi.org/10.1145/3383313.3412259openalex-snapshot
On Target Item Sampling in Offline Recommender System Evaluation
inferredcites →https://doi.org/10.1145/3383313.3412489openalex-snapshot
Are We Evaluating Rigorously? Benchmarking Recommendation for Reproducible Evaluation and Fair Comparison
inferredcites →https://doi.org/10.1145/3383313.3418479openalex-snapshot
Exploring Data Splitting Strategies for the Evaluation of Recommendation Models
inferredcites →https://doi.org/10.1145/3394486.3403226openalex-snapshot
On Sampled Metrics for Item Recommendation
inferredcites →https://doi.org/10.1145/3394486.3403262openalex-snapshot
On Sampling Top-K Recommendation Evaluation
inferredcites →https://doi.org/10.1145/3404835.3463245openalex-snapshot
Elliot: A Comprehensive and Rigorous Framework for Reproducible Recommender Systems Evaluation
inferredcites →https://doi.org/10.1145/3434185openalex-snapshot
A Troubling Analysis of Reproducibility and Progress in Recommender Systems Research
inferredcites →https://doi.org/10.1145/3459637.3482016openalex-snapshot
RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms
inferredcites →https://doi.org/10.1145/3569930openalex-snapshot
A Critical Study on Data Leakage in Recommender System Offline Evaluation
inferredcites →https://doi.org/10.1145/963770.963776openalex-snapshot
Item-based top- N recommendation algorithms
inferredcites →https://doi.org/10.24963/ijcai.2017/447openalex-snapshot
Deep Matrix Factorization Models for Recommender Systems
inferredcites →https://doi.org/10.24963/ijcai.2018/308openalex-snapshot
Outer Product-based Neural Collaborative Filtering
inferredcites →https://doi.org/10.24963/ijcai.2018/462openalex-snapshot
DELF: A Dual-Embedding based Deep Latent Factor Model for Recommendation
inferredcites →https://doi.org/10.24963/ijcai.2018/509openalex-snapshot
CoupledCF: Learning Explicit and Implicit User-item Couplings in Recommendation for Deep Collaborative Filtering
inferredcites →https://doi.org/10.48550/arxiv.1905.01395openalex-snapshot
On the Difficulty of Evaluating Baselines: A Study on Recommender Systems
inferredcites →https://doi.org/10.48550/arxiv.1909.12799openalex-snapshot
How robust is MovieLens? A dataset analysis for recommender systems
inferredcites →https://doi.org/10.48550/arxiv.2010.12470openalex-snapshot
A Practical Guide of Off-Policy Evaluation for Bandit Problems

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.4571365openalex-extracted
inferred← citeshttps://doi.org/10.1007/978-3-031-22192-7_3openalex-snapshot
Reusable Self-attention-Based Recommender System for Fashion
inferred← citeshttps://doi.org/10.1007/978-3-031-35507-3_53openalex-snapshot
Predicting Points of Interest with Social Relations and Geographical-Temporal Information
inferred← citeshttps://doi.org/10.1007/978-3-031-66428-1_46openalex-snapshot
SenAgriPreci: Improving Precision Agricultural Yields Through a Crop Recommender System
inferred← citeshttps://doi.org/10.1007/978-3-032-14099-9_23openalex-snapshot
HERAG: A Holistic Approach for Evaluating Organizational RAG Applications
inferred← citeshttps://doi.org/10.1007/978-3-032-21321-1_52openalex-snapshot
FoodNexus: Massive Food Knowledge for Recommender Systems
inferred← citeshttps://doi.org/10.1007/978-3-032-39892-5_25openalex-snapshot
Memory-Aware Multi-agent Architecture with LLM-Based Orchestration for Conversational Recommendation
inferred← citeshttps://doi.org/10.1007/978-981-95-7394-3_7openalex-snapshot
Recommending the Right Recommender System Software: A Practical Guide
inferred← citeshttps://doi.org/10.1007/978-981-96-4291-5_15openalex-snapshot
RAPID: Retrieval-Augmented Parallel Inference Drafting for Text-Based Video Event Retrieval
inferred← citeshttps://doi.org/10.1007/s44248-026-00106-1openalex-snapshot
Geospatial-based location-aware recommendation of banking services in the world of big data
inferred← citeshttps://doi.org/10.1016/j.aei.2025.103317openalex-snapshot
Reliable recommendations for CCTV sewer inspections through multi-label image classification
inferred← citeshttps://doi.org/10.1016/j.infsof.2024.107603openalex-snapshot
Dynamic robustness evaluation for automated model selection in operation
inferred← citeshttps://doi.org/10.1016/j.infsof.2025.107940openalex-snapshot
LocVul: Line-level vulnerability localization based on a Sequence-to-Sequence approach
inferred← citeshttps://doi.org/10.1038/s41598-025-86416-xopenalex-snapshot
Dual intent view contrastive learning for knowledge aware recommender systems
inferred← citeshttps://doi.org/10.1038/s41746-023-00879-8openalex-snapshot
The shaky foundations of large language models and foundation models for electronic health records
inferred← citeshttps://doi.org/10.1080/20421338.2025.2585128openalex-snapshot
GeoHostel : Location-based recommendation of hostels in the context of higher education through geospatial technology
inferred← citeshttps://doi.org/10.1109/access.2023.3249356openalex-snapshot
Comparison of Real-Time and Batch Job Recommendations
inferred← citeshttps://doi.org/10.1109/bdai66031.2025.11325185openalex-snapshot
MTGRec: A Novel Sequential Recommendation based on Multi-modal Temporal Graph
inferred← citeshttps://doi.org/10.1109/codit70676.2026.11631067openalex-snapshot
Exploration on Demand: From Algorithmic Control to User Empowerment
inferred← citeshttps://doi.org/10.1109/cvprw63382.2024.00427openalex-snapshot
Federated Hyperparameter Optimization through Reward-Based Strategies: Challenges and Insights
inferred← citeshttps://doi.org/10.1109/iccv51070.2023.01831openalex-snapshot
Efficient Discovery and Effective Evaluation of Visual Perceptual Similarity: A Benchmark and Beyond
inferred← citeshttps://doi.org/10.1109/icdm59182.2024.00074openalex-snapshot
An Explainable Recommender System by Integrating Graph Neural Networks and User Reviews
inferred← citeshttps://doi.org/10.1109/icmlt69916.2026.11688873openalex-snapshot
Cause-Aware Collaborative Ranking: Resolving Rating-Review Dissonance Through LLM-Based Attribution of External Factors
inferred← citeshttps://doi.org/10.1109/icodsa67155.2025.11157454openalex-snapshot
Word2Vec-Based Facial Serum Recommender System
inferred← citeshttps://doi.org/10.1109/imitec60221.2024.10851124openalex-snapshot
A Review of Evaluation Metrics Algorithmic Used in Scholarly Research Recommender System
inferred← citeshttps://doi.org/10.1109/mipro70003.2026.11591622openalex-snapshot
Evaluation of algorithms for data-driven recommendation systems
inferred← citeshttps://doi.org/10.1145/3523227.3547380openalex-snapshot
Translating the Public Service Media Remit into Metrics and Algorithms
inferred← citeshttps://doi.org/10.1145/3539618.3591931openalex-snapshot
Take a Fresh Look at Recommender Systems from an Evaluation Standpoint
inferred← citeshttps://doi.org/10.1145/3556536openalex-snapshot
Evaluating Recommender Systems: Survey and Framework
inferred← citeshttps://doi.org/10.1145/3583780.3614980openalex-snapshot
Multi-Representation Variational Autoencoder via Iterative Latent Attention and Implicit Differentiation
inferred← citeshttps://doi.org/10.1145/3604915.3609495openalex-snapshot
On Challenges of Evaluating Recommender Systems in an Offline Setting
inferred← citeshttps://doi.org/10.1145/3629171openalex-snapshot
On Item-Sampling Evaluation for Recommender System
inferred← citeshttps://doi.org/10.1145/3630106.3658926openalex-snapshot
Diversity of What? On the Different Conceptualizations of Diversity in Recommender Systems
inferred← citeshttps://doi.org/10.1145/3637528.3671655openalex-snapshot
From Variability to Stability: Advancing RecSys Benchmarking Practices
inferred← citeshttps://doi.org/10.1145/3640457.3688195openalex-snapshot
Does It Look Sequential? An Analysis of Datasets for Evaluation of Sequential Recommendations
inferred← citeshttps://doi.org/10.1145/3640457.3691701openalex-snapshot
RePlay: a Recommendation Framework for Experimentation and Production Use
inferred← citeshttps://doi.org/10.1145/3640820openalex-snapshot
Group Validation in Recommender Systems: Framework for Multi-layer Performance Evaluation
inferred← citeshttps://doi.org/10.1145/3701551.3703558openalex-snapshot
VARIUM: Variational Autoencoder for Multi-Interest Representation with Inter-User Memory
inferred← citeshttps://doi.org/10.1145/3705328.3748034openalex-snapshot
Not One News Recommender To Fit Them All: How Different Recommender Strategies Serve Various User Segments
inferred← citeshttps://doi.org/10.1145/3705328.3748160openalex-snapshot
Impacts of Mainstream-Driven Algorithms on Recommendations for Children Across Domains: A Reproducibility Study
inferred← citeshttps://doi.org/10.1145/3706598.3714045openalex-snapshot
EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
inferred← citeshttps://doi.org/10.1145/3710940openalex-snapshot
Bridging Expertise: Doctor Recommendations for Cross-Disciplinary Collaborations in Online Medical Consultations
inferred← citeshttps://doi.org/10.1145/3726302.3730199openalex-snapshot
From Monolith to Mosaic: Uncovering Behavioral Differences for Choice Models in Recommender Systems Simulations
inferred← citeshttps://doi.org/10.1145/3728373openalex-snapshot
Recall, Robustness, and Lexicographic Evaluation
inferred← citeshttps://doi.org/10.1145/3744916.3787798openalex-snapshot
Multi-Location Software Model Completion
inferred← citeshttps://doi.org/10.1145/3770855.3818176openalex-snapshot
Text-Guided Visual Representation Learning for Robust Multimodal E-Commerce Recommendation
inferred← citeshttps://doi.org/10.1145/3773078.3831854openalex-snapshot
Continuous Automated Reproducibility
inferred← citeshttps://doi.org/10.1145/3778173openalex-snapshot
Welcome to the Metrics Jungle: Organizational Stakeholder Perspectives on Evaluation of News Recommender Systems in Industry
inferred← citeshttps://doi.org/10.1145/3787969openalex-snapshot
An Analysis of Sequential Patterns in Datasets for Evaluation of Sequential Recommendations
inferred← citeshttps://doi.org/10.1145/3800587openalex-snapshot
Improving Methodological Standards in Recommender Systems Offline Evaluation
inferred← citeshttps://doi.org/10.1145/3808222openalex-snapshot
Adopting State-of-the-Art Pretrained Audio Representations for Music Recommender Systems
inferred← citeshttps://doi.org/10.1145/3821220openalex-snapshot
VARIUM+: Semantic Expert-Structured Memory-Augmented Variational Autoencoder for Multi-Interest Recommendation
inferred← citeshttps://doi.org/10.1155/2024/9015012openalex-snapshot
Geo-Insurance: Improving Big Data Challenges in the Context of Insurance Services Using a Geographical Information System (GIS)
inferred← citeshttps://doi.org/10.1186/s43067-026-00354-wopenalex-snapshot
Monitoring and analysing student attentiveness in traditional classrooms through computational intelligence
inferred← citeshttps://doi.org/10.1371/journal.pone.0294643openalex-snapshot
Auxiliary self-supervision to metric learning for music similarity-based retrieval and auto-tagging
inferred← citeshttps://doi.org/10.14569/ijacsa.2023.0140699openalex-snapshot
Exploring the Impact of Hybrid Recommender Systems on Personalized Mental Health Recommendations
inferred← citeshttps://doi.org/10.15439/2022f191openalex-snapshot
Learning edge importance in bipartite graph-based recommendations
inferred← citeshttps://doi.org/10.3390/electronics13153049openalex-snapshot
Job Recommendations: Benchmarking of Collaborative Filtering Methods for Classifieds
inferred← citeshttps://doi.org/10.3390/informatics13090150openalex-snapshot
An Explainable Collaborative Recommendation Framework Using K-Means Clustering and LLM-Based Explanations
inferred← citeshttps://doi.org/10.4018/ijicte.356499openalex-snapshot
CARIA
inferred← citeshttps://doi.org/10.4236/iim.2022.141003openalex-snapshot
Mining Metrics for Enhancing E-Commerce Systems User Experience
inferred← citeshttps://doi.org/10.54074/jicsa.v1i02.22openalex-snapshot
Top-N Recommendation (Implicit Feedback)
inferred← citeshttps://doi.org/10.5772/intechopen.1014253openalex-snapshot
Perspective Chapter: P-Tracer – Improving Disease Surveillance and Monitoring through Geospatial Technology
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.