On the public citation graph

Diagnosing Bias and Instability in LLM Evaluation: A Scalable Pairwise Meta-Evaluator

0 signed · 29 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/s10462-024-10824-0openalex-snapshot
A survey of safety and trustworthiness of large language models through the lens of verification and validation
inferredcites →https://doi.org/10.1007/s44311-025-00019-3openalex-snapshot
On the potential of large language models to solve semantics-aware process mining tasks
inferredcites →https://doi.org/10.1093/biomet/30.1-2.81openalex-snapshot
A NEW MEASURE OF RANK CORRELATION
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.745openalex-snapshot
LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts
inferredcites →https://doi.org/10.18653/v1/2024.emnlp-main.70openalex-snapshot
AgentReview: Exploring Peer Review Dynamics with LLM Agents
inferredcites →https://doi.org/10.18653/v1/2024.findings-acl.104openalex-snapshot
RankMean: Module-Level Importance Score for Merging Fine-tuned LLM Models
inferredcites →https://doi.org/10.18653/v1/2024.findings-acl.112openalex-snapshot
DEBATE: Devil’s Advocate-Based Assessment and Text Evaluation
inferredcites →https://doi.org/10.18653/v1/2025.findings-naacl.218openalex-snapshot
TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement
inferredcites →https://doi.org/10.24963/ijcai.2024/3openalex-snapshot
AutoAgents: A Framework for Automatic Agent Generation
inferredcites →https://doi.org/10.3390/bioengineering11111067openalex-snapshot
Predicting Deep Venous Thrombosis Using Artificial Intelligence: A Clinical Data Approach
inferredcites →https://doi.org/10.3390/jcdd11120396openalex-snapshot
Evaluating Binary Classifiers for Cardiovascular Disease Prediction: Enhancing Early Diagnostic Capabilities
inferredcites →https://doi.org/10.3390/s25092755openalex-snapshot
Non-Intrusive Monitoring and Detection of Mobility Loss in Older Adults Using Binary Sensors
inferredcites →https://doi.org/10.48550/arxiv.2308.07201openalex-snapshot
ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
inferredcites →https://doi.org/10.48550/arxiv.2404.13076openalex-snapshot
Canon Suppression in Corpus-Loaded Assessment: A Two-Assessor Study
inferredcites →https://doi.org/10.52202/075280-0377openalex-snapshot
Reflexion: language agents with verbal reinforcement learning

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1007/978-3-032-29755-6_52openalex-snapshot
How Prompting and Context Granularity Shape LLM-Based Assessment of Academic Writing: A Case Study in Serbian
inferred← citeshttps://doi.org/10.1007/s11219-026-09785-0openalex-snapshot
AI-as-a-Judge for software quality assessment: Consistency, attitude effects, and complexity sensitivity in multi-agent code evaluation
inferred← citeshttps://doi.org/10.1109/acit69831.2026.11699959openalex-snapshot
Measuring Position Bias in LLM-as-a-Judge for Hiring
inferred← citeshttps://doi.org/10.1109/cai68641.2026.11536235openalex-snapshot
A System-Level Taxonomy of Failure Modes in Large Language Model Applications
inferred← citeshttps://doi.org/10.1109/iseee67817.2025.11304842openalex-snapshot
Rubric-Guided Evaluation Framework for Consistent Scoring with Large Language Models
inferred← citeshttps://doi.org/10.3390/app16010217openalex-snapshot
Comparative Evaluation of GPT-4o, GPT-OSS-120B and Llama-3.1-8B-Instruct Language Models in a Reproducible CV-to-JSON Extraction Pipeline
inferred← citeshttps://doi.org/10.3390/computers14100431openalex-snapshot
CourseEvalAI: Rubric-Guided Framework for Transparent and Consistent Evaluation of Large Language Models
inferred← citeshttps://doi.org/10.3390/computers14120530openalex-snapshot
EvalCouncil: A Committee-Based LLM Framework for Reliable and Unbiased Automated Grading
inferred← citeshttps://doi.org/10.3390/computers15010055openalex-snapshot
SteadyEval: Robust LLM Exam Graders via Adversarial Training and Distillation
inferred← citeshttps://doi.org/10.3390/computers15030177openalex-snapshot
ExamQ-Gen: Instructor-in-the-Loop Generation of Self-Contained Exam Questions from Course Materials and Decision-Support Grading
inferred← citeshttps://doi.org/10.3390/computers15070460openalex-snapshot
SafeBoundary-LLM: Measuring Safety Boundary Stability in Local Open-Weight LLMs Through Single-Turn Baselines and Multi-Turn Escalation
inferred← citeshttps://doi.org/10.3390/info16110926openalex-snapshot
PEARL: A Rubric-Driven Multi-Metric Framework for LLM Evaluation
inferred← citeshttps://doi.org/10.3390/info17030297openalex-snapshot
EvalHack: Answer-Side Prompt Injection for Probing LLM Exam-Grading Panel Stability
inferred← citeshttps://doi.org/10.3390/make8080252openalex-snapshot
GradeDrift-LLM: Measuring Student-History-Induced Score Drift in LLM-Based Automated Grading
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.