On the public citation graph

A Game Theory Approach for Estimating Reliability of Crowdsourced Relevance Assessments

0 signed · 81 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1006/cogp.1998.0710openalex-snapshot
On the Shape of the Probability Weighting Function
inferredcites →https://doi.org/10.1007/3-540-45691-0_34openalex-snapshot
The Philosophy of Information Retrieval Evaluation
inferredcites →https://doi.org/10.1007/978-3-642-17358-5_17openalex-snapshot
Statistical Quality Control for Human-Based Electronic Services
inferredcites →https://doi.org/10.1007/978-3-642-20161-5_16openalex-snapshot
Design and Implementation of Relevance Assessments Using Crowdsourcing
inferredcites →https://doi.org/10.1007/978-3-642-20161-5_17openalex-snapshot
In Search of Quality in Crowdsourcing for Search Engine Evaluation
inferredcites →https://doi.org/10.1007/s10791-012-9204-1openalex-snapshot
Implementing crowdsourcing-based relevance experimentation: an industrial perspective
inferredcites →https://doi.org/10.1007/s10791-012-9205-0openalex-snapshot
An analysis of human factors and label accuracy in crowdsourcing relevance judgments
inferredcites →https://doi.org/10.1007/s10791-017-9301-2openalex-snapshot
Validating simulated interaction for retrieval evaluation
inferredcites →https://doi.org/10.1007/s10796-012-9350-4openalex-snapshot
Evaluation on crowdsourcing research: Current status and future direction
inferredcites →https://doi.org/10.1016/j.cogdev.2009.11.003openalex-snapshot
Adolescents’ heightened risk-seeking in a probabilistic gambling task
inferredcites →https://doi.org/10.1016/j.ipm.2012.01.004openalex-snapshot
Using crowdsourcing for TREC relevance assessment
inferredcites →https://doi.org/10.1017/cbo9780511609220.014openalex-snapshot
Prospect theory: An analysis of decision under risk
inferredcites →https://doi.org/10.1017/cbo9780511615412.010openalex-snapshot
The origins and development of the logit model
inferredcites →https://doi.org/10.1037//0882-7974.12.4.555openalex-snapshot
Sequential and coordinative complexity in time-accuracy functions for mental arithmetic.
inferredcites →https://doi.org/10.1080/14459795.2017.1284250openalex-snapshot
Use of online crowdsourcing platforms for gambling research
inferredcites →https://doi.org/10.1108/01443331111104779openalex-snapshot
Reconfiguring the sociology of the crowd: exploring crowdsourcing
inferredcites →https://doi.org/10.1109/icws.2019.00072openalex-snapshot
Promoting Higher Revenues for Both Crowdsourcer and Crowds in Crowdsourcing via Contest
inferredcites →https://doi.org/10.1109/taffc.2017.2678472openalex-snapshot
Probabilistic Multigraph Modeling for Improving the Quality of Crowdsourced Affective Data
inferredcites →https://doi.org/10.1109/tpami.2018.2860987openalex-snapshot
Max-Margin Majority Voting for Learning from Crowds
inferredcites →https://doi.org/10.1111/desc.12024openalex-snapshot
Speed isn't everything: complex processing speed measures mask individual differences and developmental changes in executive control
inferredcites →https://doi.org/10.1142/9789814417358_0006openalex-snapshot
Prospect Theory: An Analysis of Decision Under Risk
inferredcites →https://doi.org/10.1145/1378704.1378719openalex-snapshot
Designing games with a purpose
inferredcites →https://doi.org/10.1145/1401890.1401965openalex-snapshot
Get another label? improving data quality and data mining using multiple, noisy labelers
inferredcites →https://doi.org/10.1145/1480506.1480508openalex-snapshot
Crowdsourcing for relevance evaluation
inferredcites →https://doi.org/10.1145/1480506.1480517openalex-snapshot
Report on the SIGIR 2008 workshop on focused retrieval
inferredcites →https://doi.org/10.1145/1600150.1600175openalex-snapshot
Financial incentives and the "performance of crowds"
inferredcites →https://doi.org/10.1145/1670564.1670567openalex-snapshot
Report on the SIGIR 2009 workshop on the future of IR evaluation
inferredcites →https://doi.org/10.1145/1753846.1753873openalex-snapshot
Who are the crowdworkers?
inferredcites →https://doi.org/10.1145/1807342.1807376openalex-snapshot
The labor economics of paid crowdsourcing
inferredcites →https://doi.org/10.1145/1809400.1809422openalex-snapshot
Financial incentives and the "performance of crowds"
inferredcites →https://doi.org/10.1145/1835449.1835540openalex-snapshot
The effect of assessor error on IR system evaluation
inferredcites →https://doi.org/10.1145/1837885.1837906openalex-snapshot
Quality management on Amazon Mechanical Turk
inferredcites →https://doi.org/10.1145/1869086.1869094openalex-snapshot
Analyzing the Amazon Mechanical Turk marketplace
inferredcites →https://doi.org/10.1145/1958824.1958865openalex-snapshot
Designing incentives for inexpert human raters
inferredcites →https://doi.org/10.1145/2009916.2009947openalex-snapshot
Crowdsourcing for book search evaluation
inferredcites →https://doi.org/10.1145/2009916.2010082openalex-snapshot
The effects of choice in routing relevance judgments
inferredcites →https://doi.org/10.1145/2009916.2010134openalex-snapshot
Measuring assessor accuracy
inferredcites →https://doi.org/10.1145/2047196.2047201openalex-snapshot
Crowds in two seconds
inferredcites →https://doi.org/10.1145/2063576.2063860openalex-snapshot
Worker types and personality traits in crowdsourcing relevance labels
inferredcites →https://doi.org/10.1145/2348283.2348400openalex-snapshot
Quality through flow and immersion
inferredcites →https://doi.org/10.1145/2396761.2398697openalex-snapshot
The face of quality in crowdsourcing relevance labels
inferredcites →https://doi.org/10.1145/2764468.2764513openalex-snapshot
Behavioral Mechanism Design
inferredcites →https://doi.org/10.1145/2766462.2767760openalex-snapshot
The Benefits of Magnitude Estimation Relevance Assessments for Information Retrieval Evaluation
inferredcites →https://doi.org/10.1145/2873063openalex-snapshot
A Game-Theory Approach for Effective Crowdsource-Based Relevance Assessment
inferredcites →https://doi.org/10.1145/2911451.2914756openalex-snapshot
Identifying Careless Workers in Crowdsourcing Platforms
inferredcites →https://doi.org/10.1145/2960403openalex-snapshot
Mathematical foundations for social computing
inferredcites →https://doi.org/10.1145/3002172openalex-snapshot
On Crowdsourcing Relevance Magnitudes for Information Retrieval Evaluation
inferredcites →https://doi.org/10.1145/3121050.3121060openalex-snapshot
Considering Assessor Agreement in IR Evaluation
inferredcites →https://doi.org/10.1145/3209978.3210052openalex-snapshot
On Fine-Grained Relevance Scales
inferredcites →https://doi.org/10.1145/3336191.3371857openalex-snapshot
Crowd Worker Strategies in Relevance Judgment Tasks
inferredcites →https://doi.org/10.1145/3357384.3357988openalex-snapshot
On Transforming Relevance Scales
inferredcites →https://doi.org/10.1257/aer.101.5.1912openalex-snapshot
New York City Cab Drivers' Labor Supply Revisited: Reference-Dependent Preferences with Rational-Expectations Targets for Hours and Income
inferredcites →https://doi.org/10.1287/mnsc.1040.0270openalex-snapshot
Games with Incomplete Information Played by “Bayesian” Players, I–III: Part I. The Basic Model
inferredcites →https://doi.org/10.1609/hcomp.v4i1.13284openalex-snapshot
Crowdsourcing Relevance Assessments: The Unexpected Benefits of Limiting the Time to Judge
inferredcites →https://doi.org/10.2307/1914185openalex-snapshot
Prospect Theory: An Analysis of Decision under Risk
inferredcites →https://doi.org/10.3115/1613715.1613751openalex-snapshot
Cheap and fast---but is it good?
inferredcites →https://doi.org/10.3386/w18621openalex-snapshot
Thirty Years of Prospect Theory in Economics: A Review and Assessment
inferredcites →https://doi.org/10.3758/s13428-011-0124-6openalex-snapshot
Conducting behavioral research on Amazon’s Mechanical Turk

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1007/978-3-032-31930-2_1openalex-snapshot
Reliability-Aware Citizen Science for Environmental Machine Learning
inferred← citeshttps://doi.org/10.1145/3539618.3591685openalex-snapshot
Extending Label Aggregation Models with a Gaussian Process to Denoise Crowdsourcing Labels
inferred← citeshttps://doi.org/10.1145/3641023openalex-snapshot
The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and Guidelines
inferred← citeshttps://doi.org/10.1145/3674127openalex-snapshot
Information Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3674128openalex-snapshot
Preface
inferred← citeshttps://doi.org/10.1145/3674127.3674129openalex-snapshot
Introduction
inferred← citeshttps://doi.org/10.1145/3674127.3674130openalex-snapshot
Neural Information Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3674131openalex-snapshot
Recommender Systems
inferred← citeshttps://doi.org/10.1145/3674127.3674132openalex-snapshot
Evaluation of IR Systems
inferred← citeshttps://doi.org/10.1145/3674127.3674133openalex-snapshot
Query-driven Search Functionality
inferred← citeshttps://doi.org/10.1145/3674127.3674134openalex-snapshot
Knowledge Graphs and Search
inferred← citeshttps://doi.org/10.1145/3674127.3674135openalex-snapshot
Conversational Search
inferred← citeshttps://doi.org/10.1145/3674127.3674136openalex-snapshot
Cross-language Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3674137openalex-snapshot
Temporal Extraction and Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3674138openalex-snapshot
Bias in Retrieval Systems
inferred← citeshttps://doi.org/10.1145/3674127.3674139openalex-snapshot
Privacy in Information Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3674140openalex-snapshot
eCommerce Search and Discovery
inferred← citeshttps://doi.org/10.1145/3674127.3674141openalex-snapshot
Professional Search
inferred← citeshttps://doi.org/10.1145/3674127.3674142openalex-snapshot
Searching Personal Collections
inferred← citeshttps://doi.org/10.1145/3674127.3702959openalex-snapshot
Audio-based Music Retrieval
inferred← citeshttps://doi.org/10.1145/3674127.3702960openalex-snapshot
IR in Biomedicine
inferred← citeshttps://doi.org/10.1145/3674127.3702961openalex-snapshot
Bibliography
inferred← citeshttps://doi.org/10.1145/3674127.3702962openalex-snapshot
Authors’ Biography/Index
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.