On the public citation graph

Crowdsourcing Ground Truth for Medical Relation Extraction

0 signed · 80 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/pds.4850openalex-snapshot
Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program.
inferredcites →https://doi.org/10.1007/978-3-319-11915-1_3openalex-snapshot
Conference v2.0: An Uncertain Version of the OAEI Conference Benchmark
inferredcites →https://doi.org/10.1007/978-3-319-11915-1_31openalex-snapshot
CrowdTruth: Machine-Human Computation Framework for Harnessing Disagreement in Gathering Annotated Data
inferredcites →https://doi.org/10.1007/978-3-642-31040-9_8openalex-snapshot
Validating Candidate Gene-Mutation Relations in MEDLINE Abstracts via Crowdsourcing
inferredcites →https://doi.org/10.1007/bf02295996openalex-snapshot
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
inferredcites →https://doi.org/10.1007/s00778-013-0328-8openalex-snapshot
Hybrid entity clustering using crowds and data
inferredcites →https://doi.org/10.1093/nar/gkh061openalex-snapshot
The Unified Medical Language System (UMLS): integrating biomedical terminology
inferredcites →https://doi.org/10.1109/icde.2014.6816717openalex-snapshot
Combining information extraction and human computing for crowdsourced knowledge acquisition
inferredcites →https://doi.org/10.1136/amiajnl-2011-000465openalex-snapshot
Overcoming barriers to NLP for clinical text: the role of shared tasks and the need for additional creative solutions
inferredcites →https://doi.org/10.1145/2470654.2466265openalex-snapshot
Cascade
inferredcites →https://doi.org/10.1162/coli_a_00074openalex-snapshot
What Determines Inter-Coder Agreement in Manual Annotations? A Meta-Analytic Investigation
inferredcites →https://doi.org/10.13016/m21j97c2popenalex-snapshot
Annotating named entities in Twitter data with crowdsourcing
inferredcites →https://doi.org/10.15346/hc.v1i1openalex-snapshot
inferredcites →https://doi.org/10.15346/hc.v1i1.3openalex-snapshot
The Three Sides of CrowdTruth
inferredcites →https://doi.org/10.2196/jmir.2426openalex-snapshot
Web 2.0-Based Crowdsourcing for High-Quality Gold Standard Development in Clinical Natural Language Processing
inferredcites →https://doi.org/10.3115/1613715openalex-snapshot
Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08
inferredcites →https://doi.org/10.3115/1613715.1613751openalex-snapshot
Cheap and fast---but is it good?
inferredcites →https://doi.org/10.3115/1690219.1690287openalex-snapshot
Distant supervision for relation extraction without labeled data
inferredcites →https://doi.org/10.3115/v1/p14-1078openalex-snapshot
Medical Relation Extraction with Manifold Models
inferredcites →https://doi.org/10.3115/v1/p14-2062openalex-snapshot
Experiments with crowdsourced re-annotation of a POS tagging data set
inferredcites →https://doi.org/10.3115/v1/p14-2083openalex-snapshot
Linguistically debatable or just plain wrong?
inferredcites →https://doi.org/10.48550/arxiv.1505.06256openalex-snapshot
Exposing ambiguities in a relation-extraction gold standard with crowdsourcing
inferredcites →https://doi.org/10.52202/085713openalex-snapshot
Advances in Neural Information Processing Systems 19
inferredcites →https://doi.org/10.6084/m9.figshare.679997openalex-snapshot
Crowd Truth: Harnessing disagreement in crowdsourcing a relation extraction gold standard

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1002/widm.1288openalex-snapshot
Machine learning from crowds: A systematic review of its applications
inferred← citeshttps://doi.org/10.1007/978-3-030-01364-6_12openalex-snapshot
Crowd Disagreement About Medical Images Is Informative
inferred← citeshttps://doi.org/10.1007/978-3-031-93612-8_1openalex-snapshot
Embracing Disagreement in Text Classification During Training and Prediction
inferred← citeshttps://doi.org/10.1007/s10916-022-01879-zopenalex-snapshot
Crowdsourcing Operational and Design Flaws of Diabetes Mobile Apps
inferred← citeshttps://doi.org/10.1007/s11280-019-00736-3openalex-snapshot
A crowd-efficient learning approach for NER based on online encyclopedia
inferred← citeshttps://doi.org/10.1007/s41019-019-00098-wopenalex-snapshot
Towards Automatic Mathematical Exercise Solving
inferred← citeshttps://doi.org/10.1016/j.artmed.2019.06.002openalex-snapshot
Distant supervision for treatment relation extraction by leveraging MeSH subheadings
inferred← citeshttps://doi.org/10.1016/j.artmed.2023.102586openalex-snapshot
FooDis: A food-disease relation mining pipeline
inferred← citeshttps://doi.org/10.1016/j.cmpb.2025.108773openalex-snapshot
GDReCo: Fine-grained gene-disease relationship extraction corpus
inferred← citeshttps://doi.org/10.1016/j.jbi.2021.103902openalex-snapshot
Relation extraction from DailyMed structured product labels by optimally combining crowd, experts and machines
inferred← citeshttps://doi.org/10.1016/j.jbi.2023.104460openalex-snapshot
GENA: A knowledge graph for nutrition and mental health
inferred← citeshttps://doi.org/10.1016/j.knosys.2024.112646openalex-snapshot
Personalised soft prompt tuning in pre-trained language models: Bridging multitask transfer learning and crowdsourcing learning
inferred← citeshttps://doi.org/10.1056/aioa2400181openalex-snapshot
Retrieval-Augmented Generation–Enabled GPT-4 for Clinical Trial Screening
inferred← citeshttps://doi.org/10.1097/scs.0000000000012195openalex-snapshot
Assessing the Quality of AI-Generated Responses to Botulinum Toxin Applications in Bruxism Therapy
inferred← citeshttps://doi.org/10.1097/scs.0000000000012363openalex-snapshot
Clinical Accuracy of AI Language Models in Providing Impacted Teeth Information: A Comparative Evaluation
inferred← citeshttps://doi.org/10.1109/cdc42340.2020.9304064openalex-snapshot
Variational Bayesian Inference for Crowdsourcing Predictions
inferred← citeshttps://doi.org/10.1109/iccv.2019.00437openalex-snapshot
Why Does a Visual Question Have Different Answers?
inferred← citeshttps://doi.org/10.1109/icetci62771.2024.10704103openalex-snapshot
Early Detection of Black Fungus Using Deep Learning Models for Efficient Medical Diagnosis
inferred← citeshttps://doi.org/10.1109/ichi57859.2023.00021openalex-snapshot
End-to-End n-ary Relation Extraction for Combination Drug Therapies
inferred← citeshttps://doi.org/10.1109/tmi.2022.3228316openalex-snapshot
Data Discernment for Affordable Training in Medical Image Segmentation
inferred← citeshttps://doi.org/10.1111/opo.13207openalex-snapshot
Assessing the utility of ChatGPT as an artificial intelligence‐based large language model for information to answer questions on myopia
inferred← citeshttps://doi.org/10.1145/3269206.3271779openalex-snapshot
Studying Topical Relevance with Evidence-based Crowdsourcing
inferred← citeshttps://doi.org/10.1145/3274423openalex-snapshot
Resolvable vs. Irresolvable Disagreement
inferred← citeshttps://doi.org/10.1145/3290605.3300356openalex-snapshot
How Data Science Workers Work with Data
inferred← citeshttps://doi.org/10.1145/3308558.3320096openalex-snapshot
Crowdsourcing Inclusivity: Dealing with Diversity of Opinions, Perspectives and Ambiguity in Annotated Data
inferred← citeshttps://doi.org/10.1145/3313831.3376290openalex-snapshot
Expert Discussions Improve Comprehension of Difficult Cases in Medical Image Assessment
inferred← citeshttps://doi.org/10.1145/3357384.3357934openalex-snapshot
MedTruth
inferred← citeshttps://doi.org/10.1145/3359164openalex-snapshot
Efficient Elicitation Approaches to Estimate Collective Crowd Answers
inferred← citeshttps://doi.org/10.1145/3359178openalex-snapshot
Understanding Expert Disagreement in Medical Data Analysis through Structured Adjudication
inferred← citeshttps://doi.org/10.1145/3394486.3403167openalex-snapshot
Semi-Supervised Multi-Label Learning from Crowds via Deep Sequential Generative Model
inferred← citeshttps://doi.org/10.1145/3411764.3445423openalex-snapshot
The Disagreement Deconvolution: Bringing Machine Learning Performance Metrics In Line With Reality
inferred← citeshttps://doi.org/10.1145/3476076openalex-snapshot
Goldilocks: Consistent Crowdsourced Scalar Annotations with Relative Uncertainty
inferred← citeshttps://doi.org/10.1145/3491101.3519614openalex-snapshot
Debiased Label Aggregation for Subjective Crowdsourcing Tasks
inferred← citeshttps://doi.org/10.1145/3511808.3557196openalex-snapshot
POTATO: exPlainable infOrmation exTrAcTion framewOrk
inferred← citeshttps://doi.org/10.1145/3512935openalex-snapshot
Eliciting Confidence for Improving Crowdsourced Audio Annotations
inferred← citeshttps://doi.org/10.1145/3610074openalex-snapshot
Judgment Sieve: Reducing Uncertainty in Group Judgments through Interventions Targeting Ambiguity versus Disagreement
inferred← citeshttps://doi.org/10.1145/3610183openalex-snapshot
Crowdsourcing Subjective Annotations Using Pairwise Comparisons Reduces Bias and Error Compared to the Majority-vote Method
inferred← citeshttps://doi.org/10.1145/3715275.3732070openalex-snapshot
Perils of Label Indeterminacy: A Case Study on Prediction of Neurological Recovery After Cardiac Arrest
inferred← citeshttps://doi.org/10.1145/3812206openalex-snapshot
Improving Reproducibility in Crowdsourced Labeling Across Platforms
inferred← citeshttps://doi.org/10.1186/s12903-025-06983-3openalex-snapshot
What artificial intelligence (AI) can tell us about Nasoalveolar Molding (NAM)?
inferred← citeshttps://doi.org/10.1590/2177-6709.28.5.e2323183.oaropenalex-snapshot
Assessing the reliability of ChatGPT: a content analysis of self-generated and self-answered questions on clear aligners, TADs and digital imaging
inferred← citeshttps://doi.org/10.1609/aaai.v32i1.11507openalex-snapshot
Adversarial Learning for Chinese NER From Crowd Annotations
inferred← citeshttps://doi.org/10.1609/hcomp.v6i1.13330openalex-snapshot
Capturing Ambiguity in Crowdsourcing Frame Disambiguation
inferred← citeshttps://doi.org/10.18653/v1/2020.coling-main.442openalex-snapshot
Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods
inferred← citeshttps://doi.org/10.18653/v1/2020.nlpcss-1.13openalex-snapshot
Uncertainty over Uncertainty: Investigating the Assumptions, Annotations, and Text Measurements of Economic Policy Uncertainty
inferred← citeshttps://doi.org/10.18653/v1/2021.bionlp-1.4openalex-snapshot
SAFFRON: tranSfer leArning For Food-disease RelatiOn extractioN
inferred← citeshttps://doi.org/10.18653/v1/2021.findings-acl.371openalex-snapshot
Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence
inferred← citeshttps://doi.org/10.18653/v1/n19-1150openalex-snapshot
Predicting Annotation Difficulty to Improve Task Routing and Model Performance for Biomedical Information Extraction
inferred← citeshttps://doi.org/10.3233/shti220156openalex-snapshot
Review of the Performance Metrics for Natural Language Systems for Clinical Trials Matching
inferred← citeshttps://doi.org/10.3233/sw-200415openalex-snapshot
Empirical methodology for crowdsourcing ground truth
inferred← citeshttps://doi.org/10.3390/atmos14040651openalex-snapshot
Machine Learning-Aided Remote Monitoring of NOx Emissions from Heavy-Duty Diesel Vehicles Based on OBD Data Streams
inferred← citeshttps://doi.org/10.4103/sej.sej_107_24openalex-snapshot
Evaluating generative pretraining transformer reliability in addressing dental trauma: A cross-sectional observational study on avulsion and intrusion
inferred← citeshttps://doi.org/10.48550/arxiv.1905.07791openalex-snapshot
Predicting Annotation Difficulty to Improve Task Routing and Model Performance for Biomedical Information Extraction
inferred← citeshttps://doi.org/10.48550/arxiv.1911.01875openalex-snapshot
Metrology for AI: From Benchmarks to Instruments
inferred← citeshttps://doi.org/10.48550/arxiv.2004.03473openalex-snapshot
Learning from Imperfect Annotations
inferred← citeshttps://doi.org/10.5220/0010982000003123openalex-snapshot
Local Explanations for Clinical Search Engine Results
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.