On the public citation graph

A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned, and Perspectives

https://doi.org/10.1145/3561970

0 signed · 137 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.

Claim with ORCID

Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.

See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1007/978-3-030-58539-6_33openalex-snapshot

A Unifying Mutual Information View of Metric Learning: Cross-Entropy vs. Pairwise Losses

inferredcites →https://doi.org/10.1007/978-3-030-58595-2_41openalex-snapshot

A Metric Learning Reality Check

inferredcites →https://doi.org/10.1109/cvpr42600.2020.00975openalex-snapshot

Momentum Contrast for Unsupervised Visual Representation Learning

inferredcites →https://doi.org/10.1109/iccv.2019.00986openalex-snapshot

Transferable Contrastive Network for Generalized Zero-Shot Learning

inferredcites →https://doi.org/10.1145/3447548.3467265openalex-snapshot

Leveraging Latent Features for Local Explanations

inferredcites →https://doi.org/10.1145/3474085.3475637openalex-snapshot

Dense Contrastive Visual-Linguistic Pretraining

inferredcites →https://doi.org/10.1162/tacl_a_00259openalex-snapshot

GILE: A Generalized Input-Label Embedding for Text Classification

inferredcites →https://doi.org/10.1609/aaai.v36i10.21318openalex-snapshot

Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-training

inferredcites →https://doi.org/10.18653/v1/2020.acl-main.194openalex-snapshot

MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification

inferredcites →https://doi.org/10.18653/v1/2020.acl-main.207openalex-snapshot

SPECTER: Document-level Representation Learning using Citation-informed Transformers

inferredcites →https://doi.org/10.18653/v1/2020.acl-main.439openalex-snapshot

Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models

inferredcites →https://doi.org/10.18653/v1/2020.acl-main.586openalex-snapshot

Words Aren’t Enough, Their Order Matters: On the Robustness of Grounding Visual Referring Expressions

inferredcites →https://doi.org/10.18653/v1/2020.acl-main.671openalex-snapshot

Contrastive Self-Supervised Learning for Commonsense Reasoning

inferredcites →https://doi.org/10.18653/v1/2020.coling-main.213openalex-snapshot

Learning with Contrastive Examples for Data-to-Text Generation

inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.20openalex-snapshot

Pre-Training Transformers as Energy-Based Cloze Models

inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.36openalex-snapshot

Contrastive Distillation on Intermediate Representations for Language Model Compression

inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.403openalex-snapshot

On Losses for Modern Language Models

inferredcites →https://doi.org/10.18653/v1/2021.acl-long.72openalex-snapshot

DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

inferredcites →https://doi.org/10.18653/v1/2021.eacl-srw.11openalex-snapshot

Contrasting distinct structured views to learn sentence embeddings

inferredcites →https://doi.org/10.18653/v1/2021.findings-acl.336openalex-snapshot

Explaining NLP Models via Minimal Contrastive Editing (MiCE)

inferredcites →https://doi.org/10.18653/v1/2021.naacl-main.280openalex-snapshot

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

inferredcites →https://doi.org/10.18653/v1/2022.emnlp-main.802openalex-snapshot

Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings

inferredcites →https://doi.org/10.18653/v1/d18-1405openalex-snapshot

Noise Contrastive Estimation and Negative Sampling for Conditional Models: Consistency and Statistical Efficiency

inferredcites →https://doi.org/10.18653/v1/d19-1301openalex-snapshot

Contrastive Attention Mechanism for Abstractive Sentence Summarization

inferredcites →https://doi.org/10.18653/v1/w19-5354openalex-snapshot

The MuCoW Test Suite at WMT 2019: Automatically Harvested Multilingual Contrastive Word Sense Disambiguation Test Sets for Machine Translation

inferredcites →https://doi.org/10.3390/cmsf2022003010openalex-snapshot

Long-Tail Zero and Few-Shot Learning via Contrastive Pretraining on and for Small Data

inferredcites →https://doi.org/10.36227/techrxiv.12308378.v1openalex-snapshot

CERT: Contrastive Self-supervised Learning for Language Understanding

inferredcites →https://doi.org/10.4230/lipics.cp.2025.31openalex-snapshot

HISTORIAE, History of Socio-Cultural Transformation as Linguistic Data Science. A Humanities Use Case

inferredcites →https://doi.org/10.48550/arxiv.1301.3781openalex-snapshot

Efficient Estimation of Word Representations in Vector Space

inferredcites →https://doi.org/10.48550/arxiv.1310.4546openalex-snapshot

Distributed Representations of Words and Phrases and their Compositionality

inferredcites →https://doi.org/10.48550/arxiv.1803.02893openalex-snapshot

An efficient framework for learning sentence representations

inferredcites →https://doi.org/10.48550/arxiv.1808.06670openalex-snapshot

Learning deep representations by mutual information estimation and maximization

inferredcites →https://doi.org/10.48550/arxiv.1910.10683openalex-snapshot

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

inferredcites →https://doi.org/10.48550/arxiv.2006.03659openalex-snapshot

DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

inferredcites →https://doi.org/10.48550/arxiv.2006.07733openalex-snapshot

Bootstrap your own latent: A new approach to self-supervised Learning

inferredcites →https://doi.org/10.48550/arxiv.2010.06682openalex-snapshot

Are all negatives created equal in contrastive instance discrimination?

inferredcites →https://doi.org/10.48550/arxiv.2010.08670openalex-snapshot

CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding

inferredcites →https://doi.org/10.48550/arxiv.2012.15466openalex-snapshot

CLEAR: Contrastive Learning for Sentence Representation

inferredcites →https://doi.org/10.48550/arxiv.2102.05918openalex-snapshot

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision

inferredcites →https://doi.org/10.48550/arxiv.2102.08473openalex-snapshot

COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

inferredcites →https://doi.org/10.48550/arxiv.2102.08850openalex-snapshot

Contrastive Learning Inverts the Data Generating Process

inferredcites →https://doi.org/10.48550/arxiv.2103.00020openalex-snapshot

Learning Transferable Visual Models From Natural Language Supervision

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.4798862openalex-extracted

Graph-Augmented Contrastive Clustering for Time Series Data

inferred← citeshttps://doi.org/10.2139/ssrn.4951336openalex-extracted

Graph-Augmented Contrastive Clustering for Time Series Data

inferred← citeshttps://doi.org/10.1002/aisy.202500818openalex-snapshot

Multivariate Contrastive Predictive Coding with Sliding Windows for Disease Prediction from Electronic Health Records

inferred← citeshttps://doi.org/10.1007/978-3-030-93049-3_18openalex-snapshot

Disentangled Contrastive Learning for Learning Robust Textual Representations

inferred← citeshttps://doi.org/10.1007/978-3-031-65329-2_26openalex-snapshot

Enhancing Low-Cost Molecular Property Prediction with Contrastive Learning on SMILES Representations

inferred← citeshttps://doi.org/10.1007/978-981-92-3441-7_1openalex-snapshot

Unsupervised Code Representation Learning via Contrastive Learning for Cross-Project Defect Prediction

inferred← citeshttps://doi.org/10.1007/978-981-95-8447-5_22openalex-snapshot

PNRM: A Pre-training News Recommendation Model with Contrastive Sampling

inferred← citeshttps://doi.org/10.1007/978-981-96-8295-9_12openalex-snapshot

Disentangled Mode-Specific Representations for Tensor Time Series via Contrastive Learning

inferred← citeshttps://doi.org/10.1007/978-981-97-5615-5_25openalex-snapshot

Users’ Preference-Aware Music Recommendation with Contrastive Learning

inferred← citeshttps://doi.org/10.1007/s00521-025-11279-2openalex-snapshot

Graph self-supervised long-tail item augmentation for recommendation

inferred← citeshttps://doi.org/10.1007/s00521-025-11467-0openalex-snapshot

A simple contrastive embedding framework for low-resource fake news detection

inferred← citeshttps://doi.org/10.1007/s00530-025-01885-4openalex-snapshot

ConASD: Contrastive Few Shot Learning for Detecting Autism Spectrum Disorder via Eye Tracking Scanpath

inferred← citeshttps://doi.org/10.1007/s10489-024-05802-6openalex-snapshot

Multivariate graph neural networks on enhancing syntactic and semantic for aspect-based sentiment analysis

inferred← citeshttps://doi.org/10.1007/s11760-025-04611-9openalex-snapshot

Multimodal knowledge retrieval of layout image text based on CLIP and ViT

inferred← citeshttps://doi.org/10.1007/s12539-023-00549-zopenalex-snapshot

LBCE-XGB: A XGBoost Model for Predicting Linear B-Cell Epitopes Based on BERT Embeddings

inferred← citeshttps://doi.org/10.1007/s13042-024-02285-2openalex-snapshot

Text semantic matching algorithm based on the introduction of external knowledge under contrastive learning

inferred← citeshttps://doi.org/10.1007/s40593-025-00500-xopenalex-snapshot

A Novel Deep Knowledge Tracing Model with Problem Complexity and State Stability

inferred← citeshttps://doi.org/10.1016/j.aei.2025.104196openalex-snapshot

A novel two-stage fault diagnosis method with frequency-aware graph contrastive learning and multi-scale recursive graph networks for rotating machinery

inferred← citeshttps://doi.org/10.1016/j.asoc.2024.111652openalex-snapshot

A graph attention network with contrastive learning for temporal review-based recommendations

inferred← citeshttps://doi.org/10.1016/j.atech.2026.101814openalex-snapshot

Automated extraction of scientific statements for integrated assessment of animal welfare using language models

inferred← citeshttps://doi.org/10.1016/j.biortech.2026.134309openalex-snapshot

Beyond text generation: large language models as autonomous agents for orchestrating synthetic biology cycles

inferred← citeshttps://doi.org/10.1016/j.caeai.2026.100662openalex-snapshot

Automatic discourse relation classification and feedback optimization in English teaching based on transformer BERT model

inferred← citeshttps://doi.org/10.1016/j.cmpb.2024.108452openalex-snapshot

Bootstrap each lead’s latent: A novel method for self-supervised learning of multilead electrocardiograms

inferred← citeshttps://doi.org/10.1016/j.compbiomed.2025.111137openalex-snapshot

A novel multimodal self-supervised framework for ECG arrhythmia classification

inferred← citeshttps://doi.org/10.1016/j.eswa.2023.121001openalex-snapshot

An Adaptive Fault Diagnosis Framework Under Class-Imbalanced Conditions Based on Contrastive Augmented Deep Reinforcement Learning

inferred← citeshttps://doi.org/10.1016/j.eswa.2024.124224openalex-snapshot

Attribute mining multi-view contrastive learning network for recommendation

inferred← citeshttps://doi.org/10.1016/j.inffus.2025.103991openalex-snapshot

Multimodal recommender systems: A survey of representation, modeling, and optimization

inferred← citeshttps://doi.org/10.1016/j.ins.2023.120032openalex-snapshot

Question-response representation with dual-level contrastive learning for improving knowledge tracing

inferred← citeshttps://doi.org/10.1016/j.ins.2023.120069openalex-snapshot

SimRE: Simple contrastive learning with soft logical rule for knowledge graph embedding

inferred← citeshttps://doi.org/10.1016/j.ins.2024.121756openalex-snapshot

A combined multi-margin contrastive learning with granulated data for warrant identification in computational argumentation

inferred← citeshttps://doi.org/10.1016/j.jss.2026.112924openalex-snapshot

Boosting commit classification with contrastive learning

inferred← citeshttps://doi.org/10.1016/j.knosys.2024.112308openalex-snapshot

TCLNet: Turn-level contrastive learning network with reranking for dialogue state tracking

inferred← citeshttps://doi.org/10.1016/j.knosys.2025.114602openalex-snapshot

Graph-augmented contrastive clustering for time series data

inferred← citeshttps://doi.org/10.1016/j.neucom.2024.127422openalex-snapshot

Online continual learning through unsupervised mutual information maximization

inferred← citeshttps://doi.org/10.1016/j.neunet.2026.108885openalex-snapshot

TFMPHGNN: Two-Fold multi-perspective heterogeneous graph neural network for sentiment analysis

inferred← citeshttps://doi.org/10.1016/j.patcog.2026.115118openalex-snapshot

A multimodal diagnosis model combining multi-granularity contrastive learning and quality-aware adaptive fusion

inferred← citeshttps://doi.org/10.1016/j.smhl.2023.100396openalex-snapshot

SimPPG: Self-supervised photoplethysmography-based heart-rate estimation via similarity-enhanced instance discrimination

inferred← citeshttps://doi.org/10.1109/cvpr52729.2023.01059openalex-snapshot

CLIPPO: Image-and-Language Understanding from Pixels Only

inferred← citeshttps://doi.org/10.1109/dsc59305.2023.00078openalex-snapshot

FixGPT: A Novel Three-Tier Deep Learning Model for Automated Program Repair

inferred← citeshttps://doi.org/10.1109/icassp43922.2022.9746018openalex-snapshot

Metricbert: Text Representation Learning Via Self-Supervised Triplet Training

inferred← citeshttps://doi.org/10.1109/icdm54844.2022.00050openalex-snapshot

Contrastive Code-Comment Pre-training

inferred← citeshttps://doi.org/10.1109/icmla61862.2024.00058openalex-snapshot

Effectively Prompting Small-Sized Language Models for Cross-Lingual Tasks via Winning Tickets

inferred← citeshttps://doi.org/10.1109/icra55743.2025.11128336openalex-snapshot

VITaL Pretraining: Visuo-Tactile Pretraining for Tactile and Non-Tactile Manipulation Policies

inferred← citeshttps://doi.org/10.1109/ijcnn60899.2024.10650863openalex-snapshot

Supervised Contrastive Learning with Hard Negative Samples

inferred← citeshttps://doi.org/10.1109/ijcnn64981.2025.11229326openalex-snapshot

An Adaptive Multi-Indicator Contrastive Predictive Coding Framework for Patient Representation Learning

inferred← citeshttps://doi.org/10.1109/iros60139.2025.11246929openalex-snapshot

Low-Fidelity Visuo-Tactile Pre-Training Improves Vision-Only Manipulation Performance

inferred← citeshttps://doi.org/10.1109/isctech60480.2023.00054openalex-snapshot

Generate to Understand for Representation in One Pre-training Stage

inferred← citeshttps://doi.org/10.1109/tase.2025.3626557openalex-snapshot

Supervised Momentum Contrastive Learning-Based Coarse-to-Fine Fusion Path Planning

inferred← citeshttps://doi.org/10.1109/tcsvt.2024.3474101openalex-snapshot

Tri-Modal Transformers With Mixture-of-Modality-Experts for Social Media Prediction

inferred← citeshttps://doi.org/10.1109/tkde.2023.3324912openalex-snapshot

Cross-Domain Recommendation via Progressive Structural Alignment

inferred← citeshttps://doi.org/10.1109/tmm.2025.3604953openalex-snapshot

AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning

inferred← citeshttps://doi.org/10.1109/tnnls.2022.3191086openalex-snapshot

Prototypical Graph Contrastive Learning

inferred← citeshttps://doi.org/10.1145/3593230openalex-snapshot

Evaluating a Large Language Model on Searching for GUI Layouts

inferred← citeshttps://doi.org/10.1145/3639477.3639754openalex-snapshot

FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systems

inferred← citeshttps://doi.org/10.1145/3643767openalex-snapshot

COSTELLO: Contrastive Testing for Embedding-Based Large Language Model as a Service Embeddings

inferred← citeshttps://doi.org/10.1145/3678513openalex-snapshot

Beyond "Taming Electric Scooters": Disentangling Understandings of Micromobility Naturalistic Riding

inferred← citeshttps://doi.org/10.1145/3699744openalex-snapshot

ContrastSense: Domain-invariant Contrastive Learning for In-the-Wild Wearable Sensing

inferred← citeshttps://doi.org/10.1162/tacl_a_00486openalex-snapshot

Fact Checking with Insufficient Evidence

inferred← citeshttps://doi.org/10.1177/02783649261417694openalex-snapshot

A survey on imitation learning for contact-rich tasks in robotics

inferred← citeshttps://doi.org/10.1186/s40537-021-00492-0openalex-snapshot

Text Data Augmentation for Deep Learning

inferred← citeshttps://doi.org/10.1371/journal.pcbi.1014492openalex-snapshot

Popformer: Learning general signatures of positive selection with a self-supervised transformer

inferred← citeshttps://doi.org/10.1371/journal.pone.0325543openalex-snapshot

TBKIN: Threshold-based explicit selection for enhanced cross-modal semantic alignments

inferred← citeshttps://doi.org/10.1609/aaai.v38i16.29731openalex-snapshot

Modeling Adaptive Inter-Task Feature Interactions via Sentiment-Aware Contrastive Learning for Joint Aspect-Sentiment Prediction

inferred← citeshttps://doi.org/10.17863/cam.75407openalex-snapshot

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

inferred← citeshttps://doi.org/10.18653/v1/2021.emnlp-main.109openalex-snapshot

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

inferred← citeshttps://doi.org/10.18653/v1/2021.emnlp-main.467openalex-snapshot

Pairwise Supervised Contrastive Learning of Sentence Representations

inferred← citeshttps://doi.org/10.18653/v1/2021.findings-emnlp.327openalex-snapshot

Contrastive Document Representation Learning with Graph Attention Networks

inferred← citeshttps://doi.org/10.18653/v1/2022.emnlp-main.802openalex-snapshot

Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings

inferred← citeshttps://doi.org/10.18653/v1/2022.findings-acl.239openalex-snapshot

Composing Structure-Aware Batches for Pairwise Sentence Classification

inferred← citeshttps://doi.org/10.18653/v1/2022.naacl-tutorialsopenalex-snapshot

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorial Abstracts

inferred← citeshttps://doi.org/10.18653/v1/2022.naacl-tutorials.6openalex-snapshot

Contrastive Data and Learning for Natural Language Processing

inferred← citeshttps://doi.org/10.18653/v1/2022.repl4nlp-1.6openalex-snapshot

A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition

inferred← citeshttps://doi.org/10.18653/v1/2023.acl-long.752openalex-snapshot

Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detection

inferred← citeshttps://doi.org/10.18653/v1/2023.clinicalnlp-1.8openalex-snapshot

Navigating Data Scarcity: Pretraining for Medical Utterance Classification

inferred← citeshttps://doi.org/10.18653/v1/2023.eacl-main.21openalex-snapshot

Triple-Hybrid Energy-based Model Makes Better Calibrated Natural Language Understanding Models

inferred← citeshttps://doi.org/10.18653/v1/2023.emnlp-main.694openalex-snapshot

TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-emnlp.236openalex-snapshot

Test-time Augmentation for Factual Probing

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-emnlp.441openalex-snapshot

Unmasking the Hidden Meaning: Bridging Implicit and Explicit Hate Speech Embedding Representations

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-emnlp.567openalex-snapshot

Contrastive Deterministic Autoencoders For Language Modeling

inferred← citeshttps://doi.org/10.18653/v1/2023.findings-ijcnlp.17openalex-snapshot

A Novel Information Theoretic Objective to Disentangle Representations for Fair Classification

inferred← citeshttps://doi.org/10.18653/v1/2023.matching-1openalex-snapshot

Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023)

inferred← citeshttps://doi.org/10.18653/v1/2023.matching-1.9openalex-snapshot

CoSiNES: Contrastive Siamese Network for Entity Standardization

inferred← citeshttps://doi.org/10.2139/ssrn.4159812openalex-snapshot

Evaluation of Contrastive Learning with Various Code Representations for Code Clone Detection

inferred← citeshttps://doi.org/10.2139/ssrn.4474418openalex-snapshot

Graph-Augmented Contrastive Clustering for Time Series

inferred← citeshttps://doi.org/10.2139/ssrn.4630799openalex-snapshot

Graph-Augmented Contrastive Clustering for Time Series

inferred← citeshttps://doi.org/10.2139/ssrn.5547721openalex-snapshot

Boosting Commit classification with Contrastive Learning

inferred← citeshttps://doi.org/10.23919/ccc63176.2024.10662135openalex-snapshot

Self-Supervised Learning with Min-Max Distance Approach for Few-Shot Steel Surface Defects Recognition

inferred← citeshttps://doi.org/10.3233/faia230538openalex-snapshot

Joint Multiple Intent Detection and Slot Filling with Supervised Contrastive Learning and Self-Distillation

inferred← citeshttps://doi.org/10.3390/app13095311openalex-snapshot

Learning Hierarchical Representations for Explainable Chemical Reaction Prediction

inferred← citeshttps://doi.org/10.3390/app13137908openalex-snapshot

DABaCLT: A Data Augmentation Bias-Aware Contrastive Learning Framework for Time Series Representation

inferred← citeshttps://doi.org/10.3390/info14040222openalex-snapshot

Emoji, Text, and Sentiment Polarity Detection Using Natural Language Processing

inferred← citeshttps://doi.org/10.48550/arxiv.2010.01061openalex-snapshot

Data-Efficient Pretraining via Contrastive Self-Supervision

inferred← citeshttps://doi.org/10.48550/arxiv.2109.09075openalex-snapshot

Adversarial Training with Contrastive Learning in NLP

inferred← citeshttps://doi.org/10.53846/goediss-9937openalex-snapshot

Aspect-based Document Similarity for Literature Recommender Systems

inferred← citeshttps://doi.org/10.7717/peerj-cs.2595openalex-snapshot

A temporal knowledge graph reasoning model based on recurrent encoding and contrastive learning

Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.