On the public citation graph

Long-document Representation for Retrieval and Retrieval-augmented Generation: A Representation-First, Distillation-aware Survey

https://doi.org/10.2139/ssrn.7247158
0 signed · 54 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/widm.70019openalex-snapshot
Long Document Classification in the Transformer Era: A Survey on Challenges, Advances, and Open Issues
inferredcites →https://doi.org/10.1007/s11263-021-01453-zopenalex-snapshot
Knowledge Distillation: A Survey
inferredcites →https://doi.org/10.1016/j.mlwa.2024.100605openalex-snapshot
A survey on knowledge distillation: Recent advancements
inferredcites →https://doi.org/10.1145/3530811openalex-snapshot
Efficient Transformers: A Survey
inferredcites →https://doi.org/10.1145/3616855.3635774openalex-snapshot
LEAD: Liberal Feature-based Distillation for Dense Retrieval
inferredcites →https://doi.org/10.1145/3637528.3671470openalex-snapshot
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
inferredcites →https://doi.org/10.1145/3637870openalex-snapshot
Dense Text Retrieval Based on Pretrained Language Models: A Survey
inferredcites →https://doi.org/10.1145/3767695.3769491openalex-snapshot
Learning Refined Document Representations for Dense Retrieval via Deliberate Thinking
inferredcites →https://doi.org/10.1145/3805622.3810780openalex-snapshot
Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA
inferredcites →https://doi.org/10.1162/tacl_a_00023openalex-snapshot
The NarrativeQA Reading Comprehension Challenge
inferredcites →https://doi.org/10.1162/tacl_a_00276openalex-snapshot
Natural Questions: A Benchmark for Question Answering Research
inferredcites →https://doi.org/10.1162/tacl_a_00353openalex-snapshot
Efficient Content-Based Sparse Attention with Routing Transformers
inferredcites →https://doi.org/10.1162/tacl_a_00595openalex-snapshot
MIRACL : A Multilingual Retrieval Dataset Covering 18 Diverse Languages
inferredcites →https://doi.org/10.1609/aaai.v38i17.29947openalex-snapshot
Fine-Grained Distillation for Long Document Retrieval
inferredcites →https://doi.org/10.1609/aaai.v40i39.40574openalex-snapshot
Are We on the Right Way to Assess Document Retrieval-Augmented Generation?
inferredcites →https://doi.org/10.18653/v1/2020.acl-demos.12openalex-snapshot
Multilingual Universal Sentence Encoder for Semantic Retrieval
inferredcites →https://doi.org/10.18653/v1/2020.acl-main.195openalex-snapshot
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
inferredcites →https://doi.org/10.18653/v1/2020.acl-main.207openalex-snapshot
SPECTER: Document-level Representation Learning using Citation-informed Transformers
inferredcites →https://doi.org/10.18653/v1/2020.acl-main.431openalex-snapshot
Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.19openalex-snapshot
ETC: Encoding Long and Structured Inputs in Transformers
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.365openalex-snapshot
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation
inferredcites →https://doi.org/10.18653/v1/2020.emnlp-main.550openalex-snapshot
Dense Passage Retrieval for Open-Domain Question Answering
inferredcites →https://doi.org/10.18653/v1/2021.emnlp-main.552openalex-snapshot
SimCSE: Simple Contrastive Learning of Sentence Embeddings
inferredcites →https://doi.org/10.18653/v1/2022.emnlp-main.669openalex-snapshot
Large Dual Encoders Are Generalizable Retrievers
inferredcites →https://doi.org/10.18653/v1/2022.emnlp-main.823openalex-snapshot
SCROLLS: Standardized CompaRison Over Long Language Sequences
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.338openalex-snapshot
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.693openalex-snapshot
UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers
inferredcites →https://doi.org/10.18653/v1/2023.emnlp-main.888openalex-snapshot
Text Representation Distillation via Information Bottleneck Principle
inferredcites →https://doi.org/10.18653/v1/2023.sustainlp-1.23openalex-snapshot
Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.172openalex-snapshot
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.236openalex-snapshot
DAPR: A Benchmark on Document-Aware Passage Retrieval
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.642openalex-snapshot
Improving Text Embeddings with Large Language Models
inferredcites →https://doi.org/10.18653/v1/2024.acl-long.776openalex-snapshot
L-Eval: Instituting Standardized Evaluation for Long Context Language Models
inferredcites →https://doi.org/10.18653/v1/2024.emnlp-main.1013openalex-snapshot
PairDistill: Pairwise Relevance Distillation for Dense Retrieval
inferredcites →https://doi.org/10.18653/v1/2024.emnlp-main.1259openalex-snapshot
LongRAG: A Dual-Perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering
inferredcites →https://doi.org/10.18653/v1/2024.emnlp-main.47openalex-snapshot
LongEmbed: Extending Embedding Models for Long Context Retrieval
inferredcites →https://doi.org/10.18653/v1/2025.acl-long.127openalex-snapshot
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
inferredcites →https://doi.org/10.18653/v1/2025.acl-long.1394openalex-snapshot
Pretraining Context Compressor for Large Language Models with Embedding-Based Memory
inferredcites →https://doi.org/10.18653/v1/2025.acl-long.183openalex-snapshot
LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks
inferredcites →https://doi.org/10.18653/v1/2025.acl-long.740openalex-snapshot
Efficient Long Context Language Model Retrieval with Compression
inferredcites →https://doi.org/10.18653/v1/2025.emnlp-industry.173openalex-snapshot
Distilling Cross-Modal Knowledge into Domain-Specific Retrievers for Enhanced Industrial Document Understanding
inferredcites →https://doi.org/10.18653/v1/2025.emnlp-main.179openalex-snapshot
FinMTEB: Finance Massive Text Embedding Benchmark
inferredcites →https://doi.org/10.18653/v1/2025.emnlp-main.316openalex-snapshot
Static Word Embeddings for Sentence Semantic Representation
inferredcites →https://doi.org/10.18653/v1/d17-1070openalex-snapshot
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
inferredcites →https://doi.org/10.18653/v1/d18-1259openalex-snapshot
HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
inferredcites →https://doi.org/10.18653/v1/d19-1006openalex-snapshot
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings
inferredcites →https://doi.org/10.18653/v1/n19-1423openalex-snapshot
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
inferredcites →https://doi.org/10.18653/v1/p17-1147openalex-snapshot
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
inferredcites →https://doi.org/10.18653/v1/p19-1285openalex-snapshot
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
inferredcites →https://doi.org/10.3115/v1/d14-1162openalex-snapshot
Glove: Global Vectors for Word Representation
inferredcites →https://doi.org/10.52202/068431-2192openalex-snapshot
Matryoshka Representation Learning
inferredcites →https://doi.org/10.52202/079017-1902openalex-snapshot
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models
inferredcites →https://doi.org/10.52202/079017-3204openalex-snapshot
MUVERA: Multi-Vector Retrieval via Fixed Dimensional Encoding
inferredcites →https://doi.org/10.63317/2gscircifffdopenalex-snapshot
SentEval: An Evaluation Toolkit for Universal Sentence Representations
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.