On the public citation graph

Managing What We Can Measure: Quantifying the Susceptibility of Automated Scoring Systems to Gaming Behavior

0 signed · 70 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/j.2333-8504.2009.tb02158.xopenalex-snapshot
EVALUATING THE CONSTRUCT‐COVERAGE OF THE E‐RATER® SCORING ENGINE
inferredcites →https://doi.org/10.1007/bf01419938openalex-snapshot
The use of the computer in analyzing student essays
inferredcites →https://doi.org/10.1016/j.specom.2009.04.009openalex-snapshot
Automatic scoring of non-native spontaneous speech in tests of spoken English
inferredcites →https://doi.org/10.1016/s0747-5632(01)00052-8openalex-snapshot
Stumping e-rater:challenging the validity of automated essay scoring
inferredcites →https://doi.org/10.1017/s1351324906004189openalex-snapshot
Identifying off-topic student essays without topic-specific training data
inferredcites →https://doi.org/10.1080/00220973.1994.9943835openalex-snapshot
Computer Grading of Student Prose, Using Modern Concepts and Software
inferredcites →https://doi.org/10.1080/0969594032000148154openalex-snapshot
Automatic Essay Assessment
inferredcites →https://doi.org/10.1080/10627197.2015.997617openalex-snapshot
Contrasting State-of-the-Art in the Machine Scoring of Short-Form Constructed Responses
inferredcites →https://doi.org/10.1111/j.1745-3992.1998.tb00631.xopenalex-snapshot
Validity and Automad Scoring: It's Not Only the Scoring
inferredcites →https://doi.org/10.1111/j.1745-3992.2011.00223.xopenalex-snapshot
A Framework for Evaluation and Use of Automated Scoring
inferredcites →https://doi.org/10.1145/985692.985741openalex-snapshot
Off-task behavior in the cognitive tutor classroom
inferredcites →https://doi.org/10.1177/0265532210364404openalex-snapshot
Validating automated speaking tests
inferredcites →https://doi.org/10.1177/0265532211425673openalex-snapshot
A comparison of two scoring methods for an automated speech scoring system
inferredcites →https://doi.org/10.1177/0265532212452396openalex-snapshot
Scoring with the computer: Alternative procedures for improving the reliability of holistic essay scoring
inferredcites →https://doi.org/10.21437/interspeech.2011-479openalex-snapshot
Off-topic detection in automated speech assessment applications
inferredcites →https://doi.org/10.2307/3587951openalex-snapshot
A New Academic Word List
inferredcites →https://doi.org/10.2307/j.ctt4cgq0p.8openalex-snapshot
5 Taking a spin on the intelligent essay assessor
inferredcites →https://doi.org/10.2307/j.ctt4cgq0p.9openalex-snapshot
ACCUPLACERʹS ESSAY-SCORING TECHNOLOGY:
inferredcites →https://doi.org/10.4324/9780203122761openalex-snapshot
Handbook of Automated Essay Evaluation

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.2139/ssrn.4826248openalex-extracted
Exploring Differences between Automated Writing Evaluation (Awe) Feedback and Teacher Feedback and Their Impact on College Students’ Second Language (L2) Writing Practice
inferred← citeshttps://doi.org/10.1002/9781118914069.ch21openalex-snapshot
Technology and High‐stakes Language Testing
inferred← citeshttps://doi.org/10.1002/ets2.12022openalex-snapshot
A Study of the Use of the e‐rater® Scoring Engine for the Analytical Writing Measure of the GRE ® revised General Test
inferred← citeshttps://doi.org/10.1002/ets2.12116openalex-snapshot
Evaluating the Advisory Flags and Machine Scoring Difficulty in the e‐rater® Automated Scoring Engine
inferred← citeshttps://doi.org/10.1007/978-3-031-20980-2_13openalex-snapshot
Coherence Based Automatic Essay Scoring Using Sentence Embedding and Recurrent Neural Networks
inferred← citeshttps://doi.org/10.1007/978-3-319-19977-1_14openalex-snapshot
Evaluating the Detection of Aberrant Responses in Automated Essay Scoring
inferred← citeshttps://doi.org/10.1007/s00287-024-01573-zopenalex-snapshot
Strengths and weaknesses of automated scoring of free-text student answers
inferred← citeshttps://doi.org/10.1007/s10462-021-10068-2openalex-snapshot
An automated essay scoring systems: a systematic literature review
inferred← citeshttps://doi.org/10.1007/s10639-024-12891-wopenalex-snapshot
ChatGPT as an automated essay scoring tool in the writing classrooms: how it compares with human scoring
inferred← citeshttps://doi.org/10.1007/s11191-024-00511-5openalex-snapshot
Unpacking Epistemic Insights of Artificial Intelligence (AI) in Science Education: A Systematic Review
inferred← citeshttps://doi.org/10.1007/s11423-021-10004-9openalex-snapshot
Statewide implementation of automated writing evaluation: analyzing usage and associations with state test performance in grades 4-11
inferred← citeshttps://doi.org/10.1007/s40593-020-00236-wopenalex-snapshot
Automated Feedback and Automated Scoring in the Elementary Grades: Usage, Attitudes, and Associations with Writing Outcomes in a Districtwide Implementation of MI Write
inferred← citeshttps://doi.org/10.1007/s40593-022-00301-6openalex-snapshot
Evaluating the Construct Validity of an Automated Writing Evaluation System with a Randomization Algorithm
inferred← citeshttps://doi.org/10.1016/j.asw.2017.08.002openalex-snapshot
Automated formative writing assessment using a levels of language framework
inferred← citeshttps://doi.org/10.1016/j.cedpsych.2018.07.002openalex-snapshot
Teacher implementation of Self-Regulated Strategy Development with an automated writing evaluation system: Effects on the argumentative writing performance of middle school students
inferred← citeshttps://doi.org/10.1016/j.compcom.2021.102675openalex-snapshot
Using automated feedback to develop writing proficiency
inferred← citeshttps://doi.org/10.1016/j.compedu.2016.05.004openalex-snapshot
Automated essay evaluation software in English Language Arts classrooms: Effects on teacher feedback, student motivation, and writing quality
inferred← citeshttps://doi.org/10.1037/mgr0000049openalex-snapshot
Adapting simulation responses from judgment-based to analytic-based scores: A process model, case study, and empirical evaluation of managers’ responses among a sample of managers.
inferred← citeshttps://doi.org/10.1108/978-1-68123-931-620251008openalex-snapshot
Validity Issues For Technology-Enhanced Innovative Assessments
inferred← citeshttps://doi.org/10.1109/ictai59109.2023.00118openalex-snapshot
A cross-attention and Siamese network based model for off-topic detection
inferred← citeshttps://doi.org/10.1111/emip.12544openalex-snapshot
To Score or Not to Score: Factors Influencing Performance and Feasibility of Automatic Content Scoring of Text Responses
inferred← citeshttps://doi.org/10.1111/emip.12593openalex-snapshot
MxML (Exploring the Relationship between Measurement and Machine Learning): Current State of the Field
inferred← citeshttps://doi.org/10.1111/jedm.12093openalex-snapshot
The Impact of Anonymization for Automated Essay Scoring
inferred← citeshttps://doi.org/10.1111/jedm.12427openalex-snapshot
The Vulnerability of AI‐Based Scoring Systems to Gaming Strategies: A Case Study
inferred← citeshttps://doi.org/10.1145/3493700.3493765openalex-snapshot
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems
inferred← citeshttps://doi.org/10.1145/3587102.3588796openalex-snapshot
Seeing Program Output Improves Novice Learning Gains
inferred← citeshttps://doi.org/10.1155/2021/8812542openalex-snapshot
A Review of Artificial Intelligence (AI) in Education from 2010 to 2020
inferred← citeshttps://doi.org/10.1177/07356331221127300openalex-snapshot
The Effectiveness of Automated Writing Evaluation on Writing Quality: A Meta-Analysis
inferred← citeshttps://doi.org/10.1177/07356331231189294openalex-snapshot
A Multi-Strategy Computer-Assisted EFL Writing Learning System With Deep Learning Incorporated and Its Effects on Learning: A Writing Feedback Perspective
inferred← citeshttps://doi.org/10.1177/0741088318819473openalex-snapshot
Multidimensional Levels of Language Writing Measures in Grades Four to Six
inferred← citeshttps://doi.org/10.1371/journal.pone.0354680openalex-snapshot
Testing standards for AI-based scores in automated essay scoring
inferred← citeshttps://doi.org/10.14742/apubs.2016.798openalex-snapshot
Applications of Automatic Writing Evaluation to Guide the Understanding of Learning and Teaching
inferred← citeshttps://doi.org/10.1515/edu-2025-0104openalex-snapshot
Investigating the Factors Influencing Teachers’ Intention to Use Chatbots in Primary Education in Greece
inferred← citeshttps://doi.org/10.18653/v1/2020.acl-main.697openalex-snapshot
Automated Evaluation of Writing – 50 Years and Counting
inferred← citeshttps://doi.org/10.18653/v1/2020.bea-1openalex-snapshot
Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications
inferred← citeshttps://doi.org/10.18653/v1/2020.bea-1.4openalex-snapshot
Complementary Systems for Off-Topic Spoken Response Detection
inferred← citeshttps://doi.org/10.18653/v1/2020.coling-main.76openalex-snapshot
Don’t take “nswvtnvakgxpm” for an answer –The surprising vulnerability of automatic content scoring systems to adversarial input
inferred← citeshttps://doi.org/10.18653/v1/n18-1024openalex-snapshot
Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input
inferred← citeshttps://doi.org/10.18653/v1/n18-3008openalex-snapshot
Atypical Inputs in Educational Applications
inferred← citeshttps://doi.org/10.18653/v1/w19-4441openalex-snapshot
Content Modeling for Automated Oral Proficiency Scoring System
inferred← citeshttps://doi.org/10.21203/rs.3.rs-7533498/v1openalex-snapshot
Potential Use of ChatGPT for Automated Essay Scoring Based
inferred← citeshttps://doi.org/10.2200/s01121ed1v01y202108hlt052openalex-snapshot
Automated Essay Scoring
inferred← citeshttps://doi.org/10.3102/00028312221106773openalex-snapshot
Examining Human and Automated Ratings of Elementary Students’ Writing Quality: A Multivariate Generalizability Theory Application
inferred← citeshttps://doi.org/10.37514/jwa-j.2018.2.1.08openalex-snapshot
Developing an e-rater Advisory to Detect Babel-generated Essays
inferred← citeshttps://doi.org/10.4018/978-1-4666-9441-5.ch026openalex-snapshot
Using Automated Feedback to Improve Writing Quality
inferred← citeshttps://doi.org/10.4324/9781003278658-5openalex-snapshot
Assessment of Clinical Skills
inferred← citeshttps://doi.org/10.4324/9781315871493-3openalex-snapshot
Issues in Simulation-Based Assessment
inferred← citeshttps://doi.org/10.48550/arxiv.2012.13872openalex-snapshot
My Teacher Thinks The World Is Flat! Interpreting Automatic Essay Scoring Mechanism
inferred← citeshttps://doi.org/10.5753/cbie.sbie.2017.51openalex-snapshot
Off-Topic Essay Detection: A Systematic Review
inferred← citeshttps://doi.org/10.5753/rbie.2019.27.03.177openalex-snapshot
Off-Topic Essay Detection: A comparative study on the Portuguese language
inferred← citeshttps://doi.org/10.5753/stil.2024.245419openalex-snapshot
A Robustness Analysis of Automated Essay Scoring Methods
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.