On the public citation graph
How Consistent Are Humans When Grading Programming Assignments?
0 signed · 69 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1016/j.edurev.2007.05.002openalex-snapshot
The use of scoring rubrics: Reliability, validity and educational consequences
inferredcites →https://doi.org/10.1016/j.nedt.2018.06.022openalex-snapshot
The use of assessment rubrics to enhance feedback in higher education: An integrative literature review
inferredcites →https://doi.org/10.1016/j.nepr.2018.05.013openalex-snapshot
Consistency in grading clinical skills
inferredcites →https://doi.org/10.1016/j.tsc.2014.02.003openalex-snapshot
Personal and environmental factors affecting teachers’ creativity-fostering practices in Hong Kong
inferredcites →https://doi.org/10.1016/j.tsc.2017.11.004openalex-snapshot
Learning environments that support student creativity: Developing the SCALE
inferredcites →https://doi.org/10.1080/02602930600760868openalex-snapshot
Student justice perceptions following assignment feedback
inferredcites →https://doi.org/10.1080/02602930902862859openalex-snapshot
A review of rubric use in higher education
inferredcites →https://doi.org/10.1080/02602938.2015.1024607openalex-snapshot
Let’s stop the pretence of consistent marking: exploring the multiple limitations of assessment criteria
inferredcites →https://doi.org/10.1080/02602938.2023.2203883openalex-snapshot
Same grade for different reasons, different grades for the same reason?
inferredcites →https://doi.org/10.1080/03075070220000662openalex-snapshot
Summative Assessment in Higher Education: Practices in disarray
inferredcites →https://doi.org/10.1080/0309877x.2018.1499883openalex-snapshot
Rethinking the teaching roles and assessment responsibilities of student teaching assistants
inferredcites →https://doi.org/10.1080/0969594x.2021.1884041openalex-snapshot
Analytic or holistic? A study about how to increase the agreement in teachers’ grading
inferredcites →https://doi.org/10.1080/13538320802278347openalex-snapshot
Student Satisfaction Surveys: The Value in Taking an Historical Perspective
inferredcites →https://doi.org/10.1109/fie.2010.5673351openalex-snapshot
Perceived differences in tutor grading in large classes: Fact or fiction?
inferredcites →https://doi.org/10.1109/fie.2018.8659243openalex-snapshot
Teaching Assistants’ Experiences of Lab Sessions in Introductory Computer Science Courses
inferredcites →https://doi.org/10.1109/icaibd.2018.8396196openalex-snapshot
The effect of software programmers' personality on programming performance
inferredcites →https://doi.org/10.1109/icse48619.2023.00047openalex-snapshot
A Qualitative Study on the Implementation Design Decisions of Developers
inferredcites →https://doi.org/10.1109/wpc.2004.1311066openalex-snapshot
Programming style changes in evolving source code
inferredcites →https://doi.org/10.1111/j.1745-3984.1977.tb00031.xopenalex-snapshot
SOLVING MEASUREMENT PROBLEMS WITH THE RASCH MODEL
inferredcites →https://doi.org/10.1119/1.1634963openalex-snapshot
Grading student problem solutions: The challenge of sending a consistent message
inferredcites →https://doi.org/10.1145/1352135.1352162openalex-snapshot
Improving pedagogical feedback and objective grading
inferredcites →https://doi.org/10.1145/1734263.1734412openalex-snapshot
Using strategies for assessment of programming exercises
inferredcites →https://doi.org/10.1145/2632320.2632346openalex-snapshot
The recurring rainfall problem
inferredcites →https://doi.org/10.1145/2999541.2999555openalex-snapshot
Designing a rubric for feedback on code quality in programming courses
inferredcites →https://doi.org/10.1145/3017680.3017764openalex-snapshot
Impact of Class Size on Student Evaluations for Traditional and Peer Instruction Classrooms
inferredcites →https://doi.org/10.1145/3174781.3174785openalex-snapshot
"I know it when I see it" Perceptions of Code Quality
inferredcites →https://doi.org/10.1145/3291279.3339422openalex-snapshot
Undergraduate Teaching Assistants in Computer Science
inferredcites →https://doi.org/10.1145/3300115.3309532openalex-snapshot
Impact of Open-Ended Assignments on Student Self-Efficacy in CS1
inferredcites →https://doi.org/10.1145/3408877.3432370openalex-snapshot
Growing Enrollments Require Us to Do More: Perspectives on Broadening Participation During an Undergraduate Computing Enrollment Boom
inferredcites →https://doi.org/10.1145/3430665.3456304openalex-snapshot
Challenges Faced by Teaching Assistants in Computer Science Education Across Europe
inferredcites →https://doi.org/10.1145/3430895.3460165openalex-snapshot
Components of Assessments and Grading At Scale
inferredcites →https://doi.org/10.1145/3474623openalex-snapshot
Hiring CS Graduates: What We Learned from Employers
inferredcites →https://doi.org/10.1145/3517133openalex-snapshot
Assessment of Code, Which Aspects Do Teachers Consider and How Are They Valued?
inferredcites →https://doi.org/10.1145/3517134openalex-snapshot
A Qualitative Study of Experienced Course Coordinators’ Perspectives on Assessment in Introductory Programming Courses for Non-CS Majors
inferredcites →https://doi.org/10.1145/3519312openalex-snapshot
A Review on Source Code Documentation
inferredcites →https://doi.org/10.1145/3544547openalex-snapshot
Why universities must resist GPA-based enrollment caps in the face of surging enrollments
inferredcites →https://doi.org/10.1145/3545945.3569822openalex-snapshot
FalconCode: A Multiyear Dataset of Python Code Samples from an Introductory Computer Science Course
inferredcites →https://doi.org/10.1145/3568812.3603485openalex-snapshot
Creating Equitable Grading Practices with Rubrics: A Teaching Assistant Training Activity
inferredcites →https://doi.org/10.1145/3626252.3630953openalex-snapshot
Transforming Grading Practices in the Computing Education Community
inferredcites →https://doi.org/10.1145/3631802.3631804openalex-snapshot
Feedback on Student Programming Assignments: Teaching Assistants vs Automated Assessment Tool
inferredcites →https://doi.org/10.1145/3636243.3636256openalex-snapshot
A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education
inferredcites →https://doi.org/10.1145/3636243.3636258openalex-snapshot
A Literature-Informed Model for Code Style Principles to Support Teachers of Text-Based Programming
inferredcites →https://doi.org/10.1145/3636515openalex-snapshot
Automated Grading and Feedback Tools for Programming Education: A Systematic Review
inferredcites →https://doi.org/10.1145/6592.6594openalex-snapshot
Learning to program = learning to construct mechanisms and explanations
inferredcites →https://doi.org/10.1186/1471-2288-13-61openalex-snapshot
A comparison of Cohen’s Kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples
inferredcites →https://doi.org/10.1186/1472-6920-6-42openalex-snapshot
Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling
inferredcites →https://doi.org/10.1348/000711006x126600openalex-snapshot
Computing inter‐rater reliability and its variance in the presence of high agreement
inferredcites →https://doi.org/10.14738/aivp.112.14406openalex-snapshot
The Ideal versus the Real Deal in Assessment of Physics Lab Report Writing
inferredcites →https://doi.org/10.2307/2288384openalex-snapshot
Content Analysis: An Introduction to its Methodology.
inferredcites →https://doi.org/10.3200/ctch.53.1.27-31openalex-snapshot
Teaching With Rubrics: The Good, the Bad, and the Ugly
inferredcites →https://doi.org/10.3389/feduc.2018.00022openalex-snapshot
Appropriate Criteria: Key to Effective Rubrics
inferredcites →https://doi.org/10.6084/m9.figshare.12610958openalex-snapshot
+5 Million Python & Bash Programming Submissions for 5 Courses & Grades for Computer-Based Exams over 3 academic years.
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1080/08993408.2026.2705528openalex-snapshot
Students judge different things differently: dimension-specific self-assessment calibration in introductory digital circuit design
inferred← citeshttps://doi.org/10.1109/fie63693.2025.11328152openalex-snapshot
WIP: How Effective are Llm-Implemented Autograders for Programming Assignments Compared to Human Graders?
inferred← citeshttps://doi.org/10.1109/iciet69664.2026.11561565openalex-snapshot
Transforming Student Assignments through GenAI Innovation in Higher Education
inferred← citeshttps://doi.org/10.1109/mipro70003.2026.11591576openalex-snapshot
Evolving Programming Education with AL Opportunities and Challenges of LLM-Integrated Assessment Systems
inferred← citeshttps://doi.org/10.1109/siml69834.2026.11621519openalex-snapshot
A Linguistic Structure-Based Short Answer Automatic Scoring System for Indonesian
inferred← citeshttps://doi.org/10.1145/3769994.3770017openalex-snapshot
Failures in Reliably Assessing Program Code Readability
inferred← citeshttps://doi.org/10.1145/3794763.3794806openalex-snapshot
Put The “Code” Back in “Code Comprehension Study”
inferred← citeshttps://doi.org/10.5753/wei.2026.21827openalex-snapshot
Beyond Correctness: A Competency-Driven Framework for Designing Autograder Test Suites
inferred← citeshttps://doi.org/10.59350/01cd6-dvq50openalex-snapshot
Join us on Monday 3rd of November to discuss how consistent humans are when grading programming assignments (spoiler alert: not very)
inferred← citeshttps://doi.org/10.59350/gt87p-h7295openalex-snapshot
Join us on Monday 3rd of November to discuss how consistent humans are when grading programming assignments (spoiler alert: not very)
inferred← citeshttps://doi.org/10.61453/jods.v20260211openalex-snapshot
Human-in-the-Loop Data Science: Enhancing Model Performance Through Interactive Learning Mechanisms
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.