On the public citation graph

An Empirical Study of Testing Machine Learning in the Wild

0 signed · 109 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/stv.430openalex-snapshot
Regression testing minimization, selection and prioritization: a survey
inferredcites →https://doi.org/10.1007/978-1-4020-5614-7_3349openalex-snapshot
Statistical Tests
inferredcites →https://doi.org/10.1007/978-1-4419-9863-7_927openalex-snapshot
Inductive Bias
inferredcites →https://doi.org/10.1007/978-1-4471-0721-7_2openalex-snapshot
Genetic Algorithms
inferredcites →https://doi.org/10.1007/978-3-030-36718-3_20openalex-snapshot
Models in the Wild: On Corruption Robustness of Neural NLP Systems
inferredcites →https://doi.org/10.1007/978-3-031-33976-9openalex-snapshot
Agile Processes in Software Engineering and Extreme Programming
inferredcites →https://doi.org/10.1007/978-3-319-66787-4_22openalex-snapshot
Illusion and Dazzle: Adversarial Optical Channel Exploits Against Lidars for Automotive Applications
inferredcites →https://doi.org/10.1007/978-3-540-73589-2openalex-snapshot
ECOOP 2007 - object-oriented programming : 21st European Conference, Berlin, Germany, July 30 - August 3, 2007 : proceedings
inferredcites →https://doi.org/10.1007/978-3-540-73589-2_8openalex-snapshot
Exception Handling: A Field Study in Java and .NET
inferredcites →https://doi.org/10.1007/978-3-642-00296-0openalex-snapshot
Noise Reduction in Speech Processing
inferredcites →https://doi.org/10.1007/978-3-642-38314-4_7openalex-snapshot
Effects of Negative Testing on TDD: An Industrial Experiment
inferredcites →https://doi.org/10.1007/978-94-007-7152-9openalex-snapshot
Swarm Planning: The Development of a Planning Methodology to Deal with Climate Adaptation
inferredcites →https://doi.org/10.1007/s10664-017-9512-6openalex-snapshot
Curating GitHub for engineered software projects
inferredcites →https://doi.org/10.1007/s10664-020-09881-0openalex-snapshot
Testing machine learning based systems: a systematic mapping
inferredcites →https://doi.org/10.1007/s10664-022-10116-7openalex-snapshot
Search-based fairness testing for regression-based machine learning systems
inferredcites →https://doi.org/10.1007/s10664-023-10409-5openalex-snapshot
Detection and evaluation of bias-inducing features in machine learning
inferredcites →https://doi.org/10.1007/s11219-021-09557-yopenalex-snapshot
Construction of a quality model for machine learning systems
inferredcites →https://doi.org/10.1007/s11334-021-00384-9openalex-snapshot
Tri-level regression testing using nature-inspired algorithms
inferredcites →https://doi.org/10.1016/j.asoc.2021.107366openalex-snapshot
Data set quality in Machine Learning: Consistency measure based on Group Decision Making
inferredcites →https://doi.org/10.1016/j.bdr.2015.12.001openalex-snapshot
Finding the Best Classification Threshold in Imbalanced Classification
inferredcites →https://doi.org/10.1016/j.dss.2010.12.003openalex-snapshot
An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models
inferredcites →https://doi.org/10.1016/j.entcs.2005.12.014openalex-snapshot
An Introduction to Software Testing
inferredcites →https://doi.org/10.1016/j.eswa.2020.113233openalex-snapshot
A multimodal particle swarm optimization-based approach for image segmentation
inferredcites →https://doi.org/10.1016/j.ins.2016.01.090openalex-snapshot
BNC-PSO: structure learning of Bayesian networks by Particle Swarm Optimization
inferredcites →https://doi.org/10.1016/j.jss.2020.110542openalex-snapshot
On testing machine learning programs
inferredcites →https://doi.org/10.1016/j.knosys.2018.03.022openalex-snapshot
Graph embedding techniques, applications, and performance: A survey
inferredcites →https://doi.org/10.1016/j.media.2017.07.005openalex-snapshot
A survey on deep learning in medical image analysis
inferredcites →https://doi.org/10.1016/j.patcog.2022.108868openalex-snapshot
DSLA: Dynamic smooth label assignment for efficient anchor-free object detection
inferredcites →https://doi.org/10.1016/s0898-1221(98)90701-5openalex-snapshot
Finite-state language processing
inferredcites →https://doi.org/10.1038/s42256-022-00482-8openalex-snapshot
Autonomous environment-adaptive microrobot swarm navigation enabled by deep learning-based real-time distribution planning
inferredcites →https://doi.org/10.1049/sej.1994.0025openalex-snapshot
Applicability of modified condition/decision coverage to software testing
inferredcites →https://doi.org/10.1079/phn2002429openalex-snapshot
Statistical approaches for assessing the relative validity of a food-frequency questionnaire: use of correlation coefficients and the kappa statistic
inferredcites →https://doi.org/10.1080/02564602.2021.1894250openalex-snapshot
Path Planning for Multiple Targets Interception by the Swarm of UAVs based on Swarm Intelligence Algorithms: A Review
inferredcites →https://doi.org/10.1080/09613218.2012.710047openalex-snapshot
Swarm planning for climate change: an alternative pathway for resilience
inferredcites →https://doi.org/10.1089/big.2016.0048openalex-snapshot
Conscientious Classification: A Data Scientist's Guide to Discrimination-Aware Classification
inferredcites →https://doi.org/10.1093/jjfinec/nbh004openalex-snapshot
Backtesting Value-at-Risk: A Duration-Based Approach
inferredcites →https://doi.org/10.1109/32.372146openalex-snapshot
State transition analysis: a rule-based intrusion detection approach
inferredcites →https://doi.org/10.1109/32.799955openalex-snapshot
Qualitative methods in empirical studies of software engineering
inferredcites →https://doi.org/10.1109/ase.2019.00078openalex-snapshot
A Study of Oracle Approximations in Testing Deep Learning Libraries
inferredcites →https://doi.org/10.1109/bigdata.2017.8258038openalex-snapshot
The ML test score: A rubric for ML production readiness and technical debt reduction
inferredcites →https://doi.org/10.1109/cvpr.2019.01152openalex-snapshot
Importance Estimation for Neural Network Pruning
inferredcites →https://doi.org/10.1109/iccv.2015.312openalex-snapshot
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
inferredcites →https://doi.org/10.1109/iccv.2017.298openalex-snapshot
Learning Efficient Convolutional Networks through Network Slimming
inferredcites →https://doi.org/10.1109/icict43934.2018.9034254openalex-snapshot
Automated API Testing
inferredcites →https://doi.org/10.1109/icse-nier.2019.00030openalex-snapshot
Towards Improved Testing For Deep Learning
inferredcites →https://doi.org/10.1109/icse-seip.2019.00042openalex-snapshot
Software Engineering for Machine Learning: A Case Study
inferredcites →https://doi.org/10.1109/icsme.2018.00072openalex-snapshot
Clone-Based Variability Management in the Android Ecosystem
inferredcites →https://doi.org/10.1109/icsme55016.2022.00010openalex-snapshot
An Empirical Study of Challenges in Converting Deep Learning Models
inferredcites →https://doi.org/10.1109/icsme55016.2022.00014openalex-snapshot
An Empirical Study on the Usage of Automated Machine Learning Tools
inferredcites →https://doi.org/10.1109/icst.2008.47openalex-snapshot
Mining Software Repositories to Study Co-Evolution of Production & Test Code
inferredcites →https://doi.org/10.1109/issre.2018.00021openalex-snapshot
DeepMutation: Mutation Testing of Deep Learning Systems
inferredcites →https://doi.org/10.1109/ms.1984.233702openalex-snapshot
Verifying and Validating Software Requirements and Design Specifications
inferredcites →https://doi.org/10.1109/msp.2020.3016143openalex-snapshot
Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networks
inferredcites →https://doi.org/10.1109/qrs.2018.00044openalex-snapshot
Manifesting Bugs in Machine Learning Code: An Explorative Study with Mutation Testing
inferredcites →https://doi.org/10.1109/saner.2019.8667998openalex-snapshot
Studying Android App Popularity by Cross-Linking GitHub and Google Play Store
inferredcites →https://doi.org/10.1109/sp.2017.49openalex-snapshot
Towards Evaluating the Robustness of Neural Networks
inferredcites →https://doi.org/10.1109/tii.2012.2198665openalex-snapshot
Comparison of Parallel Genetic Algorithm and Particle Swarm Optimization for Real-Time UAV Path Planning
inferredcites →https://doi.org/10.1109/tse.1977.231133openalex-snapshot
Compiler Analysis of the Value Ranges for Variables
inferredcites →https://doi.org/10.1109/tse.2019.2962027openalex-snapshot
Machine Learning Testing: Survey, Landscapes and Horizons
inferredcites →https://doi.org/10.1109/tse.2023.3313875openalex-snapshot
A Grounded Theory of Cross-Community SECOs: Feedback Diversity Versus Synchronization
inferredcites →https://doi.org/10.1109/vl/hcc10541.2005openalex-snapshot
2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05)
inferredcites →https://doi.org/10.1109/vlhcc.2005.44openalex-snapshot
How Well Do Professional Developers Test with Code Coverage Visualizations? An Empirical Study
inferredcites →https://doi.org/10.1126/science.aal1950openalex-snapshot
Ecosystem management as a wicked problem
inferredcites →https://doi.org/10.1137/1015034openalex-snapshot
Matrix Calculus Operations and Taylor Expansions
inferredcites →https://doi.org/10.1145/1541880.1541882openalex-snapshot
Anomaly detection
inferredcites →https://doi.org/10.1145/1541880.1541883openalex-snapshot
Methodologies for data quality assessment and improvement
inferredcites →https://doi.org/10.1145/2338965.2336763openalex-snapshot
Swarm testing
inferredcites →https://doi.org/10.1145/2487575.2487579openalex-snapshot
Accurate intelligible models with pairwise interactions
inferredcites →https://doi.org/10.1145/2594473.2594475openalex-snapshot
Comprehensible classification models
inferredcites →https://doi.org/10.1145/2939672.2939778openalex-snapshot
"Why Should I Trust You?"
inferredcites →https://doi.org/10.1145/3052973.3053009openalex-snapshot
Practical Black-Box Attacks against Machine Learning
inferredcites →https://doi.org/10.1145/3106237.3106277openalex-snapshot
Fairness testing: testing software for discrimination
inferredcites →https://doi.org/10.1145/3132747.3132785openalex-snapshot
DeepXplore
inferredcites →https://doi.org/10.1145/3236009openalex-snapshot
A Survey of Methods for Explaining Black Box Models
inferredcites →https://doi.org/10.1145/3338906.3338937openalex-snapshot
Black box fairness testing of machine learning models
inferredcites →https://doi.org/10.1145/3394486.3403379openalex-snapshot
An Empirical Analysis of Backward Compatibility in Machine Learning Systems
inferredcites →https://doi.org/10.1145/3457607openalex-snapshot
A Survey on Bias and Fairness in Machine Learning
inferredcites →https://doi.org/10.1145/3468264.3468537openalex-snapshot
Bias in machine learning software: why? how? what to do?
inferredcites →https://doi.org/10.1145/3530019.3530039openalex-snapshot
Studying the Practices of Deploying Machine Learning Projects on Docker
inferredcites →https://doi.org/10.1145/367008.367020openalex-snapshot
An empirical study of regression test selection techniques
inferredcites →https://doi.org/10.1145/3680463openalex-snapshot
An Empirical Study of Testing Machine Learning in the Wild
inferredcites →https://doi.org/10.1177/1525822x05282260openalex-snapshot
Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice
inferredcites →https://doi.org/10.1201/9781439889503openalex-snapshot
Software Testing
inferredcites →https://doi.org/10.1371/journal.pone.0262838openalex-snapshot
Deep learning model calibration for improving performance in class-imbalanced medical image classification tasks
inferredcites →https://doi.org/10.1609/aaai.v33i01.33012429openalex-snapshot
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
inferredcites →https://doi.org/10.17016/feds.2005.21openalex-snapshot
A Review of Backtesting and Backtesting Procedures
inferredcites →https://doi.org/10.18653/v1/d19-1578openalex-snapshot
Perturbation Sensitivity Analysis to Detect Unintended Model Biases
inferredcites →https://doi.org/10.18653/v1/n18-1170openalex-snapshot
Adversarial Example Generation with Syntactically Controlled Paraphrase Networks
inferredcites →https://doi.org/10.18653/v1/p18-1079openalex-snapshot
Semantically Equivalent Adversarial Rules for Debugging NLP models
inferredcites →https://doi.org/10.2139/ssrn.418762openalex-snapshot
Backtesting Value-at-Risk: A Duration-Based Approach
inferredcites →https://doi.org/10.3390/s22124374openalex-snapshot
Test Case Prioritization, Selection, and Reduction Using Improved Quantum-Behaved Particle Swarm Optimization
inferredcites →https://doi.org/10.3905/jpm.2015.42.1.013openalex-snapshot
Backtesting
inferredcites →https://doi.org/10.48550/arxiv.1505.06378openalex-snapshot
Monotonic Calibrated Interpolated Look-Up Tables
inferredcites →https://doi.org/10.48550/arxiv.1712.05526openalex-snapshot
Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
inferredcites →https://doi.org/10.48550/arxiv.2006.04388openalex-snapshot
Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection
inferredcites →https://doi.org/10.6092/issn.1973-2201/3599openalex-snapshot
The permutation testing approach: a review
inferredcites →https://doi.org/10.7551/mitpress/3007.001.0001openalex-snapshot
Finite-State Language Processing

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1007/978-3-032-10721-3_24openalex-snapshot
Machine Learning Testing: Error, Fault, or Failure? An Ontological Approach
inferred← citeshttps://doi.org/10.1007/978-3-032-23883-2_33openalex-snapshot
Software Quality in Machine Learning Systems: A Scoping Review of Smells and Antipatterns
inferred← citeshttps://doi.org/10.1007/s10664-026-10834-2openalex-snapshot
Can we recycle our old models? An empirical evaluation of model selection mechanisms for AIOps solutions
inferred← citeshttps://doi.org/10.1007/s10664-026-10857-9openalex-snapshot
An empirical study of testing practices in open source AI agent frameworks and agentic applications
inferred← citeshttps://doi.org/10.1016/j.infsof.2026.108345openalex-snapshot
Dealing with drifting data in computer vision applications. A case study of retail and quick service restaurants monitoring
inferred← citeshttps://doi.org/10.1016/j.jss.2026.112925openalex-snapshot
Understanding Machine Learning testing in practice
inferred← citeshttps://doi.org/10.1016/j.multra.2025.100272openalex-snapshot
Towards autonomy: A comprehensive technical and ethical review of automated vehicle safety
inferred← citeshttps://doi.org/10.1109/icse55347.2025.00185openalex-snapshot
A Large-Scale Study of Model Integration in ML-Enabled Software Systems
inferred← citeshttps://doi.org/10.1145/3706599.3706686openalex-snapshot
AI for Meeting Minutes: Promises and Challenges in Designing Human-AI Collaboration on a Production SaaS Platform
inferred← citeshttps://doi.org/10.1145/3843282.3844433openalex-snapshot
Automated Annotation of Test Types using LLMs: A Multi-LLM Workflow for Machine Learning Test-Related Commits
inferred← citeshttps://doi.org/10.7717/peerj-cs.4114openalex-snapshot
Systematic review of test case generation strategies for deep learning systems
showing the first 11 of 12 · page through all 12
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.