2024
Syntax Is All You Need: A Universal-Language Approach to Mutant Generation.
Proc. ACM Softw. Eng., 2024
(Programs), Proofs and Refutations (and Tests and Mutants).
Proceedings of the 2024 ACM SIGPLAN International Symposium on New Ideas, 2024
2023
Contextual Predictive Mutation Testing.
Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2023
Mind the Gap: The Difference Between Coverage and Mutation Score Can Guide Testing Efforts.
Proceedings of the 34th IEEE International Symposium on Software Reliability Engineering, 2023
2022
Mutation Analysis: Answering the Fuzzing Challenge.
CoRR, 2022
Looking for Lacunae in Bitcoin Core's Fuzzing Efforts.
Proceedings of the 44th IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice, 2022
Making no-fuss compiler fuzzing effective.
Proceedings of the CC '22: 31st ACM SIGPLAN International Conference on Compiler Construction, Seoul, South Korea, April 2, 2022
2021
Evaluating and Improving Static Analysis Tools Via Differential Mutation Analysis.
Proceedings of the 21st IEEE International Conference on Software Quality, 2021
Let a thousand flowers bloom: on the uses of diversity in software testing.
Proceedings of the Onward! 2021: Proceedings of the 2021 ACM SIGPLAN International Symposium on New Ideas, 2021
SMARTIAN: Enhancing Smart Contract Fuzzing with Static and Dynamic Data-Flow Analyses.
Proceedings of the 36th IEEE/ACM International Conference on Automated Software Engineering, 2021
echidna-parade: a tool for diverse multicore smart contract fuzzing.
Proceedings of the ISSTA '21: 30th ACM SIGSOFT International Symposium on Software Testing and Analysis, 2021
Fuzz Testing the Compiled Code in R Packages.
Proceedings of the 32nd IEEE International Symposium on Software Reliability Engineering, 2021
2020
Using Relative Lines of Code to Guide Automated Test Generation for Python.
ACM Trans. Softw. Eng. Methodol., 2020
Using mutants to help developers distinguish and debug (compiler) faults.
Softw. Test. Verification Reliab., 2020
ACM SIGSOFT Softw. Eng. Notes, 2020
Practical Automatic Lightweight Nondeterminism and Flaky Test Detection and Debugging for Python.
Proceedings of the 20th IEEE International Conference on Software Quality, 2020
A Practical, Principled Measure of Fuzzer Appeal: A Preliminary Study.
Proceedings of the 20th IEEE International Conference on Software Quality, 2020
Echidna: effective, usable, and fast fuzzing for smart contracts.
Proceedings of the ISSTA '20: 29th ACM SIGSOFT International Symposium on Software Testing and Analysis, 2020
What are the Actual Flaws in Important Smart Contracts (And How Can We Find Them)?
Proceedings of the Financial Cryptography and Data Security, 2020
2019
Evaluating Fault Localization for Resource Adaptation via Test-Based Software Modification.
Proceedings of the 19th IEEE International Conference on Software Quality, 2019
Manticore: A User-Friendly Symbolic Execution Framework for Binaries and Smart Contracts.
Proceedings of the 34th IEEE/ACM International Conference on Automated Software Engineering, 2019
Building Resource Adaptations via Test-Based Software Minimization: Application, Challenges, and Opportunities.
Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops, 2019
Slither: a static analysis framework for smart contracts.
Proceedings of the 2nd International Workshop on Emerging Trends in Software Engineering for Blockchain, 2019
2018
TSTL: the template scripting testing language.
Int. J. Softw. Tools Technol. Transf., 2018
How verified (or tested) is my code? Falsification-driven verification and testing.
Autom. Softw. Eng., 2018
Tutorial: DeepState: Bringing Vulnerability Detection Tools into the Development Cycle.
Proceedings of the 2018 IEEE Cybersecurity Development, SecDev 2018, Cambridge, MA, USA, 2018
Target Selection for Test-Based Resource Adaptation.
Proceedings of the 2018 IEEE International Conference on Software Quality, 2018
Causal Distance-Metric-Based Assistance for Debugging after Compiler Fuzzing.
Proceedings of the 29th IEEE International Symposium on Software Reliability Engineering, 2018
Reduce Before You Localize: Delta-Debugging and Spectrum-Based Fault Localization.
Proceedings of the 2018 IEEE International Symposium on Software Reliability Engineering Workshops, 2018
An extensible, regular-expression-based tool for multi-language mutant generation.
Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings, 2018
2017
Mutation Reduction Strategies Considered Harmful.
IEEE Trans. Reliab., 2017
Does choice of mutation tool matter?
Softw. Qual. J., 2017
Provenance and Pseudo-Provenance for Seeded Learning-Based Automated Test Generation.
CoRR, 2017
Resource Adaptation via Test-Based Software Minimization.
Proceedings of the 11th IEEE International Conference on Self-Adaptive and Self-Organizing Systems, 2017
A suite of tools for making effective use of automatically generated tests.
Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, Santa Barbara, CA, USA, July 10, 2017
One test to rule them all.
Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, Santa Barbara, CA, USA, July 10, 2017
The Theory of Composite Faults.
Proceedings of the 2017 IEEE International Conference on Software Testing, 2017
Applying Mutation Analysis on Kernel Test Suites: An Experience Report.
Proceedings of the 2017 IEEE International Conference on Software Testing, 2017
2016
Cause reduction: delta debugging, even without bugs.
Softw. Test. Verification Reliab., 2016
Finding Model-Checkable Needles in Large Source Code Haystacks: Modular Bug-Finding via Static Analysis and Dynamic Invariant Discovery.
CoRR, 2016
Data Poisoning: Lightweight Soft Fault Injection for Python.
CoRR, 2016
Bounded Model Checking and Feature Omission Diversity.
CoRR, 2016
A Method Dependence Relations Guided Genetic Algorithm.
Proceedings of the Search Based Software Engineering - 8th International Symposium, 2016
Mitigating (and exploiting) test reduction slippage.
Proceedings of the 7th International Workshop on Automating Test Case Design, 2016
Can testedness be effectively measured?
Proceedings of the 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2016
Evaluating non-adequate test-case reduction.
Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, 2016
Generating focused random tests using directed swarm testing.
Proceedings of the 25th International Symposium on Software Testing and Analysis, 2016
Measuring Effectiveness of Mutant Sets.
Proceedings of the Ninth IEEE International Conference on Software Testing, 2016
Topsy-Turvy: a smarter and faster parallelization of mutation analysis.
Proceedings of the 38th International Conference on Software Engineering, 2016
On the limits of mutation reduction strategies.
Proceedings of the 38th International Conference on Software Engineering, 2016
2015
Guidelines for Coverage-Based Comparisons of Non-Adequate Test Suites.
ACM Trans. Softw. Eng. Methodol., 2015
A Little Language for Testing.
Proceedings of the NASA Formal Methods - 7th International Symposium, 2015
How Verified is My Code? Falsification-Driven Verification (T).
Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering, 2015
TSTL: a language and tool for testing (demo).
Proceedings of the 2015 International Symposium on Software Testing and Analysis, 2015
How hard does mutation analysis have to be, anyway?
Proceedings of the 26th IEEE International Symposium on Software Reliability Engineering, 2015
Exploiting abstraction, learning from random simulation, and SVM classification for efficient dynamic prediction of software health problems.
Proceedings of the Sixteenth International Symposium on Quality Electronic Design, 2015
2014
You Are the Only Possible Oracle: Effective Test Selection for End Users of Interactive Machine Learning Systems.
,
,
,
,
,
,
,
,
,
,
IEEE Trans. Software Eng., 2014
Establishing flight software reliability: testing, model checking, constraint-solving, monitoring and learning.
Ann. Math. Artif. Intell., 2014
An Improved Memetic Algorithm with Method Dependence Relations (MAMDR).
Proceedings of the 2014 14th International Conference on Quality Software, 2014
Coverage and Its Discontents.
Proceedings of the Onward! 2014, 2014
Using test case reduction and prioritization to improve symbolic execution.
Proceedings of the International Symposium on Software Testing and Analysis, 2014
MuCheck: an extensible tool for mutation testing of haskell programs.
Proceedings of the International Symposium on Software Testing and Analysis, 2014
Mutations: How Close are they to Real Faults?
Proceedings of the 25th IEEE International Symposium on Software Reliability Engineering, 2014
Cause Reduction for Quick Testing.
Proceedings of the Seventh IEEE International Conference on Software Testing, 2014
Code coverage for suite evaluation by developers.
Proceedings of the 36th International Conference on Software Engineering, 2014
Taming a Fuzzer Using Delta Debugging Trails.
Proceedings of the 2014 IEEE International Conference on Data Mining Workshops, 2014
2013
Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation, 2013
Comparing non-adequate test suites using coverage criteria.
Proceedings of the International Symposium on Software Testing and Analysis, 2013
Help, help, i'm being suppressed! The significance of suppressors in software testing.
Proceedings of the IEEE 24th International Symposium on Software Reliability Engineering, 2013
2012
Proceedings of the International Symposium on Software Testing and Analysis, 2012
Finding common ground: choose, assert, and assume.
Proceedings of the International Workshop on Dynamic Analysis: held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2012), 2012
Extended program invariants: applications in testing and fault localization.
Proceedings of the International Workshop on Dynamic Analysis: held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2012), 2012
Lightweight Automated Testing with Adaptation-Based Programming.
Proceedings of the 23rd IEEE International Symposium on Software Reliability Engineering, 2012
Learning-Based Test Programming for Programmers.
Proceedings of the Leveraging Applications of Formal Methods, Verification and Validation. Technologies for Mastering Change, 2012
2011
Swarm Verification Techniques.
IEEE Trans. Software Eng., 2011
Mini-crowdsourcing end-user assessment of intelligent assistants: A cost-benefit study.
Proceedings of the 2011 IEEE Symposium on Visual Languages and Human-Centric Computing, 2011
Coverage rewarded: Test input generation via adaptation-based programming.
Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011), 2011
Where Are My Intelligent Assistant's Mistakes? A Systematic Testing Approach.
Proceedings of the End-User Development - Third International Symposium, 2011
2010
Formal Analysis of Log Files.
J. Aerosp. Comput. Inf. Commun., 2010
From scripts to specifications: the evolution of a flight software testing effort.
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering, 2010
2009
An Entry Point for Formal Methods: Specification and Analysis of Event Logs
Proceedings of the Proceedings FM-09 Workshop on Formal Methods for Aerospace, 2009
Rule Systems for Runtime Verification: A Short Tutorial.
Proceedings of the Runtime Verification, 9th International Workshop, 2009
(Quickly) testing the tester via path coverage.
Proceedings of the International Workshop on Dynamic Analysis: held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2009), 2009
2008
Exploiting traces in static program analysis: better model checking through printf{{\tt printf}}s.
Int. J. Softw. Tools Technol. Transf., 2008
Model driven code checking.
Autom. Softw. Eng., 2008
Extending Model Checking with Dynamic Analysis.
Proceedings of the Verification, 2008
New Challenges in Model Checking.
Proceedings of the 25 Years of Model Checking - History, Achievements, Perspectives, 2008
Tackling Large Verification Problems with the Swarm Tool.
Proceedings of the Model Checking Software, 2008
Automated Testing of Planning Models.
Proceedings of the Model Checking and Artificial Intelligence, 5th International Workshop, 2008
Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2008), 2008
Random Test Run Length and Effectiveness.
Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE 2008), 2008
Random testing and model checking: building a common framework for nondeterministic exploration.
Proceedings of the 2008 International Workshop on Dynamic Analysis: held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2008), 2008
2007
Verifying C++ with STL containers via predicate abstraction.
Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007), 2007
Randomized Differential Testing as a Prelude to Formal Verification.
Proceedings of the 29th International Conference on Software Engineering (ICSE 2007), 2007
2006
Error explanation with distance metrics.
Int. J. Softw. Tools Technol. Transf., 2006
Exploiting Traces in Program Analysis.
Proceedings of the Tools and Algorithms for the Construction and Analysis of Systems, 2006
2004
Modular Verification of Software Components in C.
IEEE Trans. Software Eng., 2004
Heuristics for model checking Java programs.
Int. J. Softw. Tools Technol. Transf., 2004
Efficient Verification of Sequential and Concurrent C Programs.
Formal Methods Syst. Des., 2004
Making the Most of BMC Counterexamples.
Proceedings of the 2nd International Workshop on Bounded Model Checking, 2004
Error Explanation with Distance Metrics.
Proceedings of the Tools and Algorithms for the Construction and Analysis of Systems, 2004
Explaining abstract counterexamples.
Proceedings of the 12th ACM SIGSOFT International Symposium on Foundations of Software Engineering, 2004, Newport Beach, CA, USA, October 31, 2004
Counterexample Guided Abstraction Refinement Via Program Execution.
Proceedings of the Formal Methods and Software Engineering, 2004
Understanding Counterexamples with explain.
Proceedings of the Computer Aided Verification, 16th International Conference, 2004
2003
VeriAgent: an Approach to Integrating UML and Formal Verification Tools.
Proceedings of the 6th Brazilian Workshop on Formal Methods, 2003
What Went Wrong: Explaining Counterexamples.
Proceedings of the Model Checking Software, 2003
Predicate Abstraction with Minimum Predicates.
Proceedings of the Correct Hardware Design and Verification Methods, 2003
2002
Heuristic Model Checking for Java Programs.
Proceedings of the Model Checking of Software, 2002
Model checking Java programs using structural heuristics.
Proceedings of the International Symposium on Software Testing and Analysis, 2002
AMC: An Adaptive Model Checker.
Proceedings of the Computer Aided Verification, 14th International Conference, 2002
2001
Efficient Model Checking Via Büchi Tableau Automata.
Proceedings of the Computer Aided Verification, 13th International Conference, 2001