Speaker
Alexander Svetkin is a Principal Software Engineer at Microsoft, working on Azure Core infrastructure. With over 15 years of experience in tech, he focuses on scaling engineering processes, improving development efficiency, and building resilient platforms.
Why AI Changes Testing
AI makes it faster to write and modify code, but it also introduces new risks. Generated code may look correct while hiding edge cases or unstable behavior.
Traditional testing relies on predefined scenarios, which makes it less effective in detecting unknown issues. As systems become more dynamic, teams need approaches that can explore unexpected inputs and failure modes.
What Fuzz Testing Adds
Fuzz testing focuses on system stability rather than expected outputs. Instead of checking if code behaves correctly in known cases, it tests how systems respond to unpredictable inputs.
This helps detect:
- crashes
- hangs
- resource issues
It shifts testing from “did we cover this case?” to “what happens if something unexpected occurs?”
Why It Works Well with AI Code
Fuzz testing does not require a deep understanding of the code. It treats the system as a black box and tests behavior through inputs and outputs.
This makes it particularly effective for AI-generated code, where:
- logic may be unclear for the developer
- edge cases are easy to miss
- changes may be introduced without intent
Unlike unit tests, fuzzing is less dependent on predefined assumptions.
Case Studies
To validate this in practice, an experiment was performed across around thirty open-source Go projects, using an AI agent to write fuzz harnesses for functions it considered interesting — parsers, input handlers, data transformers. The results were significant: five critical runtime errors across three projects, used in production by thousands of companies. The process took around thirty minutes per project, with no prior knowledge of the codebase.
What Makes Fuzz Testing Effective
High-performing teams treat fuzzing as part of the regular testing process:
Test critical entry points. APIs, parsers, and input handlers are the most valuable targets.
Run continuously. Integrating fuzzing into CI/CD helps catch issues early.
Focus on stability. The goal is not perfect correctness, but resilience under unexpected conditions.
Combine with other methods. Fuzzing works best alongside unit tests and monitoring.
Fuzzing as Part of Engineering Infrastructure
Like automated testing or CI/CD, fuzz testing becomes more valuable when integrated into the overall development process.
It helps teams:
- detect issues earlier
- reduce production incidents
- improve confidence in rapidly changing codebases
This is especially important as AI accelerates development speed.
Conclusion
As AI changes how code is written, testing approaches must adapt. Fuzz testing provides a practical way to uncover hidden failures that traditional methods miss. By integrating it into the development workflow, teams can improve reliability without sacrificing speed — and build systems that remain stable even under unpredictable conditions.