Kill All Mutants! (Intro to Mutation Testing)

Schedule

Room: Room 228

April 4

14:30–14:55

Abstract

Agenda:

• What is mutation testing?
• Why isn't test coverage enough?
• What are its pros and cons?
• How does it work (overview and details)?
• Simple example (finding and fixing bad test)
• Complex example (finding and fixing bad/missing test)
• Complex example (finding and fixing redundant code)
• FAQs -- history, why it's so CPU/RAM intensive, and more if time allows
• Unusual applications, if time allows
• Wrapup
• Q&A

Prerequisites

Basic concepts of unit testing or similar automated testing of small pieces

Description

Would your test suite still pass if the tested code was changed? If so, there may be problems with your code, your tests, or both!

Mutation Testing reveals these cases. This talk will tell you what mutation testing is, how it works, how to use it, and its benefits, drawbacks, and history. There will be multiple examples, and a list of tools for many popular languages (and others).

You will come away equipped with a powerful technique for making sure your tests are strict and your code is meaningful!