Benchmarking Test Density
by Thomas Fehlmann
In Automotive, but also in many other areas such as the Internet of Things (IoT), Trains or Airplanes, Software Testing is necessary to get certificates and trust. Or would users ever dare to let an autonomous car drive them through traffic without trusting the software tests ensuring safety (SOTIF — Safety of The Intended Functionality, ISO 21448)? Drivers even switch off their ADAS (Advanced Driving Assistance System) because of mistrust. Airline passengers likely will avoid flights with new software releases of the Boeing 737 MAX unless the constructor can exhibit a test density that restores trust.
Test Density can be measured and benchmarked. This talk is about how to measure tests, defects, test density and predict reliability, even for software that relies on Artificial Intelligence (AI) and Support Vector Machines (SVM), as many visual recognition systems do.