Technical Deep-Dive: Tested To the Core
Multiple-Level Testing as a Foundation for Validating Skypuzzler’s Software Systems.
When developing cyber-physical software systems, it is easy to fall into the “sim-to-real trap” and rely solely on unit tests, integration tests and simulations. Skypuzzler utilises multiple levels of testing and validation to mitigate issues before they arise in its products, thereby facilitating better coverage and understanding of the system.
Skypuzzler does this by simulating many types of drone missions in pure software, followed by stress-testing the system to extrapolate what is possible from a software-only perspective. Software-in-the-Loop facilities of many flight controllers are also utilised to run the same missions and compare results.
Physical testing of Skypuzzler’s system is vital to confirm its real-world behaviour in the chaotic environment of the physical world.
Based on the results of the software tests, physical tests are conducted using the same type of missions. Here, Skypuzzler employs two types of drones, with micro-drones, CrazyFlies from Bitcraze, as the first test subjects due to their clear safety benefit. Full-sized commercial drones are used next. Even though there is a scaling issue when using both micro-drones and fullsized commercial drones, it is extremely valuable to analyse the new features in a safe habitat.
To validate all the processed results from both the software tests and the tests with the micro-drones, Skypuzzler uses a number of different types of commercial drones, such as Holybro X500 and X650s, VTOL models, DJI drones and Fixed-wing
drones. This is to acquire a better understanding of the different behaviours of the specific drone types under the particular missions.
