Coverage Analysis
After execution, the data is analysed to determine if the system is safe. There are two main steps in this analysis: Coverage Analysis and Test Evaluation. Coverage Analysis uses a multi-pillar approach, examining the test from multiple perspectives and deriving a combined coverage outcome. These perspectives might include analysing coverage of the parameter value ranges in the logical scenario using individual concrete parameter values. There is an iterative process to derive new concrete scenarios within a given logical scenario’s parameter ranges based on the analysis outcome to identify failure conditions (i.e., parameter combinations that lead to system failure). This iterative feedback loop is indicated by the red feedback arrow and will be discussed in more detail shortly.
Another aspect of Coverage Analysis is ODD analysis. Here, we examine the accumulated ODD features covered by the set of test scenarios to determine if enough of the system’s ODD is covered. We focus on ODD because it defines the operational boundary within which the system is expected to operate safely. Thus, it is essential to thoroughly explore this claimed boundary using a diverse set of scenarios. These are just two examples that form the coverage concept, and the SUNRISE project will continue to explore this further in later stages.
You may use this xlsx file to send your comments on any part of the SAF Handbook, following the integrated instructions! Thank you in advance for your time!