Coverage
After execution, the data is analysed as part of the safety assessment of the system. There are two main steps in this analysis: Coverage Analysis and Test Evaluation. Coverage Analysis examines the test from multiple perspectives and derives a combined coverage outcome. These perspectives might include analysing coverage of the parameter value ranges in the logical scenario using individual concrete parameter values. There is an iterative process to derive new concrete scenarios within a given logical scenario’s parameter ranges based on the analysis outcome to identify conditions that result in the system violates pass/fail criteria (e.g., parameter combinations that lead to system failure). This iterative feedback loop is indicated by the red feedback arrow and will be discussed in more detail shortly.
Another aspect of Coverage Analysis is Operational Design Domain (ODD) analysis. Here, the accumulated ODD features covered by the set of test scenarios are examined to determine if enough of the system’s ODD is covered. ODD is the focus because it defines the operational boundary within which the system is expected to operate safely. Thus, it is essential to thoroughly explore this claimed boundary using a diverse set of scenarios. These are just two examples that form the coverage concept, and the SUNRISE project will continue to explore this further in later stages.