Test Evaluate
The Test Evaluate block assesses each test execution to determine whether the system has passed or failed. For instance, did the system stay within an upper speed limit, or did it avoid collisions? Both the Coverage and Test Evaluate blocks contribute to the overall Analysis block, and the results are used to select further concrete parameters within the original scenario’s parameter ranges. After several iterations, once the coverage threshold is reached, the combined coverage and test evaluation results will feed into the Decide block, producing the overall safety assurance outcome for the system. Please note that pass/fail criteria are heavily governed by the use case (i.e., use case dependent), therefore SUNRISE cannot prescribe specific criteria, however, the categories below should be considered: 1) whether the intended test has been executed (e.g., whether intended cut-in has occurred), 2) use case specific pass/fail criteria received from the input layer, 3) optionally, user can consider baseline based pass/fail criteria, such as human driver model baseline.