Allocate
The SUNRISE Safety Assurance Framework is test environment-agnostic, allowing scenarios to be executed in a range of test environments, from fully virtual to simulated environments (such as Hardware-in-the-Loop) to controlled real-world environments or public roads. Within the SUNRISE project, a test environment allocation workflow is also being developed (it is detailed below), which will later be implemented in case studies within the broader safety assurance framework. Once the test environment is allocated, the test scenario is executed, and the corresponding data is recorded.
The initial allocation process involves two key inputs: test case information and test instance capabilities. Test cases include scenario descriptions, expected behavior of the system under test (SUT), and pass/fail criteria. Specific requirements are extracted from these test cases. The second input consists of available test instances, such as virtual testing, X-in-the-Loop (XiL), and proving ground testing, with field testing excluded due to its uncontrollable nature.
The process begins with comparing test case requirements to the capabilities of test instances using a structured approach. This includes analyzing aspects like scenery elements, environmental conditions, dynamic elements, and test criteria. Once a suitable test instance is identified, the test case is allocated to it.
A virtual simulation-first approach is prioritized for safety and efficiency. Test cases suitable for virtual simulation are executed using the lowest-fidelity simulation capable of meeting requirements, to maximize throughput. Post-execution, results are reviewed to determine if further testing on higher-fidelity test instances is required. This iterative process may include reallocations to ensure the necessary test coverage and accuracy.
The process includes provisions for external influence, such as road authorities overriding allocations or proving ground operators refusing tests due to safety concerns. These decisions must be documented for the final assessment. Additionally, the allocation framework includes initial reallocation steps, which will be refined in future development efforts.