Session 2b: Autonomy & Autonomous Systems

Defining metrics for autonomous controllers assessment

Pablo Muñoz1, Amedeo Cesta2, Andrea Orlandini2, María D. R-Moreno1

Universidad de Alcalá (Spain)1
Institute of Cognitive Science and Technology, CNR (Italy)2

Date: September 29, 15:15 - 15:45
Room: Sala 3M

Autonomous controllers based on Planning & Scheduling are reaching confidence enough to be candidate for automating the operation of different on-board spacecraft's systems. Moreover, in the literature several proposals to fully automate robotics operations are presented. To demonstrate their effectiveness these autonomous controllers face different operational scenarios for particular domains. However, these tests usually do not provide details about the average behaviors of the system and/or the bounds of these behaviors when executing the same operational scenario several times. In this paper we will focus on a planetary exploration case study to analyze different behaviors of the ESA GOAC autonomous controller, assessing how different parameters vary within multiple executions monitored with the OGATE tool. The objective is to characterize such data by means of a statistical analysis, providing detailed information about the expected behaviors of the system for a better validation of the autonomous controller.