The 7th UCAAT (User Conference on Advanced Automated Testing) was held at Bordeaux on 22-24 October 2019.

ETSI Technical Committee INT presented the current work on Artificial Intelligence (AI) in Test Systems and Testing AI Models for Autonomic (Closed-Loop) Network Automation.

Artificial Intelligence Models (AI Models) are enablers for advanced intelligence in the Management and Control operations now strongly required for the evolving and future networks such as 5G Networks. AI algorithms bring benefits to diverse aspects in development and deployment of AI exhibiting systems such as Autonomic and Cognitive 5G networks and their associated Autonomic Management and Control (AMC) systems. This presentation covers the work launched under the ETSI TC INT AFI WG 5G PoC Program on “AI in Test Systems and Testing AI Models” articulated around the three following topics:

• The benefits AI brings to Test Systems (e.g. in reduction of Test Suites execution time in Performance Testing complex systems)
• Testing AI Models for autonomic and cognitive management & control of network resources, parameters and services—using a “Qualified Automated Test Component(s) or System” that exhibit best quality AI capabilities for testing those of AI Component(s)/System Under Test
• Generic Test Framework for Testing ETSI GANA (Generic Autonomic Network Architecture) Model’s Multi-Layer Autonomics & AI Algorithms for Closed-Loop Network Automation

The following aspects are also covered by the presentation:

• The Metrics on what AI brings to Performance Test Systems, and Products that can be used by Testers to achieve such Objectives
• Initiation of Work on Standardization of Metrics of specific classes of AI Models so as to enable Test Systems and Certification communities to test the AI Models and to provide certification services
• A Methodology for Testing AI Models that are designed for autonomic and cognitive management & control of network resources, parameters and services
• A Generic Test Framework for Testing the ETSI GANA (Generic Autonomic Network Architecture) Model’s Multi-Layer Autonomics Decision-making-Elements (DEs) and their associated AI Algorithms for Closed-Loop Network Automation
• How Testers for Performance Testing of Complex Systems can leverage the understanding of Metrics that AI brings to Performance Test Systems to partner with Organizations that have Products/Solutions in this space in order to benefit from such solutions/products and the overall benefits of AI in Test Systems
• How Test Solution Vendors shall benefit from both a Methodology for Testing AI Models that are designed for autonomic and cognitive management & control of network resources, parameters and services; and the Generic Test Framework for Testing ETSI GANA (Generic Autonomic Network Architecture) Model’s Multi-Layer Autonomics & AI Algorithms for Closed-Loop Network Automation; in developing Test Solutions for Autonomic Management and Control Intelligence being introduced in emerging and future networks such as 5G

The presentation “Artificial Intelligence (AI) in Test Systems, Testing AI Models and the ETSI GANA Model's Cognitive Decision Elements (DEs) via a Generic Test Framework for Testing ETSI GANA Multi-Layer Autonomics & their AI Algorithms for Closed-Loop Network Automation” can be downloaded via the UCAAT website.

Contributors

• Tayeb Ben Meriem, PhD: Orange: Senior Standardization Manager & Technical Expert: ETSI TC-INT Vice-Chair and TC INT AFI WG 5G PoC Steering Committee Leader; France
• Ranganai Chaparadza, PhD: Altran Germany: Technical Expert & Senior Consultant/Vodafone Consultant; IPv6 Forum; TC INT AFI WG 5G PoC Steering Committee Member; Germany
• Michael Mild; Testing Expert & Standardization Expert; Softwell Performance AB; Sweden
• Ralf Karbstein; Testing Expert; Senior Account Manager at DATAKOM; Germany
• Uwe Baeder; Testing Expert & Standardization Expert; Rohde & Schwarz; Germany
• Miguel Roman; Testing and AI Expert; Rohde & Schwarz; Germany
• Benoit Radier, PhD: Orange: Standardization & Technical Expert; TC INT AFI WG 5 PoC Steering Committee Member; France
• Said Soulhi, PhD:  Verizon: Technical Expert and Solutions Design Architect & Standardization Expert; PoC Steering Committee Member
• Muslim Elkotob, PhD: Vodafone: Technical Expert and Solutions Design Architect & Standardization Expert; Germany