Virtual event The 8th edition of UCAAT, the User Conference on Advanced Automated Testing took place virtually in October 2021.
UCAAT 2021: Testing to the Edge
Test process automation has proven to increase productivity and product quality. As the COVID-19 pandemic has shifted and increased the demands on various IT systems and services in terms of interoperability, scalability, and adaptability, test automation is essential for delivering agile solutions in uncertain times. Sharing knowledge and learning from experience of others helps everyone to get better prepared for future challenges.
The annual ETSI User Conference on Advanced Automated Testing (UCAAT) is the pinnacle in the calendar of ETSI’s Technical Committee Methods for Testing and Specification (TC MTS).
Overview
UCAAT is dedicated to the practical engineering and application aspects of automated testing, including experiences from the use of new techniques for test automation, advanced test automation processes, and standardised testing languages and methodologies for test automation in different application domains, such as IT services, telecommunications, transportation, healthcare, finance, and smart cities.
Target audience
The event is of particular interest for:
- Test engineer, designer or test automation expert
- Engineer working in test specification, automation, DevOps and RPA
- Software developer or architect
- Project leader or manager in digital transformation
- Test tool or service provider
- Test and quality assurance analyst
… then UCAAT 2021 provided a unique opportunity to get together with your peers and exchange on experiences gained and lessons learned, both from the adoption of novel test automation techniques, methods, and tools and from the long-term application of test automation.
Watch the trailers...
UCAAT 2021 AGENDA (19-21 October).
The detailed programme of the event is provided below. Times indicated are Central European Summer Time (CEST).
- 19 October: Pre-Conference Tutorial Day
PRE-CONFERENCE TUTORIAL DAY
- 08.55 am - 09.00 am: Opening Address
Philip Makedonski (Programme Committee Chair, University of Göttingen) - 09.00 am - 10.00 am: Session 1 - Followed by a Live Q&A - Model-Based Testing (MBT) of Web and Mobile Applications: A Practical Tutorial
Vahid Garousi (Software Engineering Consulting), Alper Buğra Keleş (Testinium) - 10.00 am - 10.30 am: Networking Break: Connect With Your Peers Via The Meeting Hub
- 10.30 am - 11.30 am: Session 2 - Live Workshop - Let's build a Continuous Quality Assurance Strategy around your CI/CD Pipelines
Szilárd Széll (Eficode Oy) - 11.30 am - 01.00 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
- 01:00 pm - 02:00 pm: Session 3 - Autonomous Real-time Testing
Thomas Fehlmann (Euro Project Office AG) - 02.00 am - 02.15 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
- 02:15 pm - 03:15 pm: Session 4 - A Practical Approach of ‘Standard to Validation’ Methodology
Yann Garcia (FSCOM) - 03:15 pm - 04:00 pm: Panel Discussion and Q&A
Moderators: Stephan Schulz (Giesecke + Devrient) and Rémi Caudwell (Sogeti) – Panellists: Vahid Garousi, Alper Buğra Keleş, Szilárd Széll, Thomas Fehlmann, Yann Garcia
- 08.55 am - 09.00 am: Opening Address
- 20 October
OPENING and KEYNOTE
- 09:00 am - 09:20 am: Conference Opening presented by Luis Jorge Romero, ETSI followed by Philip Makedonski (Programme Committee Chair, University of Göttingen) and Dirk Tepelmann (ETSI MTS Chair) Luis Jorge Romero (ETSI Director General), Philip Makedonski (Programme Committee Chair, University of Göttingen) and Dirk Tepelmann (ETSI MTS Chair)
- 09:20 am - 10:00 am: Keynote followed by a Live Q&A - Testing at the Edge of Reality - Virtual Prototyping and Opportunities for Test Automation: Virtual Prototyping is essential for many development processes. It is used on the whole scale from simple visualizations of concepts to automated testing of complex machinery. The processes may cover robustness tests of individual components, integration tests to evaluate construction issues, and system tests to assess potential issues at runtime. One important focus for every machinery is the user interface. With virtual prototypes, we can transfer established standards from usability engineering and user experience design to designing user interfaces of technical devices. This includes enhanced prototyping, remote evaluation and even static testing of design concepts. In this talk, we will have a look at the opportunities for testing and evaluating user interfaces of technical devices and larger machinery and we will briefly introduce a framework for efficient creation and evaluation of virtual prototypes.
Prof. Dr. Patrick Harms (Nürnberg Institute of Technology) - 10:00 am - 10:15 am: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: 5G and Networks
- 10:15 am - 10:35 am: Automated OTA Testing Needs and Challenges for 5G Devices
Heinz Mellein (Rohde & Schwarz GmbH & Co.KG) - 10:35 am - 10:55 am: How to Design a Cloud-Native Deployment and Test Pipeline for 5G
Szilárd Széll (Eficode Oy) - 10:55 am - 11:15 am: Containerized Setup for Performance Tests of Communication Networks
Valentin Egger (Carinthia University of Applied Sciences) - 11:15 am - 11:30 am: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: AI and Regression Testing
- 11:30 am - 11:50 am: Generate Automated Regression Tests from Execution Traces
Bruno Legeard (Smartesting) - 11:50 am - 12:10 pm: ETSI Standardization Perspectives on AI in Testing and Testing of AI-Enabled Systems
Andreas Ulrich (Siemens), Muslim Elkotob (Vodafone, IPv6 Forum) and Ranganai Chaparadza (Vodafone, Capgemini Engineering, IPv6 Forum) - 12:10 pm - 12:30 pm: Test Case Selection based on Text Analytics of Software Artifacts
Rajesh Kumar (Siemens) - 12:30 pm - 12:50 pm: Panel Discussion and Q&A
Moderators: Rémi Caudwell (Sogeti) and Ultan Mulligan (ETSI) – Panellists: Heinz Mellein, Szilárd Széll, Valentin Egger, Julien Botella (Smartesting), Ranganai Chaparadza, Muslim Elkotob, Rajesh Kumar - 12.50 pm - 02:00 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: Standards and Security
- 02:00 pm - 02:20 pm: One Platform to Test them All (IoT, NFV or MEC)
Loïc Baron (runningcode.io) - 02:20 pm - 02:40 pm: Integrating Open Sources CyberSecurity Tools into an Automated Testing System
Sergio Borghese (NetResults S.r.l.) - 02:40 pm - 03:00 pm: 3 Things you Have Always Wanted to Know about the Test Description Language
Martti Käärik (Estonia Elvior LLC) - 03:00 pm - 03:15 pm: Panel Discussion and Q&A
Moderators: Martin Schneider (Fraunhofer FOKUS) and Gjore Zaharchev (Seavus) – Panellists: Loïc Baron, Sergio Borghese, Martti Käärik - 03:15 pm - 03:30 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: Model and Process Testing
- 03:30 pm - 03:50 pm: Automatic Testing of Business Processes
Emmanuel Gaudin (PragmaDev) - 03:50 pm - 04:10 pm: TDL-Based Automatic Detection of Interaction Errors
Nader Kesserwan (Robert Morris University) - 04:10 pm - 04:25 pm: Poster Introduction
1- Deployment of Keyword Testing for Vehicle Powertrain HIL Validation: Jean-Marie Quelin (Groupe Renault)
2- A fully Automated Toolchain for Cross Browser UI Tests including AI-powered Reporting: Pascal Koenig (Siemens AG)
3- How to Efficiently test RESTful Microservices with TTCN-3: Theofanis Vassiliou-Gioles (TU Berlin)
4- Automated Conformance Testing of ETSI NFV APIs using Robot Framework: Giacomo Bernini (Nextworks) - 04:25 pm - 05:30 pm: Panel and Poster Discussion
Moderators: Szilárd Széll (Eficode Oy) and Martti Käärik (Estonia Elvior LLC) - Panellists: Emmanuel Gaudin, Nader Kesserwan, Jean-Marie Quelin, Pascal Koenig, Theofanis Vassiliou-Gioles, Giacomo Bernini
- 21 October
- 08:55 am - 09:00 am: Introduction
Philip Makedonski (Programme Committee Chair, University of Göttingen)
KEYNOTE
- 09:00 am - 09:45 am: Keynote followed by a live Q&A - Interoperability in CI/CD and Why it Matters? The emergence of virtualization and cloud-native has resulted in tremendous advances in the telecommunications industry, speeding up the introduction of new services and CI/CD is one of the prerequisites and enablers of success. Despite its many advantages, the CI/CD ecosystem has its challenges and interoperability is one of them. This session will discuss issues arising from the lack of interoperability across proliferating CI/CD technologies and what open source communities are doing to address them in a collaborative manner. We will also highlight the necessity, and greater sustainability, of a holistic approach to interoperability in the CI/CD ecosystem and invite attendees to join community efforts.
Fatih Degirmenci (Ericsson Software Technology) - 09:45 am - 10:15 am: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: Model-Based Testing
- 10:15 am - 10:35 am: Using Tabular Notation to Support Model-Based Testing Rachid Kherrazi (Akka Technologies)
- 10:35 am - 10:55 am: Traceability Links among UCM, TDL and TTCN-3 Nader Kesserwan (Robert Morris University)
- 10:55 am - 11:15 am: Evidence-Based Guidelines for Model-Based Testing: An Empirical Study
Tomas Helmfridsson (Add Q), Emil Alégroth (Blekinge Institute of Technology) - 11:15 am - 11:30 am: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: Methodology
- 11:30 am - 11:50 am: 4 Pillars of Successful Agile Test Automation
Mesut Durukal (Rapyuta Robotics) - 11:50 am - 12:10 am: Methodology for RESTful APIs Specifications and Testing
Sana Zulfiqar (Flow Research Inc.), Michele Carignani (ETSI) - Philip Makedonski (Programme Committee Chair, University of Göttingen), and Martti Käärik (Estonia Elvior LLC) - 12:10 pm - 12:30 pm: Flow Model vs Page Object Pattern
Péter Földházi (EPAM Systems USA) - 12:30 pm - 12:50 pm: Panel Discussion and Q&A
Moderators: Zhen Ru Dai (Hamburg University of Applied Sciences) and Stephan Schulz (Giesecke + Devrient) – Panellists: Rachid Kherrazi, Nader Kesserwan, Emil Alégroth, Mesut Durukal, Sana Zulfiqar, Péter Földházi - 12:50 pm - 02:00 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: AI
- 02:00 pm - 02:20 pm: Using ComputerVision and Machine Learning to Measure No Reference Video Streaming Quality
Stefano Aru (NetResults Srl) - 02:20 pm - 02:40 pm: Using AI to Prioritize Static Analysis Findings
Rix Groenboom (Parasoft Netherlands BV) - 02:40 pm - 03:00 pm: Evolution & Future of Software Testing
Mesut Durukal (Rapyuta Robotics) - 03:00 pm - 03:15 pm: Networking Break: Connect With Your Peers Via The Meeting Hub
SESSION: Model Verification and Simulation
- 03:15 pm - 03:35 pm: A Framework for Cloud-based Testing of Multi-variant Cyber-physical Systems
Niels Hoppe (Fraunhofer) - 03:35 pm - 03:55 pm: Basic Test Set - Testing PSI5 Interfaces Made Easy
Anna Neumann (iSyst Intelligente Systeme GmbH) - 03:55 pm - 04:15 pm: Panel Discussion and Q&A
Moderators: Andreas Ulrich (Siemens AG) and Martin Schneider (Fraunhofer FOKUS) – Panellists: Stefano Aru, Rix Groenboom, Mesut Durukal, Niels Hoppe, Anna Neumann
Conference Closing and Best Presentation Award
- 04:15 pm - 04:30 pm: Conference Closing and Best Presentation Award
Philip Makedonski (Programme Committee Chair, University of Göttingen)
- 08:55 am - 09:00 am: Introduction
The independent programme committee is composed mostly of industry stakeholders nominated by the appointed Programme Committee Chair. The programme committee determines the call for presentations and evaluates the received presentation, poster, and tutorial proposals to select the best ones for the conference programme.
Programme Committee Chair:
- Philip Makedonski, University of Göttingen
Programme Committee Members:
- Alexis Despeyroux, Testing Solutions and Services
- Andreas Ulrich, Siemens AG
- Anne Kramer, sepp.med GmbH
- Carlos Cardenas, DEKRA Testing and Certification, S.A.U
- Ceren Şahin, University of Luxembourg
- Dirk Tepelmann, Spirent
- Gjore Zaharchev, Seavus
- Jorge Asensio, ARHS Developments
- Jorge Pascal, Audi AG
- Mark Beierl, Canonical Ltd
- Martin Schneider, Fraunhofer FOKUS
- Martti Käärik Elvior, LLC
- Michele Carignani, ETSI
- Muslim Elkotob, Vodafone
- Pierre Lynch, Keysight
- Raquel Jimenez, MTP
- Rémi Caudwell, Sogeti
- Sergio Borghese, NetResults Srl
- Stephan Schulz, Giesecke + Devrient
- Szilard Szell, Eficode Oy
- Tibor Csöndes, Ericsson Hungary
- Václav Vidoň, Kiwi.com
- Zhen Ru Dai, Hamburg University of Applied Sciences (HAW)
UCAAT is an established series of annual events. Previous editions of the UCAAT have focused on different aspects of test automation following emerging trends through the years. Information about previous editions of the UCAAT, including the programmes and presentation slides, are available from the archived websites linked below. Browse through the archives and discover past experiences shared at UCAAT!
- UCAAT 2020 (cancelled)
- UCAAT 2019
- UCAAT 2018
- UCAAT 2017
- UCAAT 2016
- UCAAT 2015
- UCAAT 2014
- UCAAT 2013