Performance Testing of 5G Systems for Industrial Automation

How do I find out whether a 5G system is really suitable for my application? The answer is analyse the 5G systems performance from the application’s point of view by subjecting it to (stress) performance tests. This white paper explains what aspects to be aware of and what to consider when preparing and conducting performance tests.

Intro

Executive Summary

Performance testing is key to building trust in a 5G system fulfilling the industrial application’s requirements. It is the basis to analyse a 5G system’s behaviour prior or simultaneously to its deployment in a real-world operative use case. This white paper seeks to show how (stress) performance testing can be achieved. It explains that aspects to be aware of and what to consider when preparing and conducting performance tests from the industrial application’s point of view. Baseline parameters to be described and performance parameters to be measured are defined. The interfacing of testing system and system under test is examined by discussing the reference interface. A universal performance testing concept is presented. Additionally, 5G-ACIA’s testbed endorsement and how these testbeds are aiming to conduct performance tests is shown.

Key messages

Insight and Vision

This white paper explains what aspects to be aware of and what to consider when preparing and conducting performance tests.

Performance tests are organized in test groups consisting of multiple test cases. Each test group aims to investigate a certain feature and thus answer a certain question on the system’s performance. All baseline parameters have to be described carefully for each test case. By this, the measured performance parameters are reproducible and comparable.

During performance tests, the testing system controls the system under test by reproducibly providing the values for the baseline parameters as specified in the test cases. The testing system observes the system under test’s behaviour by measuring its performance parameters based on which the performance is evaluated.

When interfacing the testing system and the system under test, the overall wireless industrial automation system has to be understood. It usually consists of three parts: the production system, the distributed automation system and the wireless communication system. These systems have a complex interdependency which has to be taken into account when preparing performance tests.

Presentation by the experts during the Hannover Fair 2021

conclusion

Retrospect and Outlook

The understanding of the term “Performance testing” differs, although it is commonly used. This white paper explains performance testing from an industrial application’s point of view revealing its unique meaning in this field. The universal approach developed in this white paper is relevant to both suppliers, who seek to state reliable information on their solutions, and to end users, who seek to invest in a suitable solution. It helps both parties to discuss the characteristics of a given communication solution properly by consolidating their understanding. Moreover, the universal approach cannot only be applied to 5G systems, but also to hybrid networks for example consisting of a legacy industrial Ethernet network and a 5G system. Finally, the ideas presented in this paper allow a preview of what will be relevant when discussing the certification of industrial 5G devices.

Download

We have awoken your interest?

Do you want to learn more about this future-oriented topic? Please download or share the 5G-ACIA white paper as a PDF file.

Relevant white papers

5G-ACIA_WP075_NPNs-for-Industrial-Scenarios_240320_A4_thumbnail
NPNs for Industrial Scenarios
Where do you start if you want to start using 5G in your industrial operation? One of the first things...
5G-ACIA_WP063_IndustrialSidelink_Covervisual_blue_1920x1080
Using 5G sidelink in industrial factory applications
The aim of this 5G-ACIA white paper is to identify and understand uses for 5G sidelink in industrial factory and...
5G-ACIA_Whitepaper_CoverGraphics_Requirements_Blue_1920x1080
Key 5G Use Cases and Requirements
5G-ACIA_Whitepaper_CoverGraphics_TrafficModel_Blue_1920x1080
A 5G Traffic Model for Industrial Use Cases
5G-ACIA_Whitepaper_CoverGraphics_Ethernet_Blue_1920x1080
Integration of Industrial Ethernet Networks with 5G Networks
5G-ACIA_Whitepaper_CoverGraphics_Testing_Blue_1920x1080
Selected Testing and Validation Considerations for Industrial Communication with 5G Technologies
5G-ACIA_Whitepaper_CoverGraphics_NonPublicNetwork_Blue_1920x1080
5G Non-Public Networks for Industrial Scenarios
5G-ACIA_Whitepaper_CoverGraphics_5G_2nd_1920x1080_Blue
5G for Connected Industries and Automation (Second Edition)