Performance Testing of 5G Systems for Industrial Automation

How do I find out whether a 5G system is really suitable for my application? The answer is analyse the 5G systems performance from the application’s point of view by subjecting it to (stress) performance tests. This white paper explains what aspects to be aware of and what to consider when preparing and conducting performance tests.


Executive Summary

Performance testing is key to building trust in a 5G system fulfilling the industrial application’s requirements. It is the basis to analyse a 5G system’s behaviour prior or simultaneously to its deployment in a real-world operative use case. This white paper seeks to show how (stress) performance testing can be achieved. It explains that aspects to be aware of and what to consider when preparing and conducting performance tests from the industrial application’s point of view. Baseline parameters to be described and performance parameters to be measured are defined. The interfacing of testing system and system under test is examined by discussing the reference interface. A universal performance testing concept is presented. Additionally, 5G-ACIA’s testbed endorsement and how these testbeds are aiming to conduct performance tests is shown.

Key messages

Insight and Vision

This white paper explains what aspects to be aware of and what to consider when preparing and conducting performance tests.

Performance tests are organized in test groups consisting of multiple test cases. Each test group aims to investigate a certain feature and thus answer a certain question on the system’s performance. All baseline parameters have to be described carefully for each test case. By this, the measured performance parameters are reproducible and comparable.

During performance tests, the testing system controls the system under test by reproducibly providing the values for the baseline parameters as specified in the test cases. The testing system observes the system under test’s behaviour by measuring its performance parameters based on which the performance is evaluated.

When interfacing the testing system and the system under test, the overall wireless industrial automation system has to be understood. It usually consists of three parts: the production system, the distributed automation system and the wireless communication system. These systems have a complex interdependency which has to be taken into account when preparing performance tests.

Presentation by the experts during the Hannover Fair 2021

Play Video


Retrospect and Outlook

The understanding of the term “Performance testing” differs, although it is commonly used. This white paper explains performance testing from an industrial application’s point of view revealing its unique meaning in this field. The universal approach developed in this white paper is relevant to both suppliers, who seek to state reliable information on their solutions, and to end users, who seek to invest in a suitable solution. It helps both parties to discuss the characteristics of a given communication solution properly by consolidating their understanding. Moreover, the universal approach cannot only be applied to 5G systems, but also to hybrid networks for example consisting of a legacy industrial Ethernet network and a 5G system. Finally, the ideas presented in this paper allow a preview of what will be relevant when discussing the certification of industrial 5G devices.

We have awoken your interest?

Do you want to learn more about this future-oriented topic? Please download or share the 5G-ACIA white paper as a PDF file.

Industrial 5G Edge Computing – Use Cases, Architecture and Deployment
5G edge computing provides reliable, low-latency communication and data processing on enterprise premises enabling many future industrial use cases. The architecture of such networks is made from standard components and their deployment is flexible to fit different use cases...
Industrial 5G Devices – Architecture and Capabilities
5G enables reliable, low-latency, high-bandwidth data transmission, making it a key technology for the future of industrial communications. The introduction of 5G to factories and a wide range of other industrial facilities is also creating a need for industrial devices that support the 5G standard....
abstracted constructor with tablet in his hand
5G QoS for Industrial Automation
Distributed industrial applications rely on the quality of service (QoS) of the underlying communications system, which has to meet the application requirements in each case. Some industrial use cases pose highly demanding communication requirements and are therefore quite sensitive to any changes in the QoS. 5G supports comprehensive mechanisms for defining, implementing, controlling, policing, and monitoring QoS. These mechanisms cover both dynamic QoS management for packet-level traffic differentiation within a single-device connection and management of the overall performance of 5G networks. This white paper addresses industrial automation professionals wishing to leverage 5G QoS features in their applications....

Share the content