Benchmarking Methodology Working Group LM. Contreras Internet-Draft J. Rodriguez Intended status: Experimental L. Luque Expires: September 10, 2020 Telefonica March 9, 2020 5G transport network benchmarking draft-contreras-bmwg-5g-01 Abstract New 5G services are starting to be deployed in operational networks, leveraging in a number of novel technologies and architectural concepts. The purpose of this document is to overview the implications of 5G services in transport networks and to provide guidance on bechmarking of the infratructures supporting those services. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on September 10, 2020. Copyright Notice Copyright (c) 2020 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of Contreras, et al. Expires September 10, 2020 [Page 1] Internet-Draft 5G transport network benchmarking March 2020 the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 2. Conventions used in this document . . . . . . . . . . . . . . 2 3. 5G services . . . . . . . . . . . . . . . . . . . . . . . . . 3 4. Benchmarking aspects of transport networks in 5G . . . . . . 3 5. Key Performance Indicators . . . . . . . . . . . . . . . . . 4 5.1. Data Plane KPIs . . . . . . . . . . . . . . . . . . . . . 4 6. Guidance on 5G transport benchmarking . . . . . . . . . . . . 5 7. Security Considerations . . . . . . . . . . . . . . . . . . . 5 8. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 5 9. References . . . . . . . . . . . . . . . . . . . . . . . . . 5 9.1. Normative References . . . . . . . . . . . . . . . . . . 5 9.2. Informative References . . . . . . . . . . . . . . . . . 5 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . 6 Contributors . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 6 1. Introduction 5G services are starting to be introduced in real operational networks. The challenges of 5G are multiple, impacting in different technological areas such as radio access, mobile core and transport network. Refer to [TMV] for a general overview of different aspects impacting 5G technology performance. From all those technological areas, the transport network is the focus of this document. It is important for operators to have a good basis of benchmarking solutions, technologies and architectures before moving them into production. With such aim, this document intends to overview available guidelines to assist on the benchmarking of 5G transport networks, identifying gaps that could require further work and details. As result, it is expected to provide guidance on benchmarking of 5G transport network infrastructures ready for experimentation in lab environments or real deployment in operational networks. 2. Conventions used in this document The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC2119 [RFC2119]. Contreras, et al. Expires September 10, 2020 [Page 2] Internet-Draft 5G transport network benchmarking March 2020 3. 5G services 5G transport networks will need to accommodate different kind of services with very distinct needs and requirements leveraging on the same infrastructure. 5G services can be grouped in three main categories, namely enhanced Mobile Broadband (eMBB), ultra-Reliable and Low Latency Communications (URLLC), and massive Machine Type Communications (mMTC). Each of them presents different inherent characteristics spanning from ultra-low latency to high bandwidth and high reliability. For instance, eMMB services are expected to provide peak bit rates of up to 1 Gbps, uRRLC services will require latencies as lower as below microsecond delays, and mMTC will demand to support up to 100 times the number of current sessions. All these features impose great constraints to the networks deployed today in backhaul and aggregation, in terms of not only network capacity but also in terms of data processing, especially for guaranteeing very low latencies. The impact in the transport network of those challenges is increased by some other additional challenges introduced by the emergence of two new technological paradigms: the network virtualization and the network programmability. In one hand, virtualization will introduce uncertainty on the traffic patterns due to the flexibility and scalability in the deployment traffic sources in the transport network. On the other hand, programmability will potentially enable automated reconfiguration of the transport network which requires coordination mechanisms to avoid misconfigurations. A final consideration is the introduction of the network slicing concept in 5G networks. According to that, the objective is to provide customized and tailored logical networks to different customers, allocating resources for the specific customer service request. With this respect the IETF has initiated the work in transport slicing (see [I-D.nsdt-teas-transport-slice-definition]). 4. Benchmarking aspects of transport networks in 5G The benchmarking aspects of 5G transport networks can be then structured in the following manner: Data plane benchmarking: aspects to consider in data plane benchmarking refer to both hardware capabilities as well as to transport encapsulations. Examples of hardware capabilities are recent developments such as IEEE TSN, and example of encapsulation is SRv6 [I-D.ietf-spring-srv6-network-programming]. Contreras, et al. Expires September 10, 2020 [Page 3] Internet-Draft 5G transport network benchmarking March 2020 Control plane benchmarking: aspects to consider for control plane relates to transport infrastructure programmability. In this case some previous works exists such as RFC8456 [RFC8456]. Management plane benchmarking: one specific aspect of management benchmarking in 5G refers to the capability of managing the transport network slice lifecycle. Architecture benchmarking: new architectural frameworks are being conceived to support advanced services like 5G. An example of these architectures is [I-D.ietf-detnet-architecture]. 5. Key Performance Indicators In order to define benchmarking criteria it is convenient to formalize Key Performance Indicators (KPIs) to assist on the assessment of the performance of the technologies under analysis. 5.1. Data Plane KPIs Data Plane KPIs will help to predict data plane performance under different measurement conditions. Existing metrics to consider are: o Bandwidth, considered as the maximum achievable throughput between two points. Those points can represent the ingress and egress ports of a equipment (e.g., to determine maximum throughput ofg a single element) or to an end-to-end setup. The througput could be differentieted in both directions of the link (i.e., upling and downlink). o Latency, considered as the network delay when transmitting between source and destination endpoints. This can apply to a single box (e.g., delay induced by a router implementing certain technology) or to a network scenario defined by a certain topology. RFC2681 [RFC2681] and RFC7679 [RFC7679] discuss about two-way (i.e., round trip time) and one-way delay metrics, respectively. o Jitter, understood as jitter the observable packet delay variation (PDV) as defined by RFC3393 [RFC3393], which is measured by the difference in the one-way. o Other general data-plane related issues affected for the usage of specific data plane technologies and/or encapsulations, such as MTU size, etc. o Other data-plane related issues specific to 5G such as e.g. the capability of isolation, understood as the avoidance of interference (i.e., affection) of traffic from different users in Contreras, et al. Expires September 10, 2020 [Page 4] Internet-Draft 5G transport network benchmarking March 2020 case of one of those user misbehaves or consumes more resources than expected. 6. Guidance on 5G transport benchmarking To be completed. 7. Security Considerations This draft does not include any security considerations. 8. IANA Considerations This draft does not include any IANA considerations 9. References 9.1. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, . 9.2. Informative References [I-D.ietf-detnet-architecture] Finn, N., Thubert, P., Varga, B., and J. Farkas, "Deterministic Networking Architecture", draft-ietf- detnet-architecture-13 (work in progress), May 2019. [I-D.ietf-spring-srv6-network-programming] Filsfils, C., Camarillo, P., Leddy, J., Voyer, D., Matsushima, S., and Z. Li, "SRv6 Network Programming", draft-ietf-spring-srv6-network-programming-12 (work in progress), March 2020. [I-D.nsdt-teas-transport-slice-definition] Rokui, R., Homma, S., and K. Makhijani, "IETF Definition of Transport Slice", draft-nsdt-teas-transport-slice- definition-00 (work in progress), November 2019. [RFC2681] Almes, G., Kalidindi, S., and M. Zekauskas, "A Round-trip Delay Metric for IPPM", RFC 2681, DOI 10.17487/RFC2681, September 1999, . Contreras, et al. Expires September 10, 2020 [Page 5] Internet-Draft 5G transport network benchmarking March 2020 [RFC3393] Demichelis, C. and P. Chimento, "IP Packet Delay Variation Metric for IP Performance Metrics (IPPM)", RFC 3393, DOI 10.17487/RFC3393, November 2002, . [RFC7679] Almes, G., Kalidindi, S., Zekauskas, M., and A. Morton, Ed., "A One-Way Delay Metric for IP Performance Metrics (IPPM)", STD 81, RFC 7679, DOI 10.17487/RFC7679, January 2016, . [RFC8456] Bhuvaneswaran, V., Basil, A., Tassinari, M., Manral, V., and S. Banks, "Benchmarking Methodology for Software- Defined Networking (SDN) Controller Performance", RFC 8456, DOI 10.17487/RFC8456, October 2018, . [TMV] "Validating 5G Technology Performance", 5G PPP TMV WG white paper , June 2019. Acknowledgments This work has been partly funded by the European Commission through the H2020 project 5G-EVE (Grant Agreement no. 815074). Contributors A. Lopez and D. Artunedo (both from Telefonica) have also contributed to this document from their work in 5GENESIS project. Authors' Addresses Luis M. Contreras Telefonica Ronda de la Comunicacion, s/n Sur-3 building, 3rd floor Madrid 28050 Spain Email: luismiguel.contrerasmurillo@telefonica.com URI: http://lmcontreras.com/ Contreras, et al. Expires September 10, 2020 [Page 6] Internet-Draft 5G transport network benchmarking March 2020 Juan Rodriguez Telefonica Zurbaran, 12 Madrid 28010 Spain Email: juan.rodriguezmartinez@telefonica.com Lourdes Luque Telefonica Zurbaran, 12 Madrid 28010 Spain Email: lourdes.luquecanto@telefonica.com Contreras, et al. Expires September 10, 2020 [Page 7]