NVO3 Working Group X. Min Internet-Draft G. Mirsky Intended status: Standards Track ZTE Corp. Expires: May 5, 2020 S. Pallagatti VMware November 2, 2019 Performance Measurement for Geneve draft-xiao-nvo3-pm-geneve-00 Abstract This document describes the method to achieve Performance Measurement (PM) in point-to-point Generic Network Virtualization Encapsulation (Geneve) tunnels that form an overlay network. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on May 5, 2020. Copyright Notice Copyright (c) 2019 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Simplified BSD License. Min, et al. Expires May 5, 2020 [Page 1] Internet-Draft PM for Geneve November 2019 Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 2 2. Conventions Used in This Document . . . . . . . . . . . . . . 2 2.1. Terminology . . . . . . . . . . . . . . . . . . . . . . . 2 2.2. Requirements Language . . . . . . . . . . . . . . . . . . 3 3. PM Packet Transmission over Geneve Tunnel . . . . . . . . . . 3 3.1. PM Encapsulation With Inner Ethernet/IP/UDP Headers . . . 3 3.2. PM Encapsulation With Inner IP/UDP Headers . . . . . . . 5 3.3. PM Encapsulation With Inner MPLS Header . . . . . . . . . 7 4. Reception of PM packet from Geneve Tunnel . . . . . . . . . . 9 4.1. Demultiplexing of the PM packet . . . . . . . . . . . . . 9 5. Security Considerations . . . . . . . . . . . . . . . . . . . 10 6. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 10 7. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . 10 8. Normative References . . . . . . . . . . . . . . . . . . . . 10 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 11 1. Introduction "Generic Network Virtualization Encapsulation" (Geneve) [I-D.ietf-nvo3-geneve] provides an encapsulation scheme that allows building an overlay network by decoupling the address space of the attached virtual hosts from that of the network. This document describes the use of Packet Loss and Delay Measurement for MPLS Networks [RFC6374], as well as Simple Two-way Active Measurement Protocol [I-D.ietf-ippm-stamp], to enable measuring the performance of the path between two Geneve tunnel endpoints. In this document, NVE (Network Virtualization Edge) represents a Geneve tunnel endpoint, TS (Tenant System) represents a physical or virtual device attached to a Geneve tunnel endpoint, and VAP (Virtual Access Point) represents the NVE side of the interface between the NVE and the TS. 2. Conventions Used in This Document 2.1. Terminology GAL: Generic Associated Channel Label G-ACh: Generic Associated Channel Geneve: Generic Network Virtualization Encapsulation MPLS: Multiprotocol Label Switching Min, et al. Expires May 5, 2020 [Page 2] Internet-Draft PM for Geneve November 2019 NVE: Network Virtualization Edge PM: Performance Measurement STAMP: Simple Two-way Active Measurement Protocol TS: Tenant System VAP: Virtual Access Point VNI: Virtual Network Identifier 2.2. Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. 3. PM Packet Transmission over Geneve Tunnel Analogous to what's specified in Section 3 of [I-D.xiao-nvo3-bfd-geneve], this document considers three options of PM packet encapsulation in Geneve: o with Ethernet and IP/UDP encapsulation; o with IP/UDP encapsulation; o with MPLS encapsulation. 3.1. PM Encapsulation With Inner Ethernet/IP/UDP Headers If the Protocol Type field (as defined in Section 3.4 of [I-D.ietf-nvo3-geneve]) of data packets indicates that an inner Ethernet header immediately follows the Geneve header, i.e., the Protocol Type equals to 0x6558 (Ethernet frame), then PM packets are encapsulated in Geneve as described below. Min, et al. Expires May 5, 2020 [Page 3] Internet-Draft PM for Geneve November 2019 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer Ethernet Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer IPvX Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer UDP Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Geneve Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Inner Ethernet Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Inner IPvX Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Inner UDP Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ STAMP Test Packet ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | FCS | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 1: Geneve Encapsulation of PM Message With the Inner Ethernet/IP/UDP Header The STAMP test packet MUST be carried inside the inner Ethernet frame of the Geneve packet, immediately after the inner IP/UDP headers. The inner Ethernet frame carrying the STAMP Test Packet has the following format: Min, et al. Expires May 5, 2020 [Page 4] Internet-Draft PM for Geneve November 2019 The Ethernet header and IP header are encoded as specified in Section 4 of [I-D.ietf-bfd-vxlan]. The destination UDP port MUST be set the well-known port 862 as defined in [I-D.ietf-ippm-stamp]. The STAMP Test Packet SHOULD be unauthenticated STAMP Session-Sender test packet or unauthenticated STAMP Session-Reflector test packet. The STAMP Test Packet is encoded as specified in [I-D.ietf-ippm-stamp] and [I-D.ietf-ippm-stamp-option-tlv]. If the PM packets are encapsulated in Geneve as described above, the values in the Geneve header are set as follows: 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |Ver| Opt Len |O|C| Rsvd. | Protocol Type | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Virtual Network Identifier (VNI) | Reserved | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Variable Length Options | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 2: Geneve Header Opt Len field MUST be set to 0 to indicate that the header does not include any variable-length options. O bit MUST be set to 1, which indicates this packet contains a control message. C bit MUST be set to 0. Protocol Type field MUST be set to 0x6558 (Ethernet frame). 3.2. PM Encapsulation With Inner IP/UDP Headers If the Protocol Type field (as defined in Section 3.4 of [I-D.ietf-nvo3-geneve]) of data packets indicates that an inner IP header immediately follows the Geneve header, i.e., the Protocol Type equals to 0x0800 (IPv4) or 0x86DD (IPv6), then PM packets are encapsulated in Geneve as described below. Min, et al. Expires May 5, 2020 [Page 5] Internet-Draft PM for Geneve November 2019 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer Ethernet Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer IPvX Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer UDP Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Geneve Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Inner IPvX Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Inner UDP Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ STAMP Test Packet ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | FCS | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 3: Geneve Encapsulation of PM Message With the Inner IP/UDP Header A STAMP test packet MUST be carried inside the inner IP/UDP packet that immediately follows the Geneve header. The values in the inner IP packet carrying the STAMP Test Packet are as follows: The IP header is encoded as specified in Section 3.2 of [I-D.xiao-nvo3-bfd-geneve]. The destination UDP port MUST be set the well-known port 862 as defined in [I-D.ietf-ippm-stamp]. Min, et al. Expires May 5, 2020 [Page 6] Internet-Draft PM for Geneve November 2019 The STAMP Test Packet SHOULD be unauthenticated STAMP Session-Sender test packet or unauthenticated STAMP Session-Reflector test packet. The STAMP Test Packet is encoded as specified in [I-D.ietf-ippm-stamp] and [I-D.ietf-ippm-stamp-option-tlv]. When the PM packets are encapsulated in Geneve in this way, the Geneve header follows the value set below. Opt Len field MUST be set to 0 to indicate there isn't any variable-length option. O bit MUST be set to 1, which indicates this packet contains a control message. C bit MUST be set to 0. Protocol Type field MUST be set to 0x0800 (IPv4) or 0x86DD (IPv6), depending on the address family of the inner IP packet. 3.3. PM Encapsulation With Inner MPLS Header If the Protocol Type field (as defined in Section 3.4 of [I-D.ietf-nvo3-geneve]) of data packets indicates that an MPLS label stack immediately follows the Geneve header, i.e., the Protocol Type equals to 0x8847 (MPLS) or 0x8848 (MPLS with the upstream-assigned label), then PM packets are encapsulated in Geneve, as described below. Min, et al. Expires May 5, 2020 [Page 7] Internet-Draft PM for Geneve November 2019 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer Ethernet Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer IPvX Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Outer UDP Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | | ~ Geneve Header ~ | | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | MPLS Interface Context Label | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | MPLS GAL | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | MPLS G-ACh | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Loss Measurement Message, | ~ Delay Measurement Message, or ~ | Combined Loss/Delay Measurement Message | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | FCS | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ Figure 4: Geneve Encapsulation of PM Message With the Inner MPLS GAL/ G-ACh The Loss Measurement Message, Delay Measurement Message, or Combined Loss/Delay Measurement Message MUST be carried inside the inner MPLS packet that immediately follows the Geneve header. The values in the inner MPLS packet carrying the Loss Measurement Message, Delay Measurement Message, or Combined Loss/Delay Measurement Message are as follows: The MPLS Interface Context Label and the MPLS GAL (Generic Associated Channel Label) are encoded as specified in Section 3.3 of [I-D.xiao-nvo3-bfd-geneve]. Min, et al. Expires May 5, 2020 [Page 8] Internet-Draft PM for Geneve November 2019 The MPLS G-ACh (Generic Associated Channel) is encoded as specified in [RFC5586], and the "Channel Type" field of MPLS G-ACh MUST be set to 0x000A, 0x000C or 0x000D requested by [RFC6374], respectively indicating "MPLS Direct Loss Measurement", "MPLS Delay Measurement" or "MPLS Direct Loss and Delay Measurement". The Loss Measurement Message, Delay Measurement Message, and Combined Loss/Delay Measurement Message are encoded as specified in Sections 3.1 through 3.3 of [RFC6374]. When the PM packets are encapsulated in Geneve in this way, the Geneve header follows the value set below. Opt Len field MUST be set to 0 to indicate there isn't any variable-length option. O bit MUST be set to 1, which indicates this packet contains a control message. C bit MUST be set to 0. Protocol Type field MUST be set to 0x8847 (MPLS). 4. Reception of PM packet from Geneve Tunnel Once a packet is received, NVE MUST validate the packet as described in [I-D.ietf-nvo3-geneve] and Section 4 of [I-D.xiao-nvo3-bfd-geneve]. 4.1. Demultiplexing of the PM packet Similar to BFD over Geneve, multiple PM sessions may be running between two NVEs, so there needs to be a mechanism for demultiplexing received PM packets to the proper session. If the PM packet is received with Session Identifier value equals to 0, for different PM encapsulation, the procedure for demultiplexing the received PM packets is different, which would follow the procedure for a BFD packet with Your Discriminator equals to 0, as specified in Section 4.1 of [I-D.xiao-nvo3-bfd-geneve]. If the PM packet is received with a non-zero Session Identifier, then PM session MUST be demultiplexed only with Session Identifier as the key. With respect to PM for Geneve, the use of the specific VNI would follow the principle as specified in Section 4.1 of [I-D.xiao-nvo3-bfd-geneve]. Min, et al. Expires May 5, 2020 [Page 9] Internet-Draft PM for Geneve November 2019 5. Security Considerations This document does not raise any additional security issues beyond those of the specifications referred to in the list of normative references. 6. IANA Considerations This document has no IANA action requested. 7. Acknowledgements TBA. 8. Normative References [I-D.ietf-bfd-vxlan] Networks, J., Paragiri, S., Govindan, V., Mudigonda, M., and G. Mirsky, "BFD for VXLAN", draft-ietf-bfd-vxlan-07 (work in progress), May 2019. [I-D.ietf-ippm-stamp] Mirsky, G., Jun, G., Nydell, H., and R. Foote, "Simple Two-way Active Measurement Protocol", draft-ietf-ippm- stamp-09 (work in progress), October 2019. [I-D.ietf-ippm-stamp-option-tlv] Mirsky, G., Xiao, M., Nydell, H., Foote, R., Masputra, A., and E. Ruffini, "Simple Two-way Active Measurement Protocol Optional Extensions", draft-ietf-ippm-stamp- option-tlv-02 (work in progress), October 2019. [I-D.ietf-nvo3-geneve] Gross, J., Ganga, I., and T. Sridhar, "Geneve: Generic Network Virtualization Encapsulation", draft-ietf- nvo3-geneve-14 (work in progress), September 2019. [I-D.xiao-nvo3-bfd-geneve] Xiao, M., Mirsky, G., and J. Networks, "BFD for Geneve", draft-xiao-nvo3-bfd-geneve-01 (work in progress), October 2019. [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, . Min, et al. Expires May 5, 2020 [Page 10] Internet-Draft PM for Geneve November 2019 [RFC5586] Bocci, M., Ed., Vigoureux, M., Ed., and S. Bryant, Ed., "MPLS Generic Associated Channel", RFC 5586, DOI 10.17487/RFC5586, June 2009, . [RFC6374] Frost, D. and S. Bryant, "Packet Loss and Delay Measurement for MPLS Networks", RFC 6374, DOI 10.17487/RFC6374, September 2011, . [RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, . Authors' Addresses Xiao Min ZTE Corp. Nanjing China Phone: +86 25 88013062 Email: xiao.min2@zte.com.cn Greg Mirsky ZTE Corp. USA Email: gregimirsky@gmail.com Santosh Pallagatti VMware Email: santosh.pallagatti@gmail.com Min, et al. Expires May 5, 2020 [Page 11]