Network Working Group S. McGlashan Internet-Draft Hewlett-Packard Intended status: Standards Track T. Melanchuk Expires: May 29, 2010 Rain Willow Communications C. Boulton NS-Technologies November 25, 2009 A Mixer Control Package for the Media Control Channel Framework draft-ietf-mediactrl-mixer-control-package-08 Abstract This document defines a Media Control Channel Framework Package for managing mixers for media conferences and connections. The package defines request elements for managing conference mixers, managing mixers between conferences and/or connections, as well as associated responses and notifications. The package also defines elements for auditing package capabilities and mixers. Status of this Memo This Internet-Draft is submitted to IETF in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents as Internet- Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." The list of current Internet-Drafts can be accessed at http://www.ietf.org/ietf/1id-abstracts.txt. The list of Internet-Draft Shadow Directories can be accessed at http://www.ietf.org/shadow.html. This Internet-Draft will expire on May 29, 2010. Copyright Notice Copyright (c) 2009 IETF Trust and the persons identified as the document authors. All rights reserved. McGlashan, et al. Expires May 29, 2010 [Page 1] Internet-Draft Mixer Control Package November 2009 This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (http://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Simplified BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the BSD License. This document may contain material from IETF Documents or IETF Contributions published or made publicly available before November 10, 2008. The person(s) controlling the copyright in some of this material may not have granted the IETF Trust the right to allow modifications of such material outside the IETF Standards Process. Without obtaining an adequate license from the person(s) controlling the copyright in such materials, this document may not be modified outside the IETF Standards Process, and derivative works of it may not be created outside the IETF Standards Process, except to format it for publication as an RFC or to translate it into languages other than English. McGlashan, et al. Expires May 29, 2010 [Page 2] Internet-Draft Mixer Control Package November 2009 Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 4 2. Conventions and Terminology . . . . . . . . . . . . . . . . . 6 3. Control Package Definition . . . . . . . . . . . . . . . . . 7 3.1. Control Package Name . . . . . . . . . . . . . . . . . . 7 3.2. Framework Message Usage . . . . . . . . . . . . . . . . . 7 3.3. Common XML Support . . . . . . . . . . . . . . . . . . . 8 3.4. CONTROL Message Body . . . . . . . . . . . . . . . . . . 8 3.5. REPORT Message Body . . . . . . . . . . . . . . . . . . . 8 3.6. Audit . . . . . . . . . . . . . . . . . . . . . . . . . . 9 3.7. Examples . . . . . . . . . . . . . . . . . . . . . . . . 9 4. Element Definitions . . . . . . . . . . . . . . . . . . . . . 10 4.1. . . . . . . . . . . . . . . . . . . . . . . . 10 4.2. Mixer Elements . . . . . . . . . . . . . . . . . . . . . 11 4.2.1. Conference Elements . . . . . . . . . . . . . . . . . 12 4.2.1.1. . . . . . . . . . . . . . . . 12 4.2.1.2. . . . . . . . . . . . . . . . 15 4.2.1.3. . . . . . . . . . . . . . . . 16 4.2.1.4. Conference Configuration . . . . . . . . . . . . 17 4.2.1.4.1. . . . . . . . . . . . . . . . 17 4.2.1.4.2. . . . . . . . . . . . . . . . 17 4.2.1.4.2.1. . . . . . . . . . . . . . 19 4.2.1.4.3. . . . . . . . . . . . . . . . 24 4.2.1.4.3.1. Priority assignment . . . . . . . . . . . 26 4.2.1.4.4. . . . . . . . . . . . . . . . . . 27 4.2.1.4.4.1. . . . . . . . . . . 27 4.2.2. Joining Elements . . . . . . . . . . . . . . . . . . 27 4.2.2.1. Joining Model . . . . . . . . . . . . . . . . . . 27 4.2.2.2. . . . . . . . . . . . . . . . . . . . . . 29 4.2.2.3. . . . . . . . . . . . . . . . . . . 31 4.2.2.4. . . . . . . . . . . . . . . . . . . . . 34 4.2.2.5. . . . . . . . . . . . . . . . . . . . . 35 4.2.2.5.1. . . . . . . . . . . . . . . . . . . 37 4.2.2.5.2. . . . . . . . . . . . . . . . . . . . 37 4.2.2.5.3. . . . . . . . . . . . . . . . . . . 37 4.2.2.5.4. . . . . . . . . . . . . . . . . . 38 4.2.3. . . . . . . . . . . . . . . . . . . . . . 38 4.2.4. . . . . . . . . . . . . . . . . . . . . . . . 39 4.2.4.1. . . . . . . . . . . . . . 39 4.2.4.1.1. . . . . . . . . . . . . . . . 39 4.2.4.2. . . . . . . . . . . . . . . . . . 40 4.2.4.3. . . . . . . . . . . . . . . . . 41 4.3. Audit Elements . . . . . . . . . . . . . . . . . . . . . 42 4.3.1. . . . . . . . . . . . . . . . . . . . . . . . 42 4.3.2. . . . . . . . . . . . . . . . . . . . 44 4.3.2.1. . . . . . . . . . . . . . . . . . 45 4.3.2.2. . . . . . . . . . . . . . . . . . . . . 46 McGlashan, et al. Expires May 29, 2010 [Page 3] Internet-Draft Mixer Control Package November 2009 4.3.2.2.1. . . . . . . . . . . . . . . 46 4.3.2.2.1.1. . . . . . . . . . . . . . 47 4.3.2.2.1.1.1. . . . . . . . . . . . . 47 4.3.2.2.2. . . . . . . . . . . . . . . . . . 48 4.4. . . . . . . . . . . . . . . . . . . . . . . . . 48 4.4.1. . . . . . . . . . . . . . . . . . . . . . . . 49 4.4.1.1. . . . . . . . . . . . . . . . . . . . . 50 4.4.1.2. . . . . . . . . . . . . . . . . . . . . 50 4.4.1.2.1. . . . . . . . . . . . . . . . . . . . 50 4.5. Response Status Codes . . . . . . . . . . . . . . . . . . 51 4.6. Type Definitions . . . . . . . . . . . . . . . . . . . . 55 5. Formal Syntax . . . . . . . . . . . . . . . . . . . . . . . . 57 6. Examples . . . . . . . . . . . . . . . . . . . . . . . . . . 76 6.1. AS-MS Framework Interaction Examples . . . . . . . . . . 76 6.1.1. Creating a conference mixer and joining a participant . . . . . . . . . . . . . . . . . . . . . 76 6.1.2. Receiving active talker notifications . . . . . . . . 77 6.1.3. Conference termination . . . . . . . . . . . . . . . 77 6.2. Mixing Examples . . . . . . . . . . . . . . . . . . . . . 77 6.2.1. Audio conferencing . . . . . . . . . . . . . . . . . 78 6.2.2. Bridging connections . . . . . . . . . . . . . . . . 80 6.2.3. Video conferencing . . . . . . . . . . . . . . . . . 81 7. Security Considerations . . . . . . . . . . . . . . . . . . . 83 8. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 86 8.1. Control Package Registration . . . . . . . . . . . . . . 86 8.2. URN Sub-Namespace Registration . . . . . . . . . . . . . 86 8.3. XML Schema Registration . . . . . . . . . . . . . . . . . 87 8.4. MIME Media Type Registration for 'application/msc-mixer+xml' . . . . . . . . . . . . . . . 87 9. Change Summary . . . . . . . . . . . . . . . . . . . . . . . 89 10. Contributors . . . . . . . . . . . . . . . . . . . . . . . . 96 11. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 97 12. References . . . . . . . . . . . . . . . . . . . . . . . . . 98 12.1. Normative References . . . . . . . . . . . . . . . . . . 98 12.2. Informative References . . . . . . . . . . . . . . . . . 98 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 100 McGlashan, et al. Expires May 29, 2010 [Page 4] Internet-Draft Mixer Control Package November 2009 1. Introduction The Media Control Channel Framework [I-D.ietf-mediactrl-sip-control-framework] provides a generic approach for establishment and reporting capabilities of remotely initiated commands. The Framework utilizes many functions provided by the Session Initiation Protocol [RFC3261] (SIP) for the rendezvous and establishment of a reliable channel for control interactions. The Control Framework also introduces the concept of a Control Package. A Control Package is an explicit usage of the Control Framework for a particular interaction set. This specification defines a package for media conference mixers and media connection mixers. This package defines mixer management elements for creating, modifying and deleting conference mixers, elements for joining, modifying and unjoining media streams between connections and conferences (including mixers between connections), as well as associated responses and notifications. The package also defines elements for auditing package capabilities and mixers. This package has been designed to satisfy media mixing requirements documented in the Media Server Control Protocol Requirements document ([RFC5167]); more specifically REQ-MCP-22, REQ-MCP-23, REQ-MCP-24, REQ-MCP-25, REQ-MCP-26 and REQ-MCP-27. The package provides the major conferencing functionality of SIP Media Server languages such as MSCML ([RFC5022]) and MSML ([MSML]). A key differentiator is that this package provides such functionality using the Media Control Channel Framework. Out of scope for this mixer package are more advanced functions including personalized video mixes for conference participants, support for floor control protocols, as well as support for video overlays and text insertion. Such functionality can be addressed by extensions to this package (through addition of foreign elements or attributes from another namespace) or use of other control packages which could build upon this package. The functionality of this package is defined by messages, containing XML [XML] elements, transported using the Media Control Channel Framework. The XML elements can be divided into two types: mixer management elements; and elements for auditing package capabilities as well as mixers managed by the package. The document is organized as follows. Section 3 describes how this control package fulfills the requirements for a Media Control Channel Framework control package. Section 4 describes the syntax and McGlashan, et al. Expires May 29, 2010 [Page 5] Internet-Draft Mixer Control Package November 2009 semantics of defined elements, including mixer management (Section 4.2) and audit elements (Section 4.3). Section 5 describes an XML schema for these elements and provides extensibility by allowing attributes and elements from other namespaces. Section 6 provides examples of package usage. Section 7 describes important security considerations for use of this control package. Section 8 provides information on IANA registration of this control package, including its name, XML namespace and MIME media type. McGlashan, et al. Expires May 29, 2010 [Page 6] Internet-Draft Mixer Control Package November 2009 2. Conventions and Terminology In this document, BCP 14/RFC 2119 [RFC2119] defines the key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL". In addition, BCP 15 indicates requirement levels for compliant implementations. The following additional terms are defined for use in this document: Application server: A SIP [RFC3261] application server (AS) is a control client that hosts and executes services such as interactive media and conferencing in an operator's network. An AS controls the media server (MS), influencing and impacting the SIP sessions terminating on a media server, which the AS can have established for example using SIP third party call control. Media Server: A media server (MS) processes media streams on behalf of an AS by offering functionality such as interactive media, conferencing, and transcoding to the end user. Interactive media functionality is realized by way of dialogs, which are identified by a URI and initiated by the application server. MS Conference: A MS Conference provides the media related mixing resources and services for conferences. In this document, A MS Conference is often referred to simply as a conference. MS Connection: A Media Server connection represents the termination on a media server of one or more RTP [RFC3550] sessions that are associated to a single SIP dialog. A media server receives media from the output(s) of a connection and it transmits media on the input(s) of a connection. Media Stream: A media stream on a media server represents a media flow between either a connection and a conference, between two connections, or between two conferences. Streams can be audio or video and can be bi-directional or uni-directional. McGlashan, et al. Expires May 29, 2010 [Page 7] Internet-Draft Mixer Control Package November 2009 3. Control Package Definition This section fulfills the mandatory requirement for information that MUST be specified during the definition of a Control Framework Package, as detailed in Section 8 of [I-D.ietf-mediactrl-sip-control-framework]. 3.1. Control Package Name The Control Framework requires a Control Package definition to specify and register a unique name. The name and version of this Control Package is "msc-mixer/1.0" (Media Server Control - Mixer - version 1.0). Its IANA registration is specified in Section 8.1. Since this is the initial ("1.0") version of the control package, there are no backwards compatibility issues to address. 3.2. Framework Message Usage The Control Framework requires a Control Package to explicitly detail the control messages that can be used as well as provide an indication of directionality between entities. This will include which role type is allowed to initiate a request type. This package specifies CONTROL and response messages in terms of XML elements defined in Section 4, where the message bodies have the MIME media type defined in Section 8.4. These elements describe requests, response and notifications and all are contained within a root element (Section 4.1). In this package, the MS operates as a Control Server in receiving requests from, and sending responses to, the AS (operating as Control Client). Mixer management requests and responses are defined in Section 4.2. Audit requests and responses are defined in Section 4.3. Mixer management and audit responses are carried in a framework 200 response or REPORT message bodies. This package's response codes are defined in Section 4.5. Note that package responses are different from framework response codes. Framework error response codes (see Section 8 of [I-D.ietf-mediactrl-sip-control-framework]) are used when the request or event notification is invalid; for example, a request is invalid XML (400), or not understood (500). The MS also operates as a Control Client in sending event notification to the AS (Control Server). Event notifications (Section 4.2.4) are carried in CONTROL message bodies. The AS MUST respond with a Control Framework 200 response. McGlashan, et al. Expires May 29, 2010 [Page 8] Internet-Draft Mixer Control Package November 2009 3.3. Common XML Support The Control Framework requires a Control Package definition to specify if the attributes for media dialog or conference references are required. This package requires that the XML Schema in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] MUST be supported for media dialogs and conferences. The package uses "connectionid" and "conferenceid" attributes for various element definitions (Section 4). The XML schema (Section 5) imports the definitions of these attributes from the framework schema. 3.4. CONTROL Message Body The Control Framework requires a Control Package to define the control body that can be contained within a CONTROL command request and to indicate the location of detailed syntax definitions and semantics for the appropriate body types. When operating as Control Server, the MS receives CONTROL messages with the MIME media type defined in Section 8.4 and a body containing a element (Section 4.1) with either a mixer management or audit request child element. The following mixer management request elements are carried in CONTROL message bodies to MS: (Section 4.2.1.1), (Section 4.2.1.2), (Section 4.2.1.3), (Section 4.2.2.2), (Section 4.2.2.3) and (Section 4.2.2.4) elements. The request element (Section 4.3.1) is also carried in CONTROL message bodies. When operating as Control Client, the MS sends CONTROL messages with the MIME media type defined in Section 8.4 and a body containing a element (Section 4.1) with a notification child element (Section 4.2.4). 3.5. REPORT Message Body The Control Framework requires a control package definition to define the REPORT body that can be contained within a REPORT command request, or that no report package body is required. This section indicates the location of detailed syntax definitions and semantics for the appropriate body types. McGlashan, et al. Expires May 29, 2010 [Page 9] Internet-Draft Mixer Control Package November 2009 When operating as Control Server, the MS sends REPORT bodies with the MIME media type defined in Section 8.4 and a element with a response child element. The response element for mixer management requests is a element (Section 4.2.3). The response element for an audit request is a element (Section 4.3.2). 3.6. Audit The Control Framework encourages Control Packages to specify whether auditing is available, how it is triggered as well as the query/ response formats. This Control Packages supports auditing of package capabilities and mixers on the MS. An audit request is carried in a CONTROL message and an audit response in a REPORT message (or a 200 response to the CONTROL if it can execute the audit in time). The syntax and semantics of audit request and response elements is defined in Section 4.3. 3.7. Examples The Control Framework recommends Control Packages to provide a range of message flows that represent common flows using the package and this framework document. This Control Package provides examples of such message flows in Section 6. McGlashan, et al. Expires May 29, 2010 [Page 10] Internet-Draft Mixer Control Package November 2009 4. Element Definitions This section defines the XML elements for this package. The elements are defined in the XML namespace specified in Section 8.2. The root element is (Section 4.1). All other XML elements (requests, responses and notification elements) are contained within it. Child elements describe mixer management (Section 4.2) and audit (Section 4.3) functionality. Response status codes are defined in Section 4.5 and type definitions in Section 4.6. Implementation of this control package MUST address the Security Considerations described in Section 7 ). Implementation of this control package MUST adhere to the syntax and semantics of XML elements defined in this section and the schema (Section 5). The XML schema supports extensibility by allowing attributes and elements from other namespaces. Implementations MAY support attributes and elements from other (foreign) namespaces. If an MS implementation receives a element containing attributes or elements from another namespace which it does not support, the MS sends a 428 response (Section 4.5). Extensible attributes and elements are not described in this section. In all other cases where there is a difference in constraints between the XML schema and the textual description of elements in this section, the textual definition takes priority. Usage examples are provided in Section 6. 4.1. The element has the following attributes (in addition to standard XML namespace attributes such as xmlns): version: a string specifying the mscmixer package version. The value is fixed as '1.0' for this version of the package. The attribute is mandatory. The element has the following defined child elements, only one of which can occur: 1. mixer management elements defined in Section 4.2: create and configure a new conference mixer. See Section 4.2.1.1 McGlashan, et al. Expires May 29, 2010 [Page 11] Internet-Draft Mixer Control Package November 2009 modify the configuration of an existing conference mixer. See Section 4.2.1.2 destroy an existing conference mixer. See Section 4.2.1.3 create and configure media streams between connections and/or conferences (for example, add a participant to a conference). See Section 4.2.2.2 modify the configuration of joined media streams. See Section 4.2.2.3 delete a media stream (for example, remove a participant from a conference). See Section 4.2.2.4 response to a mixer request. See Section 4.2.3 mixer or subscription notification. See Section 4.2.4 2. audit elements defined in Section 4.3: audit package capabilities and managed mixers. See Section 4.3.1 response to an audit request. See Section 4.3.2 For example, a request to the MS to create a conference mixer: and a response from the MS that the conference was successfully created: 4.2. Mixer Elements This section defines the mixer management XML elements for this control package. These elements are divided into requests, responses and notifications. Request elements are sent to the MS to request a specific mixer operation to be executed. The following request elements are McGlashan, et al. Expires May 29, 2010 [Page 12] Internet-Draft Mixer Control Package November 2009 defined: create and configure a new a conference mixer. See Section 4.2.1.1 modify the configuration of an existing conference mixer. See Section 4.2.1.2 destroy an existing conference mixer. See Section 4.2.1.3 create and configure media streams between connections and/or conferences (for example, add a participant to a conference). See Section 4.2.2.2 modify the configuration of joined media streams. See Section 4.2.2.3 delete a media stream (for example, remove a participant from a conference). See Section 4.2.2.4 Responses from the MS describe the status of the requested operation. Responses are specified in a element (Section 4.2.3) which includes a mandatory attribute describing the status in terms of a numeric code. Response status codes are defined in Section 4.5. The MS MUST respond to a request message with a response message. If the MS is not able to process the request and carry out the mixer operation, the request has failed and the MS MUST indicate the class of failure using an appropriate 4xx response code. Unless an error response code is specified for a class of error within this section, implementations follow Section 4.5 in determining the appropriate status code for the response. Notifications are sent from the MS to provide updates on the status of a mixer operation or subscription. Notifications are specified in an element (Section 4.2.4). 4.2.1. Conference Elements 4.2.1.1. The element is sent to the MS to request creation of a new conference (multiparty) mixer. The element has the following attributes: McGlashan, et al. Expires May 29, 2010 [Page 13] Internet-Draft Mixer Control Package November 2009 conferenceid: string indicating a unique name for the new conference. If this attribute is not specified, the MS MUST create a unique name for the conference. The value is used in subsequent references to the conference (e.g. as conferenceid in a ). The attribute is optional. There is no default value. reserved-talkers: indicates the requested number of guaranteed speaker slots to be reserved for the conference. A valid value is a non-negative integer (see Section 4.6.2). The attribute is optional. The default value is 0. reserved-listeners: indicates the requested number of guaranteed listener slots to be reserved for the conference. A valid value is a non-negative integer (see Section 4.6.2). The attribute is optional. The default value is 0. The element has the following sequence of child elements: : an element to configure the codecs supported by the conference (see Section 4.4). If codecs are specified, then they impose limitations in media capability when the MS attempts to join the conference to other entities (see Section 4.2.2.2 and Section 4.2.2.3). The element is optional. : an element to configure the audio mixing characteristics of a conference (see Section 4.2.1.4.1). The element is optional. : an element to configure the video layouts of a conference (see Section 4.2.1.4.2). The element is optional. : an element to configure the video switch policy for the layout of a conference (see Section 4.2.1.4.3). The element is optional. : an element to request subscription to conference events. (see Section 4.2.1.4.4). The element is optional. If the conferenceid attribute specifies a value which is already used by an existing conference, the MS reports an error (405) and MUST NOT create a new conference and MUST NOT affect the existing conference. If the MS is unable to configure the conference according to specified reserved-talkers or reserved-listeners attributes, the MS reports an error (420) and MUST NOT create the conference. McGlashan, et al. Expires May 29, 2010 [Page 14] Internet-Draft Mixer Control Package November 2009 If the MS is unable to configure the conference according to a specified element, the MS reports an error (421) and MUST NOT create the conference. If the MS is unable to configure the conference according to a specified element, the MS reports an error (423) and MUST NOT create the conference. If the MS is unable to configure the conference according to a specified element, the MS reports an error (424) and MUST NOT create the conference. If the MS is unable to configure the conference according to a specified element, the MS reports an error (425) and MUST NOT create the conference. When a MS has finished processing a request, it MUST reply with an appropriate element (Section 4.2.3). For example, a request to create an audio video conference mixer with specified codecs, video layout, video switch and subscription: H264 PCMA single-view dual-view quad-view and a response from the MS if the conference was successfully created: McGlashan, et al. Expires May 29, 2010 [Page 15] Internet-Draft Mixer Control Package November 2009 alternatively, a response if MS could not create the conference due to a lack of support for the H264 codec: 4.2.1.2. The element is sent to the MS to request modification of an existing conference. The element has the following attributes: conferenceid: string indicating the name of the conference to modify. This attribute is mandatory. The element has the following sequence of child elements (1 or more): : an element to configure the codecs supported by the conference (see Section 4.4). If codecs are specified, then they impose limitations in media capability when the MS attempts to join the conference to other entities (see Section 4.2.2.2 and Section 4.2.2.3). Existing conference participants are unaffected by any policy change. The element is optional. : an element to configure the audio mixing characteristics of a conference (see Section 4.2.1.4.1). The element is optional. : an element to configure the video layouts of a conference (see Section 4.2.1.4.2). The element is optional. : an element to configure the video switch policy for the layout of a conference (see Section 4.2.1.4.3). The element is optional. : an element to request subscription to conference events. (see Section 4.2.1.4.4). The element is optional. If the conferenceid attribute specifies the name of a conference which does not exist, the MS reports an error (406). McGlashan, et al. Expires May 29, 2010 [Page 16] Internet-Draft Mixer Control Package November 2009 If the MS is unable to configure the conference according to a specified element, the MS reports an error (421) and MUST NOT modify the conference in any way. If the MS is unable to configure the conference according to a specified element, the MS reports an error (423) and MUST NOT modify the conference in any way. If the MS is unable to configure the conference according to a specified element, the MS reports an error (424) and MUST NOT modify the conference in any way. If the MS is unable to configure the conference according to a specified element, the MS reports an error (425) and MUST NOT modify the conference. When a MS has finished processing a request, it MUST reply with an appropriate element (Section 4.2.3). 4.2.1.3. The element is sent to the MS to request destruction of an existing conference. The element has the following attributes: conferenceid: string indicating the name of the conference to destroy. This attribute is mandatory. The element does not specify any child elements. If the conferenceid attribute specifies the name of a conference which does not exist, the MS reports an error (406). When a MS has finished processing a request, it MUST reply with an appropriate element (Section 4.2.3). Successfully destroying the conference (status code 200) will result in all connection or conference participants being removed from the conference mixer, notification events (Section 4.2.4.2) being sent for each conference participant and a notification event (Section 4.2.4.3) indicating that conference has exited. A with any other status code indicates that the conference mixer still exists and participants are still joined to the mixer. McGlashan, et al. Expires May 29, 2010 [Page 17] Internet-Draft Mixer Control Package November 2009 4.2.1.4. Conference Configuration The elements in this section are used to establish and modify the configuration of conferences. 4.2.1.4.1. The element defines the configuration of the conference audio mix. The element has the following attributes: type: is a string indicating the audio stream mixing policy. Defined values are: "nbest" (where the N best (loudest) participant signals are mixed) and "controller" (where the contributing participant(s) is/are selected by the controlling AS via an external floor control protocol). The attribute is optional. The default value is "nbest". n: indicates the number of eligible participants included in the conference audio mix. An eligible participant is a partipicant who contributes audio to the conference. Inclusion is based on having the greatest audio energy. A valid value is a non-negative integer (see Section 4.6.2). A value of 0 indicates that all participants contributing audio to the conference are included in the audio mix. The default value is 0. The element is optional. If the type attribute does not have the value "nbest", the MS ignores the "n" attribute. The element has no child elements. For example, a fragment where the audio mixing policy is set to "nbest" with 3 participants to be included: If the conference had 200 participants of whom 30 contributed audio, then there would be 30 eligible participants for the audio mix. Of these, the 3 loudest partipicants would have their audio included in the conference. 4.2.1.4.2. The element describe the video presentation layout configuration for participants providing a video input stream to the conference. This element allows multiple video layouts to be specified so that the MS automatically changes layout depending on McGlashan, et al. Expires May 29, 2010 [Page 18] Internet-Draft Mixer Control Package November 2009 the number of video-enabled participants. The element has no attributes. The element has the following sequence of child elements (1 or more): : element describing a video layout (Section 4.2.1.4.2.1). If the MS does not support video conferencing at all, or does not support multiple video layouts, or does not support a specific video layout, the MS reports an 423 error in the response to the request element containing the element. An MS MAY support more than one element, although only one layout can be active at a time. A is active if the number of participants in the conference is equal to or greater than the value of its "min-participants" attribute, but less than the value of the "min-participants" attribute for any other element. An MS reports an error (400) if more than one has the same value for the "min-participants" attribute. When the number of regions within the active layout is greater than the number of participants in the conference, the display of unassigned regions is implementation-specific. The assignment of participant video streams to regions within the layout is according to the video switch policy specified by the element (Section 4.2.1.4.3). For example, a fragment describing a single layout: single-view And a fragment describing a sequence of layouts: single-view dual-view quad-view multiple-3x3 When the conference has one participant providing a video input stream to the conference, then the single-view format is used. When the conference has two such participants, the dual-view layout is McGlashan, et al. Expires May 29, 2010 [Page 19] Internet-Draft Mixer Control Package November 2009 used. When the conference has three or four participants, the quad- view layout is used. When the conference has five or more participants, the multiple-3x3 layout is used. 4.2.1.4.2.1. The element describes a video layout containing one or more regions in which participant video input streams are displayed. The element has the following attributes: min-participants: the minimum number of conference participants needed to allow this layout to be active. A valid value is a positive integer (see Section 4.6.3). The attribute is optional. The default value is 1. The element has a content model specifying the name of the video layout. An MS MAY support the predefined video layouts defined in the XCON conference information data model ([I-D.ietf-xcon-common-data-model]). The MS MAY support other video layouts. Non-XCON layouts MUST be prefixed with a label; for example, mylayout:single-view. Each video layout has associated with it one or more regions. The XCON layouts have associated the following named regions: single-view layout with one stream in a single region as shown in Figure 1. +-----------+ | | | | | 1 | | | | | +-----------+ Figure 1: single-view video layout dual-view layout presenting two streams side-by-side in two regions as shown in Figure 2. The MS MUST NOT alter the aspect ratio of each stream to fit the region and hence the MS could have to blank part of each region. McGlashan, et al. Expires May 29, 2010 [Page 20] Internet-Draft Mixer Control Package November 2009 +-----------+-----------+ | | | | | | | 1 | 2 | | | | | | | +-----------+-----------+ Figure 2: dual-view video layout dual-view-crop layout presenting two streams side-by-side in two regions as shown in Figure 3. The MS MUST alter the aspect ratio of each stream to fit its region so that no blanking is required. +-----------+-----------+ | | | | | | | 1 | 2 | | | | | | | +-----------+-----------+ Figure 3: dual-view-crop video layout dual-view-2x1 layout presenting two streams one above the other in two regions as shown in Figure 4. The MS MUST NOT alter the aspect ratio of each stream to fit its region and hence the MS could have to blank part of each region. +-----------+ | | | | | 1 | | | | | +-----------+ | | | | | 2 | | | | | +-----------+ McGlashan, et al. Expires May 29, 2010 [Page 21] Internet-Draft Mixer Control Package November 2009 Figure 4: dual-view-2x1 video layout dual-view-2x1-crop layout presenting two streams one above the other in two regions as shown in Figure 5. The MS MUST alter the aspect ratio of each stream to fit its region so that no blanking is required. +-----------+ | | | | | 1 | | | | | +-----------+ | | | | | 2 | | | | | +-----------+ Figure 5: dual-view-2x1-crop video layout quad-view layout presenting four equal-sized regions in a 2x2 layout as shown in Figure 6. Typically the aspect ratio of the streams is preserved, so blanking is required. +-----------+-----------+ | | | | | | | 1 | 2 | | | | | | | +-----------+-----------+ | | | | | | | 3 | 4 | | | | | | | +-----------+-----------+ Figure 6: quad-view video layout McGlashan, et al. Expires May 29, 2010 [Page 22] Internet-Draft Mixer Control Package November 2009 multiple-3x3 layout presenting nine equal-sized regions in a 3x3 layout as shown in Figure 7. Typically the aspect ratio of the streams is preserved, so blanking is required. +-----------+-----------+-----------+ | | | | | | | | | 1 | 2 | 3 | | | | | | | | | +-----------+-----------+-----------+ | | | | | | | | | 4 | 5 | 6 | | | | | | | | | +-----------+-----------+-----------+ | | | | | | | | | 7 | 8 | 9 | | | | | | | | | +-----------+-----------+-----------+ Figure 7: multiple-3x3 video layout multiple-4x4 layout presenting sixteen equal-sized regions in a 4x4 layout as shown in Figure 8. Typically the aspect ratio of the streams is preserved, so blanking is required. McGlashan, et al. Expires May 29, 2010 [Page 23] Internet-Draft Mixer Control Package November 2009 +-----------+-----------+-----------+-----------+ | | | | | | | | | | | 1 | 2 | 3 | 4 | | | | | | | | | | | +-----------+-----------+-----------+-----------+ | | | | | | | | | | | 5 | 6 | 7 | 8 | | | | | | | | | | | +-----------+-----------+-----------+-----------+ | | | | | | | | | | | 9 | 10 | 11 | 12 | | | | | | | | | | | +-----------+-----------+-----------+-----------+ | | | | | | | | | | | 13 | 14 | 15 | 16 | | | | | | | | | | | +-----------+-----------+-----------+-----------+ Figure 8: multiple-4x4 video layout multiple-5x1 layout presents a 5x1 layout as shown in Figure 9 where one region will occupy 4/9 of the mixed video stream while the others will each occupy 1/9 of the stream. Typically the aspect ratio of the streams is preserved, so blanking is required. McGlashan, et al. Expires May 29, 2010 [Page 24] Internet-Draft Mixer Control Package November 2009 +-----------------------+-----------+ | | | | | | | | 2 | | | | | | | | 1 +-----------+ | | | | | | | | 3 | | | | | | | +-----------+-----------+-----------+ | | | | | | | | | 4 | 5 | 6 | | | | | | | | | +-----------+-----------+-----------+ Figure 9: multiple-5x1 video layout 4.2.1.4.3. The element describe the configuration of the conference policy for how participant's input video streams are assigned to regions within the active video layout. The element has the following attributes: type: a string indicating the video switching policy of the conference. Defined values are: vas (Voice Activated Switching) enables automatic display of the loudest speaker participant also providing a video input stream to the conference. Participants who do not provide an audio stream are not considered for automatic display. If a participant provides more than one audio stream, then the policy for inclusion of such a participant in the VAS is implementation-specific; an MS could select one stream, sum audio streams or ignore the participant for VAS consideration. If there is only one region in the layout, then the loudest speaker is displayed there. If more than one region is available, then the loudest speaker is displayed in the largest region, if any, and then in the first region from the top-left corner of the layout. The MS assigns the remaining regions based on the priority mechanism described in McGlashan, et al. Expires May 29, 2010 [Page 25] Internet-Draft Mixer Control Package November 2009 Section 4.2.1.4.3.1. controller enables manual control over video switching. The controller AS determines how the regions are assigned based on an external floor control policy. The MS receives , and commands with a element (Section 4.2.2.5) indicating the region where the stream is displayed. If no explicit region is specified, the MS assigns the region based on the priority mechanism described in Section 4.2.1.4.3.1. An MS MAY support other video switching policies. Other policy names MUST be prefixed with a label; e.g. "mypolicies:policy1". The attribute is optional. The default value is 'vas'. interval: specifies the period between video switches as a number of seconds. In the case of 'vas' policy, a speaker needs to be the loudest speaker for the interval before the switch takes place. A valid value is a non-negative integer (see Section 4.6.2). A value of 0 indicates that switching is applied immediately. The attribute is optional. The default value is 3 (seconds). activespeakermix: indicates whether or not the active (loudest) speaker participant receives a video stream without themselves displayed in the case of the 'vas' switching policy. If enabled, the MS needs to generate two video streams for each conference mix: one for the active speaker participant without themselves displayed - details of this video layout are implementation- specific; and one for other participants as described in the 'vas' switch policy above. A valid value is a boolean (see Section 4.6.1). A value of true indicates that a separate video mix is generated for the active speaker without themselves being displayed. A value of false indicates that all participants receive the same video mix. The attribute is optional. The default value is false. If the type attribute is not set to 'vas', the MS ignores this attribute. If the MS does not support the specified video switching policy or other configuration parameters (including separate active speaker video mixes), then MS reports a 424 error (Section 4.5) in the response to the request element containing the element. If the MS receives a or request containing a element (Section 4.2.2.5) specifying a region and the conference video switching policy is set to 'vas', then the MS ignores the region (i.e. conference switching policy takes precedence). McGlashan, et al. Expires May 29, 2010 [Page 26] Internet-Draft Mixer Control Package November 2009 If the MS receives a or request containing a element (Section 4.2.2.5) specifying a region which is not defined for the currently active video layout, the MS MUST NOT report an error. Even though the participant is not currently visible, the MS displays the participant if the layout changes to one which defines the specified region. The element has no child elements. For example, a fragment specifying a 'vas' video switching policy with an interval of 2s For example, a fragment specifying a 'controller' video switching policy where video switching takes place immediately: 4.2.1.4.3.1. Priority assignment In cases where the video switching policy does not explicitly determine the region to which a participant is assigned, the following priority assignment mechanism applies: 1. Each participant has an (positive integer) priority value: the lower the value, the higher the priority. The priority value is determined by the child element (Section 4.2.2.5.4) of . If not explicitly specified, the default priority value is 100. 2. The MS uses priority values to assign participants to regions in the video layout which remain unfilled after application of the video switching policy. The MS MUST dedicate larger and/or more prominent portions of the layout to participants with higher priority values first (e.g. first all participants with priority 1, then those with 2, 3, etc). 3. The policy for displaying participants with the same priority is implementation-specific. The MS applies this priority policy each time the video layout is changed or updated. It is RECOMMENDED that the MS does not move a participant from one region to another unless required by the video switching policy when an active video layout is updated. This model allows the MS to apply default video layouts after applying the video switch policy. For example, region 2 is McGlashan, et al. Expires May 29, 2010 [Page 27] Internet-Draft Mixer Control Package November 2009 statically assigned to Bob, so the priority mechanism only applies to regions 1, 3, 4, etc. 4.2.1.4.4. The element is a container for specifying conference notification events to which a controlling entity subscribes. Notifications of conference events are delivered using the element (see Section 4.2.4). The element has no attributes, but has the following child element: : subscription to active talker events (Section 4.2.1.4.4.1). The element is optional. The MS MUST support a subscription. It MAY support other event subscriptions (specified using attributes and child elements from a foreign namespace). If the MS does not support a subscription specified in a foreign namespace, it sends a with a 428 status code (see Section 4.5). 4.2.1.4.4.1. The element has the following attributes: interval: the minimum amount of time (in seconds) that elapses before further active talker events can be generated. A valid value is a non-negative integer (see Section 4.6.2). A value of 0 suppresses further notifications. The attribute is optional. The default value is 3 (seconds). The element has no child elements. Active talker notifications are delivered in the element (Section 4.2.4.1). 4.2.2. Joining Elements In this section, the joining model is defined (Section 4.2.2.1) as well as definitions of the (Section 4.2.2.2), (Section 4.2.2.3), (Section 4.2.2.4) and (Section 4.2.2.5) elements. 4.2.2.1. Joining Model The operation creates a media stream between a connection and a conference, between connections, or between conferences. This McGlashan, et al. Expires May 29, 2010 [Page 28] Internet-Draft Mixer Control Package November 2009 section describes the model of conferences and connections and specifies the behavior for join requests to targets that already have an associated media stream. Conferences support multiple inputs and have resources to mix them together. A media server conference in essence is a mixer that combines media streams. A simple audio mixer simply sums its input audio signals to create a single common output. Conferences however use a more complex algorithm so that participants do not hear themselves as part of the mix. That algorithm, sometimes called an n-minus mix, subtracts each participants input signal from the summed input signals, creating a unique output for each contributing participant. Each operation to a conference uses one of the conference's available inputs and/or outputs, to the maximum number of supported participants. A connection is the termination of a RTP session(s) on a media server. It has a single input and output for each media session established by its SIP dialog. The output of a connection can feed several different inputs such as both a conference mixer and a recording of that participant's audio. Joining two connections which are are not joined to anything else simply creates a media stream from the outputs(s) of one connection to the corresponding inputs(s) of the other connection. It is not necessary to combine media from multiple sources in this case. There are however several common scenarios where combining media from several sources to create a single input to a connection is needed. In the first case, a connection can be receiving media from one source, for example a conference, and it is necessary to play an announcement to the connection so that both the conference audio and announcement can be heard by the conference participant. This is sometimes referred to as a whisper announcement. An alternative to a whisper announcement is to have the announcement pre-empt the conference media. Another common case is the call center coaching scenario where a supervisor can listen to the conversation between an agent and a customer, and provide hints to the agent, which are not heard by the customer. Both of these cases can be solved by having the controlling AS create one or more conferences for audio mixing and to join and unjoin the media streams as required. A better solution is to have the media server automatically mix media streams that are requested to be joined to a common input when only the simple summing of audio signals as described above is required. This is the case for both McGlashan, et al. Expires May 29, 2010 [Page 29] Internet-Draft Mixer Control Package November 2009 the use cases presented above. Automatically mixing streams has several benefits. Conceptually, it is straight forward and simple, requiring no indirect requests on the part of the controlling AS. This increases transport efficiency and reduces the coordination complexity and the latency of the overall operation. Therefore, it is RECOMMENDED that a media server be able to automatically mix at least two audio streams where only the simple summing of signals is required. When a media server receives a request, it MUST automatically mix all of the media streams included in the request with any streams already joined to one of the entities identified in the request, or it MUST fail the request and MUST NOT join any of the streams (and MUST NOT change existing streams of the entities). A controlling AS uses the request for generic conferences where the complex mixing algorithm is required. Specifications which extend this package to handle additional media types such as text, MUST define the semantics of the join operation when multiple streams are requested to be joined to a single input, such as that for a connection with a single RTP session per media type. 4.2.2.2. The element is sent to the MS to request creation one or more media streams either between a connection and a conference, between connections, or between conferences. The two entities to join are specified by the attributes of . Streams can be of any media type, and can be bi-directional or uni- directional. A bi-directional stream is implicitly composed of two uni-directional streams that can be manipulated independently. The streams to be established are specified by child elements (see Section 4.2.2.5). The element has the following attributes: id1: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. id2: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. McGlashan, et al. Expires May 29, 2010 [Page 30] Internet-Draft Mixer Control Package November 2009 Note: Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] defines the semantics for a conference identifier but not its syntax. Media server implementations need to distinguish between conferences and connections based upon the values of the "id1" and "id2" attributes. If id1 or id2 specify a conference identifier and the conference does not exist on the MS, the MS reports an error (406). If id1 or id2 specify a connection identifier and the connection does not exist on the MS, the MS reports an error (412). The element has the following child element (0 or more): : an element that both identifies the media streams to join and defines the way that they are to be joined (see Section 4.2.2.5). The element is optional. If no elements are specified, then the default is to join all streams between the entities according to the media configuration of the connection or conference. One or more elements can be specified so that individual media streams can be controlled independently. For example, if a connection supports both audio and video streams, a element could be used to indicate that only the audio stream is used in receive mode. In cases where there are multiple media streams of the same type for a connection or conference, the configuration MUST be explicitly specified using elements. Multiple elements can be specified for precise control over the media flow in different directions within the same media stream. One element can be specified for the receiving media flow and another element for the sending media flow, where each independently controls features such as volume (see child element of in Section 4.2.2.5). If there is only one element for a given media specifying a 'sendonly' or 'recvonly' direction, then the media flow in the opposite direction is inactive (established but no actual flow of media) unless this leads to a stream conflict. If the MS is unable to execute the join as specified in because a element is in conflict with (a) another element, (b) with specified connection or conference media capabilities (including supported or available codec information), or (c) with a SDP label value as part of the connection-id (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]), then the MS reports an error (407) and MUST NOT join the entities and MUST NOT change existing streams of the entities. McGlashan, et al. Expires May 29, 2010 [Page 31] Internet-Draft Mixer Control Package November 2009 If the MS is unable to execute the join as specified in elements because the MS does not support the media stream configuration, the MS reports an error (422) and MUST NOT join the entities and MUST NOT change existing streams of the entities. If the MS is unable to join an entity to a conference because it is full, then the MS reports an error (410). If the specified entities are already joined, then the MS reports an error (408). If the MS does not support joining two specified connections together, the MS reports an error (426). If the MS does not support joining two specified conferences together, the MS reports an error (427). If the MS is unable to join the specified entities for any other reason, the MS reports an error (411). When the MS has finished processing a request, it MUST reply with an element (Section 4.2.3). For example, a request to join two connection together: and the response if the MS doesn't support joining media streams between connections: 4.2.2.3. The element is sent to the MS to request changes in the configuration of media stream(s) that were previously established between a connection and a conference, between two connections, or between two conferences. The element has the following attributes: McGlashan, et al. Expires May 29, 2010 [Page 32] Internet-Draft Mixer Control Package November 2009 id1: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. id2: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. The element has the following child elements (1 or more): : an element that both identifies the media streams to modify and defines the way that each stream is now to be configured (see Section 4.2.2.5). The MS MUST support for any stream that was established using . The MS MUST configure the streams that are included within to that stated by the child elements. It MUST NOT change the configuration of any streams not included as child elements. If the MS is unable to modify the join as specified in elements because a element is in conflict with (a) another element, (b) with specified connection or conference media capabilities (including supported or available codec information), or (c) with a SDP label value as part of the connection-id (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]), then the MS reports an error (407) and MUST NOT modify the join between the entities and MUST NOT change existing streams of the entities. If the MS is unable to modify the join as specified in elements because the MS does not support the media stream configuration, the MS reports an error (422) and MUST NOT modify the join between the entities and MUST NOT change existing streams of the entities. If the specified entities are not already joined, then the MS reports an error (409). If the MS is unable to modify the join between the specified entities for any other reason, the MS reports an error (411). When an MS has finished processing a request, it MUST reply with an appropriate element (Section 4.2.3). McGlashan, et al. Expires May 29, 2010 [Page 33] Internet-Draft Mixer Control Package November 2009 In cases where stream characteristics are controlled independently for each direction, then a request needs to specify a child element for each direction in order to retain the original stream directionality. For the example, if a request establishes independent control for each direction of an audio stream (see Section 4.2.2.5): then the following request would cause, in addition to the sendonly volume being modified, that the overall stream directionality changes from sendrecv to sendonly since there is no element in this request for the recvonly direction. The following would change the sendonly volume and retain the recvonly stream together with its original characteristics such as volume: McGlashan, et al. Expires May 29, 2010 [Page 34] Internet-Draft Mixer Control Package November 2009 4.2.2.4. The element is sent to the MS to request removal of previously established media stream(s) from between a connection and a conference, between two connections, or between two conferences. The element has the following attributes: id1: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. id2: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 15.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. The element has the following child element (0 or more occurrences): : an element that identifies the media stream(s) to remove (see Section 4.2.2.5). The element is optional. When not present, all currently established streams between "id1" and "id2" are removed. The MS MUST support for any stream that was established using and has not already been removed by a previous on the same stream. If the MS is unable to terminate the join as specified in elements because a element is in conflict with (a) another element, (b) with specified connection or conference media capabilities or (c) with a SDP label value as part of the connection-id (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]), then the MS reports an error (407) and MUST NOT terminate the join between the entities and MUST NOT change existing streams of the entities. If the MS is unable to terminate the join as specified in elements because the MS does not support the media stream configuration, the MS reports an error (422) and MUST NOT terminate the join between the entities and MUST NOT change existing streams of the entities. If the specified entities are not already joined, then the MS reports an error (409). McGlashan, et al. Expires May 29, 2010 [Page 35] Internet-Draft Mixer Control Package November 2009 If the MS is unable to terminate the join between the specified entities for any other reason, the MS reports an error (411). When an MS has successfully processed a request, it MUST reply with a successful element (Section 4.2.3). 4.2.2.5. , and require the identification and manipulations of media streams. Media streams represent the flow of media between a participant connection and a conference, between two connections, or between two conferences. The element is used (as a child to , and element has the following attributes: media: a string indicating the type of media associated with the stream. The following values MUST be used for common types of media: "audio" for audio media, and "video" for video media. The attribute is mandatory. label: a string indicating the SDP label associated with a media stream ([RFC4574]). The attribute is optional. direction: a string indicating the allowed media flow of the stream relative to the value of the "id1" attribute of the parent element. Defined values are: "sendrecv" (media can be sent and received), "sendonly" (media can only be sent), "recvonly" (media can only be received) and "inactive" (stream established but no media flow). The default value is "sendrecv". The attribute is optional. The element has the following sequence of child elements: : an element (Section 4.2.2.5.1) to configure the volume or gain of the media stream. The element is optional. : an element (Section 4.2.2.5.2) to configure filtering and removal of tones from the media stream. The element is optional. : an element (Section 4.2.2.5.3) to configure a region within a video layout where the media stream is displayed. The element is optional. McGlashan, et al. Expires May 29, 2010 [Page 36] Internet-Draft Mixer Control Package November 2009 : an element (Section 4.2.2.5.4) to configure priority associated with the stream in the media mix. The element is optional. In each child element, the media stream affected is indicated by the value of the direction attribute of the parent element. If the media attribute does not have the value of "audio", then the MS ignores and elements. If the media attribute does not have the value of "video", then the MS ignores a element. For example, a request to join a connection to conference in both directions with volume control: where audio flow from the connection (id1) to the conference (id2) has the volume lowered by 3dB, and likewise the volume of the audio flow from the conference to the connection is lowered by 3 dB. In this example, the volume is independently controlled for each direction. where audio flow from the connection (id1) to the conference (id2) has the volume lowered by 3dB, but the volume of the audio flow from the conference to the connection is raised by 3 dB. McGlashan, et al. Expires May 29, 2010 [Page 37] Internet-Draft Mixer Control Package November 2009 4.2.2.5.1. The element is used to configure the volume of an audio media stream. It can be set to a specific gain amount, to automatically adjust the gain to a desired target level, or to mute the volume. The element has no child elements but has the following attributes: controltype: a string indicating the type of volume control to use for the stream. Defined values are: "automatic" (the volume will be adjusted automatically to the level specified by the "value" attribute), "setgain" (use the value of the "value" attribute as a specific gain measured in dB to apply), "setstate" (set the state of the stream to "mute" or "unmute" as specified by the value of the "value" attribute). The attribute is mandatory. value: a string specifying the amount or state for the volume control defined by the value of the "controltype" attribute. The attribute is optional. There is no default value. If the audio media stream is in a muted state, then the MS also changes automatically the state to unmuted with an "automatic" or "setgain" volume control. For the example, assume an audio stream has been muted with . If the gain on the same stream is changed with , then the volume is increased and stream state is also changed to unmuted. 4.2.2.5.2. The element is used to configure whether tones are filtered and removed from a media stream. The element has no child elements but has the following attributes: tones: A space-separated list of the tones to remove. The attribute is mandatory. 4.2.2.5.3. The element is used to explicitly specify the region within a video layout where the media stream is displayed. The element has no attributes and its content model specifies the name of the region layout. McGlashan, et al. Expires May 29, 2010 [Page 38] Internet-Draft Mixer Control Package November 2009 4.2.2.5.4. The element is used to explicitly specify the priority of a participant. The MS uses this priority to determine where the media stream is displayed within a video layout (Section 4.2.1.4.3.1). The element has no attributes and its content model specifies a positive integer (see Section 4.6.3). The lower the value, the higher the priority. 4.2.3. Responses to requests are indicated by a element. The element has following attributes: status: numeric code indicating the response status. Valid values are defined in Section 4.5. The attribute is mandatory. reason: string specifying a reason for the response status. The attribute is optional. conferenceid: string identifying the conference (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]). The attribute is optional. connectionid: string identifying the SIP dialog connection (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]). The attribute is optional. For example, a response when a conference was created successfully: Success The response if conference creation failed due to the requested conference id already existing: Conf already exists McGlashan, et al. Expires May 29, 2010 [Page 39] Internet-Draft Mixer Control Package November 2009 4.2.4. When a mixer generates a notification event, the MS sends the event using an element. The element has no attributes, but has the following sequence of child elements (0 or more instances of each child): specifies an active talkers notification (Section 4.2.4.1). notifies that a connection or conference has been completely unjoined (Section 4.2.4.2). notifies that a conference has exited (Section 4.2.4.3). 4.2.4.1. The element describes zero or more speakers that have been active in a conference during the specified interval (see Section 4.2.1.4.4.1). The element has the following attributes: conferenceid: string indicating the name of the conference from which the event originated. This attribute is mandatory. The element has the following sequence of child elements (0 or more occurrence's): element describing an active talker (Section 4.2.4.1.1). 4.2.4.1.1. The element describes an active talker, associated with either a connection or conference participant in a conference. The element has the following attributes: connectionid: string indicating the connectionid of the active talker. This attribute is optional. There is no default value. conferenceid: string indicating the conferenceid of the active talker. This attribute is optional. There is no default value. It is an error (400) if both the connectionid and conferenceid McGlashan, et al. Expires May 29, 2010 [Page 40] Internet-Draft Mixer Control Package November 2009 attributes are specified. The element has no child elements. 4.2.4.2. The element describes a notification event where a connection and/or conference have been completely unjoined. The element has the following attributes: status: a status code indicating why the unjoin occurred. A valid value is a non-negative integer (see Section 4.6.2). The MS MUST support the following values: 0 indicates the join has been terminated by a request. 1 indicates the join terminated due to an execution error. 2 indicates that the join terminated because a connection or conference has terminated. All other valid but undefined values are reserved for future use, where a standards-track RFC is required to define new status codes. The AS MUST treat any status code it does not recognize as being equivalent to 1 (join execution error). The attribute is mandatory. reason: a textual description providing a reason for the status code; e.g. details about an error. A valid value is a string (see Section 4.6.4). The attribute is optional. There is no default value. id1: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. id2: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. The element has no child elements. McGlashan, et al. Expires May 29, 2010 [Page 41] Internet-Draft Mixer Control Package November 2009 4.2.4.3. The element indicates that a conference has exited because it has been terminated or because a error occurred (for example, a hardware error in the conference mixing unit). This event MUST be sent by the MS whenever a successfully created conference exits. The element has the following attributes: conferenceid: string indicating the name of the conference. This attribute is mandatory. status: a status code indicating why the conference exited. A valid value is a non-negative integer (see Section 4.6.2). The MS MUST support the following values: 0 indicates the conference has been terminated by a request. 1 indicates the conference terminated due to an execution error. 2 indicates the conference terminated due to exceeding the maximum duration for a conference. All other valid but undefined values are reserved for future use, where a standards-track RFC is required to define new status codes. The AS MUST treat any status code it does not recognize as being equivalent to 1 (conference execution error). The attribute is mandatory. reason: a textual description providing a reason for the status code; e.g. details about an error. A valid value is a string (see Section 4.6.4). The attribute is optional. There is no default value. The element has no child elements. When a MS sends a event, the identifier for the conference (conferenceid attribute) is no longer valid on the MS and can be reused for another conference. For example, the following notification event would be sent from the MS when the conference with identifier "conference99" exits due to a successful : McGlashan, et al. Expires May 29, 2010 [Page 42] Internet-Draft Mixer Control Package November 2009 4.3. Audit Elements The audit elements defined in this section allow the MS to be audited for package capabilities as well as mixers managed by the package. Auditing is particularly important for two use cases. First, it enables discovery of package capabilities supported on an MS before an AS creates a conference mixer or joins connections and conferences. The AS can then use this information to create request elements using supported capabilities and, in the case of codecs, to negotiate an appropriate SDP for a user agent's connection. Second, auditing enables discovery of the existence and status of mixers currently managed by the package on the MS. This could be used when one AS takes over management of mixers if the AS which created the mixers fails or is no longer available (see Security Considerations described in Section 7). 4.3.1. The request element is sent to the MS to request information about the capabilities of, and mixers currently managed with, this control package. Capabilities include supported conference codecs and video layouts. Mixer information includes the status of managed mixers as well as codecs. The element has the following attributes: capabilities: indicates whether package capabilities are to be audited. A valid value is a boolean (see Section 4.6.1). A value of true indicates that capability information is to be reported. A value of false indicates that capability information is not to be reported. The attribute is optional. The default value is true. mixers: indicates whether mixers currently managed by the package are to be audited. A valid value is a boolean (see Section 4.6.1). A value of true indicates that mixer information is to be reported. A value of false indicates that mixer information is not to be reported. The attribute is optional. The default value is true. McGlashan, et al. Expires May 29, 2010 [Page 43] Internet-Draft Mixer Control Package November 2009 conferenceid: string identifying a specific conference mixer to audit. It is an error (406) if the conferenceid attribute is specified and the conference identifier is not valid. The attribute is optional. There is no default value. If the mixers attribute has the value true and conferenceid attribute is specified, then only audit information about the specified conference mixer is reported. If the mixers attribute has the value false, then no mixer audit information is reported even if a conferenceid attribute is specified. The element has no child elements. When the MS receives an request, it MUST reply with a element (Section 4.3.2) which includes a mandatory attribute describing the status in terms of a numeric code. Response status codes are defined in Section 4.5. If the request is successful, the contains (depending on attribute values) a element (Section 4.3.2.1) reporting package capabilities and a element (Section 4.3.2.2) reporting managed mixer information. If the MS is not able to process the request and carry out the audit operation, the audit request has failed and the MS MUST indicate the class of failure using an appropriate 4xx response code. Unless an error response code is specified for a class of error within this section, implementations follow Section 4.5 in determining the appropriate status code for the response. For example, a request to audit capabilities and mixers managed by the package: In this example, only capabilities are to be audited: With this example, only a specific conference mixer is to be audited: McGlashan, et al. Expires May 29, 2010 [Page 44] Internet-Draft Mixer Control Package November 2009 4.3.2. The element describes a response to a request. The element has the following attributes: status: numeric code indicating the audit response status. The attribute is mandatory. Valid values are defined in Section 4.5. reason: string specifying a reason for the status. The attribute is optional. The element has the following sequence of child elements: element (Section 4.3.2.1) describing capabilities of the package. The element is optional. element (Section 4.3.2.2) describing information about managed mixers. The element is optional. For example, a successful response to a request requesting capabilities and mixer information: McGlashan, et al. Expires May 29, 2010 [Page 45] Internet-Draft Mixer Control Package November 2009 H263 H264 PCMU PCMA PCMA 4.3.2.1. The element provides audit information about package capabilities. The element has no attributes. The element has the following sequence of child elements: McGlashan, et al. Expires May 29, 2010 [Page 46] Internet-Draft Mixer Control Package November 2009 : element (Section 4.4) describing codecs available to the package. The element is mandatory. For example, a fragment describing capabilities: H263 H264 PCMU PCMA 4.3.2.2. The element provides audit information about mixers. The element has no attributes. The element has the following sequence of child elements (0 or more occurrences, any order): : audit information for a conference mixer (Section 4.3.2.2.1). The element is optional. : audit information for a join mixer (Section 4.3.2.2.2). The element is optional. 4.3.2.2.1. The element has the following attributes: conferenceid: string identifying the conference (see Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]). The attribute is mandatory. The element has the following sequence of child elements: McGlashan, et al. Expires May 29, 2010 [Page 47] Internet-Draft Mixer Control Package November 2009 element describing codecs used in the conference. See Section 4.4. The element is optional. element listing connections or conferences joined to the conference. See Section 4.3.2.2.1.1. The element is optional. element describing the active video layout for the conference. See Section 4.2.1.4.2.1. The element is optional. For example, a fragment describing a conference which has been created but has no participants: And a fragment when the same conference has three participants (two connections and another conference) joined to it: PCMU 4.3.2.2.1.1. The element is a container for elements (Section 4.3.2.2.1.1.1). The element has no attributes, but the following child elements are defined (0 or more): : specifies a participant (Section 4.3.2.2.1.1.1). 4.3.2.2.1.1.1. The element describes a participant. The element has the following attributes: McGlashan, et al. Expires May 29, 2010 [Page 48] Internet-Draft Mixer Control Package November 2009 id: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework]. The attribute is mandatory. The element has no children. 4.3.2.2.2. The element has the following attributes: id1: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. id2: an identifier for either a connection or a conference. The identifier MUST conform to the syntax defined in Section 16.1 of [I-D.ietf-mediactrl-sip-control-framework] The attribute is mandatory. The element has no children. For example, a fragment describing an audit of two join mixers, one between connections and the second between conferences: 4.4. The element is a container for one or more codec definitions. Codec definitions are used by an AS to specify the codecs allowed for a conference (e.g. when used as a child of or element has no attributes. The element has the following sequence of child elements (0 or more occurrences): McGlashan, et al. Expires May 29, 2010 [Page 49] Internet-Draft Mixer Control Package November 2009 : defines a codec and optionally its policy (Section 4.4.1). The element is optional. For example, a fragment describing two codecs: PCMA H263 4.4.1. The element describes a codec. The element is modeled on the element in the XCON conference information data model ([I-D.ietf-xcon-common-data-model]) and allows addition information (e.g. rate, speed, etc) to be specified. The element has no attributes. The element has the following sequence of child elements: : element (Section 4.4.1.1) describing the codec's name. The element is mandatory. : element (Section 4.4.1.2) describing additional information about the codec. This package is agnostic to the names and values of the codec parameters supported by an implementation. The element is optional. For example, a fragment with a element describing the H263 codec: H263 And a fragment where the element describes the H264 codec with additional information about the profile level and packetization mode: McGlashan, et al. Expires May 29, 2010 [Page 50] Internet-Draft Mixer Control Package November 2009 H264 42A01E 0 4.4.1.1. The element specifies the name of a codec. The possible names are the values of the 'subtype' column of the RTP Payload Format media types per [RFC4855] defined in IANA ([IANA]). The element has no attributes and its content model is the codec name. 4.4.1.2. The element is a container for elements (Section 4.4.1.2.1). The element has no attributes, but the following child elements are defined (0 or more): : specifies a parameter name and value (Section 4.4.1.2.1). 4.4.1.2.1. The element describes a parameter name and value. The element has the following attributes: name: a string indicating the name of the parameter. The attribute is mandatory. type: specifies a type indicating how the inline value of the parameter is to be interpreted. A valid value is a MIME media type (see Section 4.6.6). The attribute is optional. The default value is "text/plain". The element content model (text and/or XML) is the value of the parameter. Values in XML format MUST use a namespace other than the one used in this specification. Note that a text value which contains XML characters (e.g. "<") needs to be escaped following standard XML conventions. McGlashan, et al. Expires May 29, 2010 [Page 51] Internet-Draft Mixer Control Package November 2009 4.5. Response Status Codes This section describes the response codes in Table 1 for the status attribute of mixer management (Section 4.2.3) and audit (Section 4.3.2) responses. The MS MUST support the status response codes defined here. All other valid but undefined values are reserved for future use, where a standards-track RFC is required to define new status codes. The AS MUST treat any responses it does not recognize as being equivalent to the x00 response code for all classes. For example, if an AS receives an unrecognized response code of 499, it can safely assume that there was something wrong with its request and treat the response as if it had received a 400 (Syntax error) response code. 4xx responses are definite failure responses from a particular MS. The reason attribute in the response SHOULD identify the failure in more detail, for example, "Mandatory attribute missing: id2 join element" for a 400 (Syntax error) response code. The AS SHOULD NOT retry the same request without modification (for example, correcting a syntax error or changing the conferenceid to use one available on the MS). However, the same request to a different MS might be successful; for example, if another MS supports a capability required in the request. 4xx failure responses can be grouped into three classes: failure due to a syntax error in the request (400); failure due to an error executing the request on the MS (405-419); and failure due to the request requiring a capability not supported by the MS (420-435). In cases where more than one request code could be reported for a failure, the MS SHOULD use the most specific error code of the failure class for the detected error. For example, if the MS detects that the conference identifier in the request is invalid, then it uses a 406 status code. However, if the MS merely detects that an execution error occurred, then 419 is used. McGlashan, et al. Expires May 29, 2010 [Page 52] Internet-Draft Mixer Control Package November 2009 +-------+---------------+----------------------+--------------------+ | Code | Summary | Description | Informational: AS | | | | | Possible Recovery | | | | | Action | +-------+---------------+----------------------+--------------------+ | 200 | OK | request has | | | | | succeeded | | | | | | | | 400 | Syntax error | request is | Change the request | | | | syntactically | so that it is | | | | invalid: it is not | syntactically | | | | valid with respect | valid. | | | | to the XML schema | | | | | specified in | | | | | Section 5 or it | | | | | violates a | | | | | co-occurrence | | | | | constraint for a | | | | | request element | | | | | defined in | | | | | Section 4. | | | | | | | | 405 | Conference | request uses an | Send an | | | already | identifier to create | request | | | exists | a new conference | (Section 4.3.1) | | | | (Section 4.2.1.1) | requesting the | | | | which is already | list of conference | | | | used by another | mixer identifiers | | | | conference on the | already used by | | | | MS. | the MS and then | | | | | use a conference | | | | | identifier which | | | | | is not listed. | | | | | | | 406 | Conference | request uses an | Send an | | | does not | identifier for a | request | | | exist | conference which | (Section 4.3.1) | | | | does not exist on | requesting the | | | | the MS. | list of conference | | | | | mixer identifiers | | | | | used by the MS and | | | | | then use a | | | | | conference | | | | | identifier which | | | | | is listed. | | | | | | McGlashan, et al. Expires May 29, 2010 [Page 53] Internet-Draft Mixer Control Package November 2009 | 407 | Incompatible | request specifies a | Change the media | | | stream | media stream | stream | | | configuration | configuration which | configuration to | | | | is in conflict with | match the | | | | itself, or the | capabilities of | | | | connection or | the connection or | | | | conference | conference | | | | capabilities (see | | | | | Section 4.2.2.2) | | | | | | | | 408 | joining | request attempts to | Send an | | | entities | create a join mixer | request | | | already | (Section 4.2.2.2) | (Section 4.3.1) | | | joined | where the entities | requesting the | | | | are already joined | list of join | | | | | mixers on the MS | | | | | and then use | | | | | entities which are | | | | | not listed. | | | | | | | 409 | joining | request attempts to | Send an | | | entities not | manipulate a join | request | | | joined | mixer where entities | (Section 4.3.1) | | | | which are not joined | requesting the | | | | | list of join | | | | | mixers on the MS | | | | | and then use | | | | | entities which are | | | | | listed. | | | | | | | 410 | Unable to | request attempts to | | | | join - | join a participant | | | | conference | to a conference | | | | full | (Section 4.2.2.2) | | | | | but the conference | | | | | is already full | | | | | | | | 411 | Unable to | request attempts to | | | | perform join | create, modify or | | | | mixer | delete a join | | | | operation | between entities but | | | | | fails | | | | | | | | 412 | Connection | request uses an | | | | does not | identifier for a | | | | exist | connection which | | | | | does not exist on | | | | | the MS. | | McGlashan, et al. Expires May 29, 2010 [Page 54] Internet-Draft Mixer Control Package November 2009 | 419 | Other | requested operation | | | | execution | cannot be executed | | | | error | by the MS. | | | | | | | | 420 | Conference | request to create a | | | | reservation | new conference | | | | failed | (Section 4.2.1.1) | | | | | failed due to | | | | | unsupported | | | | | reservation of | | | | | talkers or | | | | | listeners. | | | | | | | | 421 | Unable to | request to create or | | | | configure | modify a conference | | | | audio mix | failed due to | | | | | unsupported audio | | | | | mix. | | | | | | | | 422 | Unsupported | request contains one | | | | media stream | or more | | | | configuration | elements | | | | | (Section 4.2.2.5) | | | | | whose configuration | | | | | is not supported by | | | | | the MS. | | | | | | | | 423 | Unable to | request to create or | | | | configure | modify a conference | | | | video layouts | failed due to | | | | | unsupported video | | | | | layout | | | | | configuration. | | | | | | | | 424 | Unable to | request to create or | | | | configure | modify a conference | | | | video switch | failed due to | | | | | unsupported video | | | | | switch | | | | | configuration. | | | | | | | | 425 | Unable to | request to create or | | | | configure | modify a conference | | | | codecs | failed due to | | | | | unsupported codec. | | | | | | | McGlashan, et al. Expires May 29, 2010 [Page 55] Internet-Draft Mixer Control Package November 2009 | 426 | Unable to | request to join | | | | join - mixing | connection entities | | | | connections | (Section 4.2.2.2) | | | | not supported | failed due lack of | | | | | support for mixing | | | | | connections. | | | | | | | | 427 | Unable to | request to join | | | | join - mixing | conference entities | | | | conferences | (Section 4.2.2.2) | | | | not supported | failed due lack of | | | | | support for mixing | | | | | conferences. | | | | | | | | 428 | Unsupported | the request contains | | | | foreign | attributes or | | | | namespace | elements from | | | | attribute or | another namespace | | | | element | which the MS does | | | | | not support | | | | | | | | 435 | Other | request requires | | | | unsupported | another capability | | | | capability | not supported by the | | | | | MS | | +-------+---------------+----------------------+--------------------+ Table 1: status codes 4.6. Type Definitions This section defines types referenced in attribute definitions. 4.6.1. Boolean The value space of boolean is the set {true, false}. 4.6.2. Non-Negative Integer The value space of non-negative integer is the infinite set {0,1,2,...}. 4.6.3. Positive Integer The value space of positive integer is the infinite set {1,2,...}. McGlashan, et al. Expires May 29, 2010 [Page 56] Internet-Draft Mixer Control Package November 2009 4.6.4. String A string in the character encoding associated with the XML element. 4.6.5. Time Designation A time designation consists of a non-negative real number followed by a time unit identifier. The time unit identifiers are: "ms" (milliseconds) and "s" (seconds). Examples include: "3s", "850ms", "0.7s", ".5s" and "+1.5s". 4.6.6. MIME Media Type A string formated as a IANA MIME media type ([MIME.mediatypes]). McGlashan, et al. Expires May 29, 2010 [Page 57] Internet-Draft Mixer Control Package November 2009 5. Formal Syntax This section defines the XML schema for the Mixer Control Package. The schema defines datatypes, attributes, and mixer elements in the urn:ietf:params:xml:ns:msc-mixer namespace. In most elements the order of child elements is significant. The schema is extensible: elements allow attributes and child elements from other namespaces. Elements from outside this package's namespace can occur after elements defined in this package. The schema is dependent upon the schema (framework.xsd) defined in Section 16.1 of the Control Framework [I-D.ietf-mediactrl-sip-control-framework]. IETF MediaCtrl Mixer 1.0 (20090220) This is the schema of the Mixer control package. It defines request, response and notification elements for mixing. The schema namespace is urn:ietf:params:xml:ns:msc-mixer This import brings in the framework attributes for conferenceid and connectionid. This type is extended by other (non-mixed) component types to allow attributes from other namespaces. McGlashan, et al. Expires May 29, 2010 [Page 59] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 61] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 63] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 64] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 65] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 67] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 68] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 70] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 71] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 72] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 73] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 74] Internet-Draft Mixer Control Package November 2009 McGlashan, et al. Expires May 29, 2010 [Page 75] Internet-Draft Mixer Control Package November 2009 Figure 10: Mixer Package XML Schema McGlashan, et al. Expires May 29, 2010 [Page 76] Internet-Draft Mixer Control Package November 2009 6. Examples This section provides examples of the Mixer Control package. 6.1. AS-MS Framework Interaction Examples The following example assume a control channel has been established and synced as described in the Media Control Channel Framework ([I-D.ietf-mediactrl-sip-control-framework]). The XML messages are in angled brackets (with the root and other details omitted for clarity); the REPORT status is in round brackets. Other aspects of the protocol are omitted for readability. 6.1.1. Creating a conference mixer and joining a participant A conference mixer is created successfully and a participant is joined. Application Server (AS) Media Server (MS) | | | (1) CONTROL: | | ----------------------------------------> | | | | (2) 202 | | <--------------------------------------- | | | | | | (3) REPORT: | | (terminate) | | <---------------------------------------- | | | | (4) 200 | | ----------------------------------------> | | | | (5) CONTROL: | | ----------------------------------------> | | | | (6) 202 | | <--------------------------------------- | | | | (7) REPORT: | | (terminate) | | <---------------------------------------- | | | | (8) 200 | | ----------------------------------------> | McGlashan, et al. Expires May 29, 2010 [Page 77] Internet-Draft Mixer Control Package November 2009 6.1.2. Receiving active talker notifications An active talker notification event is sent by the MS. Application Server (AS) Media Server (MS) | | | (1) CONTROL: | | <--------------------------------------- | | | | (4) 200 | | ----------------------------------------> | | | 6.1.3. Conference termination The MS receives a request to terminate the conference, resulting in conferenceexit and participant unjoined notifications. Application Server (AS) Media Server (MS) | | | (1) CONTROL: | | ----------------------------------------> | | | | (2) 200: | | <--------------------------------------- | | | | (3) CONTROL: | | (unjoin-notify) | | <---------------------------------------- | | | | (4) 200 | | ----------------------------------------> | | | | (5) CONTROL: | | (conferenceexit) | | <---------------------------------------- | | | | (6) 200 | | ----------------------------------------> | 6.2. Mixing Examples The following examples show how the mixing package can be used to create audio conferences, bridge connections and video conferences. The examples do not specify all messages between the AS and MS. McGlashan, et al. Expires May 29, 2010 [Page 78] Internet-Draft Mixer Control Package November 2009 6.2.1. Audio conferencing The AS sends a request to create a conference mixer: The request specifies that the conference is assigned the conference id "conf1" and is configured with 2 reserved talkers, 3 reserved listener slots, audio mixing policy set to nbest and with active talkers notifications set to 5 seconds. If the MS is able to create this conference mixer, it sends 200 response: The AS is now able to join connections to the conference as participants. A participant able to contribute to the audio mix would be joined as follows: If the MS can join the participant 1536067209:913cd14c to the conference conf1 with audio in both directions, then it sends a successful response: The AS could also join listener-only participants to the conference by setting the stream direction to receive only: McGlashan, et al. Expires May 29, 2010 [Page 79] Internet-Draft Mixer Control Package November 2009 If the MS can join the participant 9936067209:914cd14c to the conference conf1 then it would send a successful response (not shown). As the active talker changes, the MS sends an active talker notification to the AS: The AS could decide to change the status of a talker connection so that they can only listen: Where the participant 1536067209:913cd14c is no longer able to contribute to the audio mix on the conference. If the MS is able to execute this request, it would send a 200 response. The AS could decide to remove this participant from the conference: Again, if the MS can execute this request, a 200 response would be sent. Finally, the AS terminates the conference: McGlashan, et al. Expires May 29, 2010 [Page 80] Internet-Draft Mixer Control Package November 2009 If the MS is able to destroy the conference conf1, it sends a 200 response: For each participant attached to the conference when it is destroyed, the MS sends an unjoin notification event: And the MS sends a conferenceexit notification event when the conference finally exits: 6.2.2. Bridging connections The mixer package can be used to join connections to one another. In a call center scenario, for example, this package can be used to set up and modify connections between a caller, agent and supervisor. A caller is joined to an agent with bi-directional audio: If the MS is able to establish this connection, then it would send a 200 response: Now assume that the AS wants a supervisor to listen into the agent McGlashan, et al. Expires May 29, 2010 [Page 81] Internet-Draft Mixer Control Package November 2009 conversation with the caller and provide whispered guidance to the agent. First the AS would send a request to join the supervisor and the caller connections: If this request was successful, audio output from the caller connection would now be sent to both the agent and the supervisor. Second, the AS would send a request to join the supervisor and the agent connections: If this request was successful, the audio mixing would occur on both the agent and supervisor connections: the agent would hear the caller and supervisor, and the supervisor would hear the agent and caller. The caller would only hear the agent. If the MS is unable to join and mix connections in this way, it would send a 426 response. 6.2.3. Video conferencing In this example, an audio video-conference is created with the loudest participant has the most prominent region in the video layout. The AS sends a request to create an audio-video conference: single-view dual-view quad-view multiple-5x1 McGlashan, et al. Expires May 29, 2010 [Page 82] Internet-Draft Mixer Control Package November 2009 In this configuration, the conference uses a nbest audio mixing policy and a vas video switch policy, so that the loudest speaker receives the most prominent region in the layout. Multiple video layouts are specified and active one depends on the number of participants. Assume that 4 participants are already joined to the conference. In that case, the video layout will be quad-view (Figure 6) with the most active speaker displayed in region 1. When a fifth participant joins, the video layout automatically switches to a multiple-5x1 layout (Figure 9), again with the most active speaker in region 1. The AS can manipulate which participants are displayed in the remaining regions. For example, it could force an existing conference participant to be displayed in region 2: 2 McGlashan, et al. Expires May 29, 2010 [Page 83] Internet-Draft Mixer Control Package November 2009 7. Security Considerations As this control package processes XML markup, implementations MUST address the security considerations of [RFC3023]. As a Control Package of the Media Control Channel Framework, security, confidentiality and integrity of messages transported over the control channel MUST be addressed as described in Section 11 of the Media Control channel Framework ([I-D.ietf-mediactrl-sip-control-framework]), including Transport Level Protection, Control Channel Policy Management and Session Establishment. In addition, implementations MUST address security, confidentiality and integrity of User Agent sessions with the MS, both in terms of SIP signaling and associated RTP media flow; see [I-D.ietf-mediactrl-sip-control-framework] for further details on this topic. Adequate transport protection and authentication are critical, especially when the implementation is deployed in open networks. If the implementation fails to correctly address these issues, it risks exposure to malicious attacks, including (but not limited to): Denial of Service: An attacker could insert a request message into the transport stream causing specific conferences or join mixers on the MS to be destroyed. For example, , where the value of "XXXX" could be guessed or discovered by auditing active mixers on the MS using an request. Likewise, an attacker could impersonate the MS and insert error responses into the transport stream so denying the AS access to package capabilities. Resource Exhaustion: An attacker could insert into the control channel new request messages (or modify existing ones) with, for instance, elements causing large numbers of conference mixer resources to be allocated. At some point this will exhaust the number of conference mixers that the MS is able to allocate. The Media Control Channel Framework permits additional policy management, including resource access and control channel usage, to be specified at the control package level beyond that specified for the Media Control Channel Framework (see Section 11.3 of [I-D.ietf-mediactrl-sip-control-framework]). Since creation of conference and join mixers is associated with media mixing resources on the MS, the security policy for this control package needs to address how such mixers are securely managed across more than one control channels. Such a security policy is only McGlashan, et al. Expires May 29, 2010 [Page 84] Internet-Draft Mixer Control Package November 2009 useful for secure, confidential and integrity protected channels. The identity of control channels is determined by the channel identifier: i.e. the value of the cfw-id attribute in the SDP and Dialog-ID header in the channel protocol (see [I-D.ietf-mediactrl-sip-control-framework]). Channels are the same if they have the same identifier; otherwise, they are different. This control package imposes the following additional security policies: Responses: The MS MUST only send a response to a mixer management or audit request using the same control channel as the one used to send the request. Notifications: The MS MUST only send notification events for conference and join mixers using the same control channel as it received the request creating the mixer. Auditing: The MS MUST only provide audit information about conference and join mixers which have been created on the same control channel as the one upon the request is sent. For example, if a join between two connections has been created on one channel, then a request on another channel to audit all mixers - - would not report on this join mixer. Rejection: The MS SHOULD reject requests to audit or manipulate an existing conference or join mixer on the MS if the channel is not the same as the one used when the mixer was created. The MS rejects a request by sending a Control Framework 403 response (see Section 7.4 and Section 11.3 of [I-D.ietf-mediactrl-sip-control-framework]). For example, if a channel with identifier 'cfw1234' has been used to send a request to create a particular conference and the MS receives on channel 'cfw98969' a request to audit or destroy this particular conference, then the MS sends a 403 framework response. There can be valid reasons why an implementation does not reject an audit or mixer manipulation request on a different channel from the one which created the mixer. For example, a system administrator might require a separate channel to audit mixer resources created by system users and to terminate mixers consuming excessive system resources. Alternatively, a system monitor or resource broker might require a separate channel to audit mixers managed by this package on a MS. However, the full implications need to be understood by the implementation and carefully weighted before accepting these reasons as valid. If the reasons are not valid in their particular circumstances, the MS rejects such requests. There can also be valid reasons for 'channel handover' including high McGlashan, et al. Expires May 29, 2010 [Page 85] Internet-Draft Mixer Control Package November 2009 availability support or where one AS needs to take over management of mixers after the AS which created them has failed. This could be achieved by the control channels using the same channel identifier, one after another. For example, assume a channel is created with the identifier 'cfw1234' and the channel is used to create mixers on the MS. This channel (and associated SIP dialog) then terminates due to a failure on the AS. As permitted by the Control Framework, the channel identifier 'cfw1234' could then be reused so that another channel is created with the same identifier 'cfw1234', allowing it to 'take over' management of the mixers on the MS. Again, the implementation needs to understand the full implications and carefully weight them before accepting these reasons as valid. If the reasons are not valid for their particular circumstances, the MS uses the appropriate SIP mechanisms to prevent session establishment when the same channel identifier is used in setting up another control channel (see Section 4 of [I-D.ietf-mediactrl-sip-control-framework]). McGlashan, et al. Expires May 29, 2010 [Page 86] Internet-Draft Mixer Control Package November 2009 8. IANA Considerations This specification instructs IANA to register a new Media Control Channel Framework Package, a new XML namespace, a new XML schema and a new MIME type. 8.1. Control Package Registration This section registers a new Media Control Channel Framework package, per the instructions in Section 12.1 of [I-D.ietf-mediactrl-sip-control-framework]. To: ietf-sip-control@iana.org Subject: Registration of new Channel Framework package Package Name: msc-mixer/1.0 [NOTE TO IANA/RFC-EDITOR: Please replace XXXX with the RFC number for this specification.] Published Specification(s): RFCXXXX Person & email address to contact for further information: IETF, MEDIACTRL working group, (mediactrl@ietf.org), Scott McGlashan (smcg.stds01@mcglashan.org). 8.2. URN Sub-Namespace Registration This section registers a new XML namespace, "urn:ietf:params:xml:ns:msc-mixer", per the guidelines in RFC 3688 [RFC3688]. McGlashan, et al. Expires May 29, 2010 [Page 87] Internet-Draft Mixer Control Package November 2009 URI: urn:ietf:params:xml:ns:msc-mixer Registrant Contact: IETF, MEDIACTRL working group, (mediactrl@ietf.org), Scott McGlashan (smcg.stds01@mcglashan.org). XML: BEGIN Media Control Channel Framework Mixer Package attributes

Namespace for Media Control Channel Framework Mixer Package attributes

urn:ietf:params:xml:ns:msc-mixer

[NOTE TO IANA/RFC-EDITOR: Please replace XXXX with the RFC number for this specification.]

See RFCXXXX

END 8.3. XML Schema Registration This section registers an XML schema as per the guidelines in RFC 3688 [RFC3688]. URI: urn:ietf:params:xml:ns:msc-mixer Registrant Contact: IETF, MEDIACTRL working group, (mediactrl@ietf.org), Scott McGlashan (smcg.stds01@mcglashan.org). Schema: The XML for this schema can be found in Section 5 of this document. 8.4. MIME Media Type Registration for 'application/msc-mixer+xml' This section registers the "application/msc-mixer+xml" MIME type. McGlashan, et al. Expires May 29, 2010 [Page 88] Internet-Draft Mixer Control Package November 2009 To: ietf-types@iana.org Subject: Registration of MIME media type application/msc-mixer+xml MIME media type name: application MIME subtype name: msc-mixer+xml Required parameters: (none) Optional parameters: charset Indicates the character encoding of enclosed XML. Default is UTF-8. Encoding considerations: Uses XML, which can employ 8-bit characters, depending on the character encoding used. See RFC 3023 [RFC3023], section 3.2. Security considerations: No known security considerations outside of those provided by the Media Control Channel Framework Mixer Package. Interoperability considerations: This content type provides constructs for the Media Control Channel Framework Mixer package. Published specification: RFC XXXX [NOTE TO IANA/RFC-EDITOR: Please replace XXXX with the RFC number for this specification.] Applications which use this media type: Implementations of the Media Control Channel Framework Mixer package. Additional Information: Magic Number(s): (none) File extension(s): (none) Macintosh File Type Code(s): (none) Person & email address to contact for further information: Scott McGlashan Intended usage: LIMITED USE Author/Change controller: The IETF Other information: None. McGlashan, et al. Expires May 29, 2010 [Page 89] Internet-Draft Mixer Control Package November 2009 9. Change Summary Note to RFC Editor: Please remove this whole section. The following are the changes between the -08 and -07 versions. o 8.4: Changed file extension from '.xml' to (none) o Changed "~" to a ":" for connectionid o 4.2.6.1: Clarified that can contain an XML value. o 4.2.4.2: Changed status codes so that only 0-2 defined and all others are reserved for future use requiring a standard-track RFC. o 4.2.4.3: Changed status codes so that only 0-2 defined and all others are reserved for future use requiring a standard-track RFC. o 4.5: Changed status code for and so that certain codes are defined and all others are reserved for future use requiring a standard-track RFC. The following are the changes between the -07 and -06 versions. o Generally corrected references from Section 17.1 to Section 16.1 of Control Channel Framework. o 4.2.2.2: removed "is" in "unless this is leads to a stream conflict" o 4.2.2.3: corrected error code from 408 to 409 for "If the specified entities are not already joined, then the MS reports an error (408)." o 4.2.1.4.3: corrected error code from 409 to 424 for "If the MS does not support the specified video switching policy or ..., then MS reports a 409 error". o 4.2.1.4.2: corrected error code from 408 to 423 for "If the MS does not support video conferencing at all, or ...., the MS reports an 408 error ..." o 4.2.1.1, 4.2.1.2, 4.2.2.2, 4.2.2.3: Clarified that specified in or impose a limitation in the media capability of a conference and this limitation affects whether the conference can be or McGlashan, et al. Expires May 29, 2010 [Page 90] Internet-Draft Mixer Control Package November 2009 ed to another entity. The following are the changes between the -06 and -05 versions. o 4.4.1: : corrected typos, added an example of usage, added a section and moved the section inside this section. o 8: IANA Considerations: Updated IANA registration information and added registration for the XML Schema The following are the changes between the -05 and -04 versions. o Schema: Fixed problem with non-deterministic content models. o 7. Security Considerations: Added requirement that implementations need to secure SIP and RTP sessions with User Agents. The following are the changes between the -04 and -03 versions. o 4.2.1.4.3: corrected typo o 4.2.2.3: Clarified the behavior of for cases where each direction of a stream is independently controlled. o 4.2.2.5: Corrected syntax error in examples. o 4.2.2.5.1: Clarified that when an audio stream is in the muted state, then a automatic or setgain control causes the state to change automatically to unmuted. o 7 Security: Clarified that both conference and join mixers are covered by the package security policies. o 7 Security: Added a denial of service example where the attacker impersonates the MS. o 7 Security: Clarified that the package security policy for multiple channels is only useful if the channels themselves are secured. o Updated acknowledgements. The following are the major changes between the -03 and -02 versions. o Corrected various typos and nits. McGlashan, et al. Expires May 29, 2010 [Page 91] Internet-Draft Mixer Control Package November 2009 o Conformance language: Removed unnecessary MUSTs, especially for error codes. Changed most RECOMMENDEDs to MUST or MAY. Removed lowercase 'should', 'must' and 'may'. o Tidied up Abstract o Removed old Introduction section (it just duplicated the abstract). Replaced it with the old Overview Section. Section numbering changed! o Introduction: Clarified which MediaCtrl Requirements are satisfied by this package. o 4.2.1.1: : Clarified that an attempt to create a conference with an identifier already used by an existing conference does not affect the existing conference (405 error response). o 4.2.1.4.1: : Added a 'n' attribute for the number of participants to be included in nbest audio mixing. o 4.2.1.4.3: : Clarified that the active speaker in video switching is the loudest speaker. o 4.2.1.4.4: : Clarified that if a subscription specified in a foreign namespace element or attribute is not supported by the MS, then the MS generates a 428 error response. Changed conformance support for from SHOULD to MUST. Removed 422 error response. o 4.2.2: Joining Elements: Added text to the empty section. o 4.2.2.2, 4.2.2.3, 4.2.2.4: , and : Clarified that join operation failures do not affect existing stream properties of the entities (407 and new 422 error response). Clarified stream failure errors in and . o 4.2.2.2: . Clarified that elements can be used to independently control properties of the media flow in different directions. Added a response code (422) for when the MS does not support a media stream configuation. o 4.2.2.2: . Clarified that error responses are generated if id1 or id2 reference a conference or connection which does not exist. Added an error status code (412) for non-existant connections. McGlashan, et al. Expires May 29, 2010 [Page 92] Internet-Draft Mixer Control Package November 2009 o 4.2.2.5: : Changed the definition so that in each child element, the media stream affected is indicated by the value of the direction attribute of the parent element. Added examples of controlling the media flow properties. o 4.2.4.2: . Added reserved range of status codes. Changed code from 1 to 0 for the unjoin case. Changed code from 3 to 1 for execution error. o 4.2.4.3: . Added reserved range of status codes. Changed code from 1 to 0 for the destroyconference case (align with IVR). Added a code for conference exiting due to exceeding its maximum duration. o Schema: Adding missing version attribute on . o Security Considerations: Major update. Added examples showing malicious attacks when channel security is not correctly addressed. Added more details on multiple channel cases including administrator and monitor channels as well as channel handover. o Removed affliations in Contributors section. The following are the major changes between the -02 and -01 versions. o Section 4: Aligned Control Package definitions with requirements in Section 8 of the Control Framework. o Following October Interim meeting discussion on response codes, generally clarified usage of error status codes, modified some codes and re-organized the response codes section (Section 4.5) with more guidance and details. o MIXER-006. No action required following October 2008 interim discussion. o MIXER-008. No action required following October 2008 interim discussion. o MIXER-009. No action required for control package - addressed in -05 framework draft following interim October 2008 discussion. o MIXER-010/5.2.2.5: Clarified that in the element, an "inactive" direction value indicates the stream is established but there is no media flow. Such a stream can be manipulated by and . McGlashan, et al. Expires May 29, 2010 [Page 93] Internet-Draft Mixer Control Package November 2009 o 5.2.2.5: : Clarified that the media stream specified in child elements , , and is the stream originating from the entity identified as id1. o 5.2.1.4.3: : Clarified that it is not an error if a specifies a region which is not defined for the currently active video layout. o 5.2.1.4.2.1: : Added descriptions and ASCII art for layout and regions of XCON video layouts. o Added examples of audio conferencing, connection bridging and video conferencing. The following are the major changes between the -01 and -00 versions. o [MIXER-001]/5.2.4.3: Added notification event. o [MIXER-003]/5.2.1.4.2.1: Added ASCII diagrams for video layouts. o [MIXER-004]/5.3.2.2.1: Added active information to . o [MIXER-007]/5.4.1: Added inside so additional codec information can be specified. o 5.2.1.1: Fixed example with missing min- participants attributes. o 5: Changed handling of unsupported foreign namespace elements and attributes. The MS send a 427 error response if it encounters foreign elements and attributes it does not support. o 5.2.1.4.3: . Clarified that the VAS policy is implementation-specific if a participant provides more than one audio stream. o 5.2.2.2/5.2.2.3/5.2.2.4: Clarified that joining behavior so that streams which have previously been ed or ed are not affected by a general . o 5.2.1.4.3: : Added support for whether active speaker is displayed on their video layout ('activespeakermix' attribute) and clarified that personal video mixes are out of scope for this package. o 5.2.1.4.3/5.2.2.5.4: : Added support for a priority mechanism in video switching policy and a . o 8:Updated security section o 13:Updated references o 5.2.1.4.4.1: Added default of 3 seconds for interval. o 5.2.2.5.1: controltype attribute set to mandatory. o Updated schema The following are the major changes between the -00 of this work group item draft and the individual submission -04 version. o Control package name is now 'msc-mixer/1.0'. Namespace is now 'urn:ietf:params:xml:ns:msc-mixer'. Mime type is now 'application/msc-mixer+xml'. o Added XML root element . o Editorial tidy up of sections. o Added audit request/response elements. o Added video layout and switching conference configuration. o : changed 'mix-type' attribute to 'type' (consistency with video-switch) o Added "inactive" as value of 's direction attribute. o Added child to element. o : element is no longer mandatory; added and child elements. reserved- talkers and reserved-listeners as attributes. o replaced conf-id attribute with conferenceid attribute. o Removed element. Active talkers subscription and notifications used dedicated elements now. o Added notification event to indicate when (un)expected joins occur. Use case: connection or conference joined to a conference and conference exits (either by request or runtime error. McGlashan, et al. Expires May 29, 2010 [Page 95] Internet-Draft Mixer Control Package November 2009 The following are the major changes between the -04 of the draft and the -03 version. o Updated reference for Media Control Channel Framework The following are the major changes between the -03 of the draft and the -02 version. o None The following are the major changes between the -02 of the draft and the -01 version. o clarified the model for join operations and introduced several new package error codes o added definition for MS connection The following are the major changes between the -01 of the draft and the -00 version. o restructured into single request response model for non-trivial operations o aligned with XML structure of other control framework packages McGlashan, et al. Expires May 29, 2010 [Page 96] Internet-Draft Mixer Control Package November 2009 10. Contributors Asher Shiratzky provided valuable support and contributions to early versions of this document. The authors would like to thank the Mixer design team consisting of Roni Even, Lorenzo Miniero, Adnan Saleem, Diego Besprosvan and Mary Barnes who provided valuable feedback, input, diagrams and text to this document. McGlashan, et al. Expires May 29, 2010 [Page 97] Internet-Draft Mixer Control Package November 2009 11. Acknowledgments The authors would like to thank Roni Even, Lorenzo Miniero, Steve Buko and Stephane Bastien for expert reviews of this work. Shawn Emery carried out a thorough security review. McGlashan, et al. Expires May 29, 2010 [Page 98] Internet-Draft Mixer Control Package November 2009 12. References 12.1. Normative References [I-D.ietf-mediactrl-sip-control-framework] Boulton, C., Melanchuk, T., and S. McGlashan, "Media Control Channel Framework", draft-ietf-mediactrl-sip-control-framework-11 (work in progress), October 2009. [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, March 1997. [RFC3023] Murata, M., St. Laurent, S., and D. Kohn, "XML Media Types", RFC 3023, January 2001. [RFC3688] Mealling, M., "The IETF XML Registry", BCP 81, RFC 3688, January 2004. [RFC4574] Levin, O. and G. Camarillo, "The Session Description Protocol (SDP) Label Attribute", RFC 4574, August 2006. [XML] Bray, T., Paoli, J., Sperberg-McQueen, C M., Maler, E., and F. Yergeau, "Extensible Markup Language (XML) 1.0 (Third Edition)", W3C Recommendation, February 2004. 12.2. Informative References [I-D.ietf-xcon-common-data-model] Novo, O., Camarillo, G., Morgan, D., and J. Urpalainen, "Conference Information Data Model for Centralized Conferencing (XCON)", draft-ietf-xcon-common-data-model-14 (work in progress), November 2009. [IANA] "IANA registry for RTP Payload Types", . [MIME.mediatypes] "IANA registry for MIME Media Types", . [MSML] Saleem, A., Xin, Y., and G. Sharratt, "Media Session Markup Language (MSML)", draft-saleem-msml-09 (work in progress), July 2009. [RFC3261] Rosenberg, J., Schulzrinne, H., Camarillo, G., Johnston, A., Peterson, J., Sparks, R., Handley, M., and E. Schooler, "SIP: Session Initiation Protocol", RFC 3261, McGlashan, et al. Expires May 29, 2010 [Page 99] Internet-Draft Mixer Control Package November 2009 June 2002. [RFC3550] Schulzrinne, H., Casner, S., Frederick, R., and V. Jacobson, "RTP: A Transport Protocol for Real-Time Applications", STD 64, RFC 3550, July 2003. [RFC4855] Casner, S., "Media Type Registration of RTP Payload Formats", RFC 4855, February 2007. [RFC5022] Van Dyke, J., Burger, E., and A. Spitzer, "Media Server Control Markup Language (MSCML) and Protocol", RFC 5022, September 2007. [RFC5167] Dolly, M. and R. Even, "Media Server Control Protocol Requirements", RFC 5167, March 2008. McGlashan, et al. Expires May 29, 2010 [Page 100] Internet-Draft Mixer Control Package November 2009 Authors' Addresses Scott McGlashan Hewlett-Packard Email: smcg.stds01@mcglashan.org Tim Melanchuk Rain Willow Communications Email: tim.melanchuk@gmail.com Chris Boulton NS-Technologies Email: chris@ns-technologies.com McGlashan, et al. Expires May 29, 2010 [Page 101]