RFC 9706: TreeDN: Tree-Based Content Delivery Network (CDN) for Live Streaming to Mass Audiences
- L. Giuliano,
- C. Lenart,
- R. Adam
Abstract
As Internet audience sizes for high-interest live events reach
unprecedented levels and bitrates climb to support formats and applications such as 4K, 8K, and Augmented Reality (AR), live streaming can place a unique type of stress upon network
resources. TreeDN is a tree-based Content Delivery Network (CDN) architecture designed to address
the distinctive scaling challenges of live streaming to mass audiences.
TreeDN enables operators to offer Replication
Status of This Memo
This document is not an Internet Standards Track specification; it is published for informational purposes.¶
This document is a product of the Internet Engineering Task Force (IETF). It represents the consensus of the IETF community. It has received public review and has been approved for publication by the Internet Engineering Steering Group (IESG). Not all documents approved by the IESG are candidates for any level of Internet Standard; see Section 2 of RFC 7841.¶
Information about the current status of this document, any
errata, and how to provide feedback on it may be obtained at
https://
Copyright Notice
Copyright (c) 2025 IETF Trust and the persons identified as the document authors. All rights reserved.¶
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(https://
1. Introduction
As Internet audience sizes for high-interest live events reach
unprecedented levels and bitrates climb to support formats and applications such as 4K, 8K, and Augmented
Reality (AR), live streaming can place a unique type of stress upon
network resources. TreeDN is a tree-based Content Delivery Network (CDN) architecture designed
to address the distinctive scaling challenges of live streaming to
mass audiences. TreeDN enables operators to offer Replication
2. Requirements Language
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.¶
3. Problem Statement
Live streaming to mass audiences can impose unique demands on network resources. For example, live sporting events that broadcast over the Internet to end users have a much lower tolerance for long playout buffers than typical on-demand video streaming. Viewers of live sporting events have long been conditioned by broadcast television to expect to see the content in real time, with only very short buffers for broadcast delays to prevent profanity and other objectionable content from making on the air (this is known as the "seven-second delay" [BROADCAST-DELAY]). With micro-betting, even this 5 to 10 second delay can be too long. By comparison, when watching on-demand movies, an extra one- or two-minute playout buffer tends to be perfectly acceptable for viewers. If playout buffers for live sports are that long, viewers run the risk of being alerted to a game-winning score from text messages from friends or cheers from the bar across the street minutes before they view it themselves.¶
Another unique characteristic of live streaming is the join rate. While on-demand video streaming can consume massive amounts of network resources, the viewing rates tend to be smooth and predictable. Service Providers (SPs) observe gradual levels of traffic increases over the evening hours corresponding to prime-time viewing habits. By comparison, viewing rates of live video streams can more closely resemble a step function with much less predictability as mass audiences of viewers tune in to watch the game at the same time.¶
Previous efforts for more efficient network replication of
multi
TreeDN is a tree-based CDN architecture that is the result of the
evolution of network-based replication mechanisms and is based on lessons
learned from what has and has not worked well in the past. TreeDN
addresses the fundamental issues of what has hindered multicast from
adoption on the global Internet and enables SPs the
opportunity to deliver new Replication
By more efficiently supporting multi
4. Applicability
While the primary use case mentioned throughout this document is live streaming of multimedia content (e.g., audio, video, AR, and real-time telemetry data), the TreeDN architecture can provide efficient delivery for any content that needs to be replicated and delivered to multiple destinations. For example, large software file updates (e.g., OS upgrades) that need to be delivered to many end users in a very short window of time can cause significant strain on network resources. Using TreeDN, this use case can be handled much more efficiently by the network.¶
5. Multicast Challenges in the Past
The following issues have been some of the primary challenges for deployment of IP multicast over the global Internet. This is not intended to be an exhaustive list but rather a list that provides context for the solution and how it addresses these primary challenges.¶
TreeDN is the evolution of network-based replication based on lessons learned over decades and is designed to address the problems listed above.¶
6. TreeDN Architecture
TreeDN leverages a simplified model for multicast deployment combined with network overlays to deliver traffic to receiving hosts on unicast-only networks. With network overlays, a service can be achieved and delivered to end users while recognizing and tolerating the practical realities of what is possible over a network as diverse as the global Internet. That is, the replication service is available to users and applications across the global Internet regardless of what protocols may exist in the underlying networks that constitute the underlay.¶
6.1. TreeDN Overlays
One overlay technology that TreeDN leverages is Automatic Multicast
Tunneling (AMT) [RFC7450]. With AMT, end hosts on
unicast-only networks (AMT Gateways) can dynamically build tunnels to
routers on the multicast
To support receiving on both native and non-native networks, receiving hosts can first attempt to join the traffic natively, and if no multicast traffic is received, they can fall back to AMT. This fallback mechanism can be handled by the application layer.¶
In addition to AMT, other overlay technologies like the Locator/ID
Separation Protocol (LISP) [RFC9300] can be utilized to
deliver content from multicast
6.2. TreeDN Native On-Net
Networks that support multicast provide the native on-net component
of TreeDN. The primary requirement of the native on-net component is to support
Source-Specific Multicast (SSM) [RFC4607]. PIM-SSM,
which is merely a subset of PIM-SM, is the multicast routing protocol
typically used in SSM. However, any multicast routing protocol
capable of supporting SSM can be used in the TreeDN native on-net component, such
as mLDP, Global Table Multicast (GTM) [RFC7716],
BGP-based Multicast [BGP-MULTICAST], or
even BGP Multicast VPN (BGP-MVPN) [RFC6513] for those operators
who carry
the global routing table in a Virtual Routing and Forwarding (VRF) table.
Likewise, any data plane
technology that supports SSM, including Bit Index Explicit Replication
(BIER) [RFC8279] and Segment Routing (SR) Point
The key benefit of SSM as the native on-net component of TreeDN is that it radically simplifies the control plane needed to support replication in the network. This simplification comes by moving source discovery from the network layer to some sort of out-of-band mechanism, usually in the application layer. In SSM, the receiver uses the Internet Group Management Protocol Version 3 (IGMPv3) [RFC3376] for IPv4 or the Multicast Listener Discovery Version 2 (MLDv2) protocol [RFC3810] for IPv6 to specify both the source and group address of the multicast stream. This allows the last-hop router to immediately join the multicast stream along the shortest-path tree (SPT) without the need for shared trees. This benefit addresses the "It's Too Complex" problem. By eliminating the need for network-based source discovery, most of the complexity of multicast is then eliminated, which reduces the cost of deploying and operating a multicast network. Further rationale for this SSM-only approach can be found in Any-Source Multicast (ASM) Deprecation [RFC8815].¶
7. Replication-as-a-Service (RaaS)
Content providers have traditionally used CDNs to distribute content
that needs to be delivered to large audiences, essentially outsourcing
the task of replication to CDN providers. Most CDNs utilize unicast
delivery, as multicast is not an option due to its lack of general
availability on the global Internet. TreeDN is a CDN architecture that
leverages tree-based replication to more efficiently utilize network
resources to deliver simultaneous multi
TreeDN has several advantages over traditional unicast-based CDN approaches. First, the TreeDN functionality can be delivered entirely by the existing network infrastructure. Specifically, for operators with routers that support AMT natively, multicast traffic can be delivered directly to end users without the need for specialized CDN devices, which typically are servers that need to be racked, powered, cooled, and connected to ports on routers that otherwise could have been consumed by paying customers. In this way, SPs can offer new RaaS functionality to content providers at potentially zero additional cost in new equipment.¶
Additionally, TreeDN is an open architecture that leverages mature,
IETF-specified, and widely implemented network protocols. TreeDN also
requires far less coordination between the content provider and the CDN
operator. That is, there are no storage requirements for the data, nor
group-key management issues, since a TreeDN provider merely forwards
packets. A TreeDN provider simply needs to have enough accounting data
(e.g., traffic data, number of AMT tunnels, etc.) to properly bill
customers for the service. By contrast, traditional unicast-based CDNs
often incorporate proprietary, non
TreeDN introduces a deployment model that requires new considerations for transport-layer mechanisms that are frequently relied upon by traditional unicast-based CDNs. A discussion on these considerations and differences can be found in Section 9.¶
8. Decentralization/Democratization of Content Sourcing
TreeDN is an inherently decentralized architecture. This reduces the
cost for content sourcing, as any host connected to a multicast
10. TreeDN Deployments
EUMETCast Terrestrial is a service from the European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT) that delivers
meteorological satellite data to end users for purposes such as
operational monitoring of climates and detection of global climate
changes. EUMETCast Terrestrial connects to the GEANT network, which
provides TreeDN services to deliver this real-time data natively to end
users on multicast
The Multicast Menu [Multicast-Menu] is a web-based portal that can list and launch
active multicast streams that are available on a global TreeDN network
of various research and education networks. Details of this TreeDN
network, as well as the Multicast Menu, are described in [Offnet
The RARE network is a global testbed interconnecting several National
Research and Education Networks (NRENs) via routers running BIER. AMT
relays are deployed to deliver multicast traffic from sources on the
RARE network to receivers on unicast-only networks across the Internet.
Details of the RARE network are described in [BIER
11. Operational Considerations
TreeDN is essentially the synthesis of SSM plus overlay networking technologies like AMT. As such, any existing tools to manage, operate, and troubleshoot a PIM-SSM domain and an AMT deployment can be used to manage a TreeDN deployment. Protocol error handling for PIM-SSM can be found in [RFC4607] and in Section 4.8 of [RFC7761]; for AMT, it can be found in [RFC7450].¶
One potential operational benefit of a multicast-based approach like
TreeDN over a traditional, unicast-based CDN is the visibility that
multicast state provides in the routing infrastructure. That is,
multicast routers maintain a forwarding cache of multicast flows that
usually includes the source address, group address, incoming
Additionally, since multicast leverages Reverse Path Forwarding
(RPF), the source of the content can potentially have a greater
influence over the path taken through the network from source to native
receivers/AMT relays. That is, the BGP peer advertising the
reachability of the source's subnet can do so in ways where a particular path through the network is preferred for multicast distribution; these methods are
not as easy to accomplish with traditional, destination
12. Security Consideration
Since TreeDN is essentially the synthesis of SSM plus overlay
networking technologies like AMT, the TreeDN architecture introduces no
new security threats that are not already documented in SSM and the
overlay technologies that comprise it. In particular, Section 6 of [RFC7450] candidly notes that
AMT, like UDP, IGMP, and MLD, provides no mechanisms for ensuring message
delivery or integrity, nor does it provide confidentiality
[RFC4609] and [RFC8815] describe the additional security benefits of using SSM instead of ASM.¶
13. IANA Considerations
This document has no IANA actions.¶
14. References
14.1. Normative References
- [RFC2119]
-
Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10
.17487 , , <https:///RFC2119 www >..rfc -editor .org /info /rfc2119 - [RFC3376]
-
Cain, B., Deering, S., Kouvelas, I., Fenner, B., and A. Thyagarajan, "Internet Group Management Protocol, Version 3", RFC 3376, DOI 10
.17487 , , <https:///RFC3376 www >..rfc -editor .org /info /rfc3376 - [RFC3810]
-
Vida, R., Ed. and L. Costa, Ed., "Multicast Listener Discovery Version 2 (MLDv2) for IPv6", RFC 3810, DOI 10
.17487 , , <https:///RFC3810 www >..rfc -editor .org /info /rfc3810 - [RFC4607]
-
Holbrook, H. and B. Cain, "Source-Specific Multicast for IP", RFC 4607, DOI 10
.17487 , , <https:///RFC4607 www >..rfc -editor .org /info /rfc4607 - [RFC6388]
-
Wijnands, IJ., Ed., Minei, I., Ed., Kompella, K., and B. Thomas, "Label Distribution Protocol Extensions for Point
-to , RFC 6388, DOI 10-Multipoint and Multipoint -to -Multipoint Label Switched Paths" .17487 , , <https:///RFC6388 www >..rfc -editor .org /info /rfc6388 - [RFC7450]
-
Bumgardner, G., "Automatic Multicast Tunneling", RFC 7450, DOI 10
.17487 , , <https:///RFC7450 www >..rfc -editor .org /info /rfc7450 - [RFC7761]
-
Fenner, B., Handley, M., Holbrook, H., Kouvelas, I., Parekh, R., Zhang, Z., and L. Zheng, "Protocol Independent Multicast - Sparse Mode (PIM-SM): Protocol Specification (Revised)", STD 83, RFC 7761, DOI 10
.17487 , , <https:///RFC7761 www >..rfc -editor .org /info /rfc7761 - [RFC8174]
-
Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10
.17487 , , <https:///RFC8174 www >..rfc -editor .org /info /rfc8174
14.2. Informative References
- [Algorhyme]
-
Wikipedia, "Radia Perlman", , <https://
en >..wikipedia .org /w /index .php ?title =Radia _Perlman &oldid =1245484160 - [BGP-MULTICAST]
-
Zhang, Z. J., Giuliano, L., Patel, K., Wijnands, I., Mishra, M. P., and A. Gulko, "BGP Based Multicast", Work in Progress, Internet-Draft, draft
-ietf , , <https://-bess -bgp -multicast -08 datatracker >..ietf .org /doc /html /draft -ietf -bess -bgp -multicast -08 - [BIER
-AMT -Deployment] -
Mate, C. and F. Loui, "BIER & AMT implementation", IETF 112 Proceedings, , <https://
datatracker >..ietf .org /meeting /112 /materials /slides -112 -mboned -bier -amt -depolyment -in -geantrare -network -00 - [BROADCAST
-DELAY] -
Wikipedia, "Broadcast delay", , <https://
en >..wikipedia .org /w /index .php ?title =Broadcast _delay &oldid =1225656951 - [DVB-MABR]
-
DVB Project, "Adaptive media streaming over IP multicast", DVB Document A176 Rev.3 (Fourth edition), , <https://
dvb >..org /wp -content /uploads /2022 /01 /A176r3 _Adaptive -Media -Streaming -over -IP -Multicast _Interim -Draft -TS -103 -769 -v121 _March _2023 .pdf - [EUMETCast
-TERRESTRIAL -AMT] -
Britton, R. and R. Adam, "EUMETCast Terrestrial over AMT", IETF 115 Proceedings, , <https://
datatracker >..ietf .org /meeting /115 /materials /slides -115 -mboned -eumetcast -over -amt - [EUMETSAT
-TERRESTRIAL] -
Espanyol, O., "EUMETSAT Terrestrial Service", IETF 110 Proceedings, , <https://
datatracker >..ietf .org /meeting /110 /materials /slides -110 -mboned -eumetsat -multicast -over -the -mbone -00 - [GKM-IKEv2]
-
Smyslov, V. and B. Weis, "Group Key Management using IKEv2", Work in Progress, Internet-Draft, draft
-ietf , , <https://-ipsecme -g -ikev2 -20 datatracker >..ietf .org /doc /html /draft -ietf -ipsecme -g -ikev2 -20 - [MAUD]
-
Nilsson, M. E., Turnbull, R. S., Stevens, T. S., and S. Appleby, "Multicast
-Assisted Unicast Delivery" , IBC2023 Tech Papers, , <https://www >..ibc .org /technical -papers /ibc2023 -tech -papers -multicast -assisted -unicast -delivery /10235 .article - [Multicast-Menu]
-
"Multicast Menu", <https://
menu >..treedn .net - [Offnet
-Sourcing -Multicast -Menu] -
Delwiche, L., "Offnet Sourcing with the Multicast Menu", IETF 114 Proceedings, , <https://
datatracker >..ietf .org /meeting /114 /materials /slides -114 -mboned -offnet -sourcing -with -the -multicast -menu -01 - [QUIC-Multicast]
-
Holland, J., Pardue, L., and M. Franke, "Multicast Extension for QUIC", Work in Progress, Internet-Draft, draft
-jholland , , <https://-quic -multicast -06 datatracker >..ietf .org /doc /html /draft -jholland -quic -multicast -06 - [RFC4609]
-
Savola, P., Lehtonen, R., and D. Meyer, "Protocol Independent Multicast - Sparse Mode (PIM-SM) Multicast Routing Security Issues and Enhancements", RFC 4609, DOI 10
.17487 , , <https:///RFC4609 www >..rfc -editor .org /info /rfc4609 - [RFC5740]
-
Adamson, B., Bormann, C., Handley, M., and J. Macker, "NACK-Oriented Reliable Multicast (NORM) Transport Protocol", RFC 5740, DOI 10
.17487 , , <https:///RFC5740 www >..rfc -editor .org /info /rfc5740 - [RFC6513]
-
Rosen, E., Ed. and R. Aggarwal, Ed., "Multicast in MPLS/BGP IP VPNs", RFC 6513, DOI 10
.17487 , , <https:///RFC6513 www >..rfc -editor .org /info /rfc6513 - [RFC7716]
-
Zhang, J., Giuliano, L., Rosen, E., Ed., Subramanian, K., and D. Pacella, "Global Table Multicast with BGP Multicast VPN (BGP-MVPN) Procedures", RFC 7716, DOI 10
.17487 , , <https:///RFC7716 www >..rfc -editor .org /info /rfc7716 - [RFC8085]
-
Eggert, L., Fairhurst, G., and G. Shepherd, "UDP Usage Guidelines", BCP 145, RFC 8085, DOI 10
.17487 , , <https:///RFC8085 www >..rfc -editor .org /info /rfc8085 - [RFC8279]
-
Wijnands, IJ., Ed., Rosen, E., Ed., Dolganow, A., Przygienda, T., and S. Aldrin, "Multicast Using Bit Index Explicit Replication (BIER)", RFC 8279, DOI 10
.17487 , , <https:///RFC8279 www >..rfc -editor .org /info /rfc8279 - [RFC8777]
-
Holland, J., "DNS Reverse IP Automatic Multicast Tunneling (AMT) Discovery", RFC 8777, DOI 10
.17487 , , <https:///RFC8777 www >..rfc -editor .org /info /rfc8777 - [RFC8815]
-
Abrahamsson, M., Chown, T., Giuliano, L., and T. Eckert, "Deprecating Any-Source Multicast (ASM) for Interdomain Multicast", BCP 229, RFC 8815, DOI 10
.17487 , , <https:///RFC8815 www >..rfc -editor .org /info /rfc8815 - [RFC9000]
-
Iyengar, J., Ed. and M. Thomson, Ed., "QUIC: A UDP-Based Multiplexed and Secure Transport", RFC 9000, DOI 10
.17487 , , <https:///RFC9000 www >..rfc -editor .org /info /rfc9000 - [RFC9049]
-
Dawkins, S., Ed., "Path Aware Networking: Obstacles to Deployment (A Bestiary of Roads Not Taken)", RFC 9049, DOI 10
.17487 , , <https:///RFC9049 www >..rfc -editor .org /info /rfc9049 - [RFC9300]
-
Farinacci, D., Fuller, V., Meyer, D., Lewis, D., and A. Cabellos, Ed., "The Locator/ID Separation Protocol (LISP)", RFC 9300, DOI 10
.17487 , , <https:///RFC9300 www >..rfc -editor .org /info /rfc9300 - [RFC9524]
-
Voyer, D., Ed., Filsfils, C., Parekh, R., Bidgoli, H., and Z. Zhang, "Segment Routing Replication for Multipoint Service Delivery", RFC 9524, DOI 10
.17487 , , <https:///RFC9524 www >..rfc -editor .org /info /rfc9524 - [Trees]
-
Kilmer, J., "Trees", Poetry Foundation, <https://
www >..poetryfoundatio n .org /poetrymagazine /poems /12744 /trees
Appendix A. Netverses
With inspiration from (and apologies to) Radia Perlman [Algorhyme] and Joyce Kilmer [Trees], the following poem is not intended to provide any normative or informative technical value on TreeDN beyond (mild) amusement for the reader who made it this far in the document:¶
I think that I shall never see
A CDN more lovely than a tree.¶
A tree whose crucial property
Is efficient mass-audience delivery.¶
Using SSM for simplified operation
Of native branches that eliminate duplication.¶
A tree extended by AMT,
Enabling unicast-only receivers full delivery.¶
A tree that scales to reach millions of places
To viably support the highest of bitrate use cases.¶
A CDN is built by folks like me,
But only end users can generate enough demand to necessitate a tree.¶
Acknowledgements
Many thanks to those who have contributed to building and operating the first TreeDN network on the Internet, including Pete Morasca, William Zhang, Lauren Delwiche, Natalie Landsberg, Wayne Brassem, Jake Holland, Andrew Gallo, Casey Russell, Janus Varmarken, Csaba Mate, Frederic Loui, Max Franke, Todor Moskov, Erik Herz, Bradley Cao, Katie Merrill, Karel Hendrych, Haruna Oseni, and Isabelle Xiong. The writing of this document to describe the TreeDN architecture was inspired by a conversation with Dino Farinacci and Mike McBride. Thanks also to Jeff Haas, Vinod Kumar, Ron Bonica, Jeffrey Zhang, and Éric Vyncke for their thoughtful reviews and suggestions, Chris Lemmons for his detailed shepherd review, and Stephen Farrell, Magnus Westerlund, Reese Enghardt, Jurgen Schonwalder, Carlos Pignataro, Erik Kline, Gunter Van de Velde, Warren Kumari, and Zaheduzzaman Sarker for their last call reviews.¶