Transitioning Broadcast to Cloud
Source abstract
Abstract
We analyze the differences between on-premise broadcast and cloud-based online video delivery workflows and identify technologies needed for bridging the gaps between them. Specifically, we note differences in ingest protocols, media formats, signal-processing chains, codec constraints, metadata, transport formats, delays, and means for implementing operations such as ad-splicing, redundancy and synchronization. To bridge the gaps, we suggest specific improvements in cloud ingest, signal processing, and transcoding stacks. Cloud playout is also identified as critically needed technology for convergence. Finally, based on all such considerations, we offer sketches of several possible hybrid architectures, with different degrees of offloading of processing in cloud, that are likely to emerge in the future.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Multimedia Communication and Technology · Image and Video Quality Assessment · Telecommunications and Broadcasting Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Brightcove Inc., 290 Congress Street, Boston, MA 02210, USA
References (90)
Show source-provided references
1. Pizzi, S., and Jones, G. (2014). A Broadcast Engineering Tutorial for Non-Engineers, National Association Broadcasters (NAB). [4th ed.].10.4324/9781315848426 ↗
2. Luther, A., and Inglis, A. (1999). Video Engineering, McGraw-Hill. [3rd ed.].
3. Streaming video over the internet: Approaches and directions10.1109/76.911156 ↗
4. Video coding for streaming media delivery on the internet10.1109/76.911155 ↗
5. Pantos, R., and May, W. (2020, November 01). HTTP Live Streaming, RFC 8216. IETF. Available online: https://tools.ietf.org/html/rfc8216.
6. ISO/IEC 23009-1:2014 (2020, November 01). Information Technology—Dynamic Adaptive Streaming Over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats. Available online: https://www.iso.org/about-us.html.
7. (2020, November 01). Microsoft Smooth Streaming. Available online: https://www.iis.net/downloads/microsoft/smooth-streaming.
8. Co-opetition of TV broadcasters in online video markets: A winning strategy?10.1386/jdtv.5.1.61_1 ↗
9. (2020, November 01). Nielsen Holdings Plc, Total Audience Report. Available online: https://www.nielsen.com/us/en/client-learning/tv/nielsen-total-audience-report-february-2020/.
10. Sandvine (2020, November 01). The Global Internet Phenomena Report. Available online: https://www.sandvine.com/hubfs/Sandvine_Redesign_2019/Downloads/Internet%20Phenomena/Internet%20Phenomena%20Report%20Q32019%2020190910.pdf.
11. Frost & Sullivan (2020, November 01). Analysis of the Global Online Video Platforms Market. Frost & Sullivan. Available online: https://store.frost.com/analysis-of-the-global-online-video-platforms-market.html.
12. ETSI TS 102 796 (2020, November 01). Hybrid Broadcast Broadband TV. Available online: https://www.etsi.org/deliver/etsi_ts/102700_102799/102796/01.04.01_60/ts_102796v010401p.pdf.
13. ATSC A/331:2020 (2020, November 01). Signaling, Delivery, Synchronization, and Error Protection. Available online: https://www.atsc.org/atsc-documents/3312017-signaling-delivery-synchronization-error-protection/.
14. Stockhammer, T., Sodagar, I., Zia, W., Deshpande, S., Oh, S., and Champel, M. (2016, January 8–12). Dash in ATSC 3.0: Bridging the gap between OTT and broadcast. Proceedings of the IET Conference Proceedings, IBC 2016 Conference, Amsterdam, The Netherlands.10.1049/ibc.2016.0024 ↗
15. AWS Elemental (2020, November 01). Video Processing and Delivery Moves to the Cloud, e-book. Available online: https://www.elemental.com/resources/white-papers/e-book-video-processing-delivery-moves-cloud/.
16. Fautier, T. (2019). Cloud Technology Drives Superior Video Encoding, SMPTE. In SMPTE 2019.10.5594/M001873 ↗
17. ISO/IEC 13818-1:2019 (2019). Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Systems—Part 1: Systems. ISO/IEC. Available online: https://www.iso.org/standard/75928.html.
18. ATSC A/65B (2020, November 01). Program and System Information Protocol for Terrestrial Broadcast and Cable (PSIP). Available online: https://www.atsc.org/wp-content/uploads/2015/03/Program-System-Information-Protocol-for-Terrestrial-Broadcast-and-Cable.pdf.
19. ANSI/SCTE 35 2007 (2020, November 01). Digital Program Insertion Cueing Message for Cable. Available online: https://webstore.ansi.org/standards/scte/ansiscte352007.
20. ANSI/SCTE 67 2010 (2020, November 01). Recommended Practice for SCTE 35 Digital Program Insertion Cueing Message for Cable. Available online: https://webstore.ansi.org/standards/scte/ansiscte672010.
21. The ATSC transport layer, including Program and System Information (PSIP)10.1109/JPROC.2005.861717 ↗
22. Reznik, Y., Lillevold, K., Jagannath, A., Greer, J., and Corley, J. (2018, January 12–15). Optimal design of encoding profiles for ABR streaming. Proceedings of the Packet Video Workshop, Amsterdam, The Netherlands.10.1145/3210424.3210436 ↗
23. Reznik, Y., Li, X., Lillevold, K., Peck, R., Shutt, T., and Marinov, R. (2019, January 6–11). Optimizing Mass-Scale Multi-Screen Video Delivery. Proceedings of the 2019 NAB Broadcast Engineering and Information Technology Conference, Las Vegas, NV, USA.
24. ATSC Video and Audio Coding10.1109/JPROC.2005.861715 ↗
25. ATSC A/53 Part 1: 2013 (2020, November 01). ATSC Digital Television Standard: Part 1—Digital Television System. Available online: https://www.atsc.org/wp-content/uploads/2015/03/A53-Part-1-2013-1.pdf.
26. ATSC A/53 Part 4:2009 (2020, November 01). ATSC Digital Television Standard: Part 4—MPEG-2 Video System Characteristics. Available online: https://www.atsc.org/wp-content/uploads/2015/03/a_53-Part-4-2009-1.pdf.
27. ATSC A/54A (2020, November 01). Recommended Practice: Guide to the Use of the ATSC Digital Television Standard. Available online: https://www.atsc.org/wp-content/uploads/2015/03/a_54a_with_corr_1.pdf.
28. ATSC A/72 Part 1:2015 (2020, November 01). Video System Characteristics of AVC in the ATSC Digital Television System. Available online: https://www.atsc.org/wp-content/uploads/2015/03/A72-Part-1-2015-1.pdf.
29. ATSC A/72 Part 2:2014 (2020, November 01). AVC Video Transport Subsystem Characteristics. Available online: https://www.atsc.org/wp-content/uploads/2015/03/A72-Part-2-2014-1.pdf.
30. Annex, B. (2020, November 01). Digital Video Broadcasting (DVB): Implementation Guidelines for the use of MPEG-2 Systems, Video and Audio in Satellite, Cable and Terrestrial Broadcasting Applications. Available online: https://standards.iteh.ai/catalog/standards/etsi/af36a167-779e-4239-b5a7-89356c6c2dde/etsi-ts-101-154-v2.6.1-2019-09.
31. ANSI/SCTE 43 2015 (2020, November 01). Digital Video Systems Characteristics Standard for Cable Television. Available online: https://webstore.ansi.org/standards/scte/ansiscte432015.
32. ANSI/SCTE 128 2010-a (2020, November 01). AVC Video Systems and Transport Constraints for Cable Television. Available online: https://webstore.ansi.org/standards/scte/ansiscte1282010.
33. Schulzrinne, H., Casner, S., Frederick, R., and Jacobson, V. (2020, November 01). RTP: A Transport Protocol for Real-Time Applications. RFC 1889. Available online: https://tools.ietf.org/html/rfc1889.
34. SMPTE ST 2022-1:2007 (2020, November 01). Forward Error Correction for Real-Time Video/Audio Transport over IP Networks. Available online: https://ieeexplore.ieee.org/document/7291470/versions#versions.
35. SMPTE ST 2022-2:2007 (2020, November 01). Unidirectional Transport of Constant Bit Rate MPEG-2 Transport Streams on IP Networks. Available online: https://ieeexplore.ieee.org/document/7291740.
36. Zixi, LLC (2020, November 01). Streaming Video over the Internet and Zixi. Available online: http://www.zixi.com/PDFs/Adaptive-Bit-Rate-Streaming-and-Final.aspx.
37. OC-SP-MEZZANINE-C01-161026 (2020, November 01). Mezzanine Encoding Specification. Available online: https://community.cablelabs.com/wiki/plugins/servlet/cablelabs/alfresco/download?id=1d76e930-6d98-4de3-89ee-9d0fb4b5292a.
38. (2020, November 01). Adobe Systems, Real-Time Messaging Protocol (RTMP) Specification. Available online: https://www.adobe.com/devnet/rtmp.html.
39. Haivision (2020, November 01). Secure Reliable Transport (SRT). Available online: https://github.com/Haivision/srt.
40. VSF TR-06-1 (2020, November 01). Reliable Internet Stream Transport (RIST) Protocol Specification—Simple Profile. Video Services Forum, Available online: http://vsf.tv/download/technical_recommendations/VSF_TR-06-1_2018_10_17.pdf.
41. OC-SP-CEP3.0-I05-151104 (2020, November 01). Content Encoding Profiles 3.0 Specification. Available online: https://community.cablelabs.com/wiki/plugins/servlet/cablelabs/alfresco/download?id=c7eb769e-1020-402c-b2f2-d839ee532945.
42. Ozer, J. (2020, November 01). Encoding for Multiple Devices. Streaming Media Magazine, Available online: http://www.streamingmedia.com/Articles/ReadArticle.aspx?ArticleID=88179&fb_comment_id=220580544752826_937649.
43. Ozer, J. (2020, November 01). Encoding for Multiple-Screen Delivery. Streaming Media East, Available online: https://www.streamingmediablog.com/wp-content/uploads/2013/07/2013SMEast-Workshop-Encoding.pdf.
44. Apple (2020, November 01). HLS Authoring Specification for Apple Devices. Available online: https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices.
45. DASH-IF (2020, November 01). DASH-IF Interoperability Points, v4.3. Available online: https://dashif.org/docs/DASH-IF-IOP-v4.3.pdf.
46. ETSI TS 103 285 v1.2.1 (2020, November 01). Digital Video Broadcasting (DVB); MPEG-DASH Profile for Transport of ISO BMFF Based DVB Services Over IP Based Networks. Available online: https://www.etsi.org/deliver/etsi_ts/103200_103299/103285/01.03.01_60/ts_103285v010301p.pdf.
47. SMPTE RP 145 (2020, November 01). Color Monitor Colorimetry. Available online: https://standards.globalspec.com/std/1284848/smpte-rp-145.
48. SMPTE 170M (2020, November 01). Composite Analog Video Signal—NTSC for Studio Applications. Available online: https://standards.globalspec.com/std/892300/SMPTE%20ST%20170M.
49. EBU Tech. 3213-E. E.B.U. (2020, November 01). Standard for Chromaticity Tolerances for Studio Monitors. Available online: https://tech.ebu.ch/docs/tech/tech3213.pdf.
50. ITU-R Recommendation BT.601 (2020, November 01). Studio Encoding Parameters of Digital Television For standard 4:3 and Wide Screen 16:9 Aspect Ratios. Available online: https://www.itu.int/dms_pubrec/itu-r/rec/bt/R-REC-BT.601-7-201103-I!!PDF-E.pdf.
51. ITU-R Recommendation BT.709 (2020, November 01). Parameter Values for the HDTV Standards for Production and International Programme Exchange. ITU-R. Available online: https://www.itu.int/dms_pubrec/itu-r/rec/bt/R-REC-BT.709-6-201506-I!!PDF-E.pdf.
52. IEC 61966-2-1:1999 (2020, November 01). Multimedia Systems and Equipment—Colour Measurement and Management—Part 2-1: Colour Management—Default RGB Colour Space—sRGB. Available online: https://webstore.iec.ch/publication/6169.
53. Saving Bits—The Impact of MCTF Enhanced Noise Reduction10.5594/J16412 ↗
54. ISO/IEC 13818-2:2013 (2020, November 01). Information Technology—Generic Coding of Moving Pictures and Associated Audio Information—Part 2: Video. Available online: https://www.iso.org/standard/61152.html.
55. ISO/IEC 14496-10:2003 (2020, November 01). Information Technology—Coding of Audio-Visual Objects—Part 10: Advanced Video Coding. Available online: https://www.iso.org/standard/37729.html.
56. ISO/IEC 23008-2:2013 (2020, November 01). Information Technology –High Efficiency Coding and Media Delivery in Heterogeneous Environments—Part 2: High Efficiency Video Coding. Available online: https://www.iso.org/standard/35424.html.
57. AOM AV1 (2020, November 01). AV1 Bitstream & Decoding Process Specification, v1.0.0. Alliance for Open Media, Available online: https://aomediacodec.github.io/av1-spec/av1-spec.pdf.
58. CTA 5001 (2020, November 01). Web Application Video Ecosystem—Content Specification. Available online: https://cdn.cta.tech/cta/media/media/resources/standards/pdfs/cta-5001-final_v2_pdf.pdf.
59. Statistical multiplexing of multiple MPEG-2 video programs in a single channel10.5594/J17232 ↗
60. Statistical multiplexing using MPEG-2 video encoders10.1147/rd.434.0511 ↗
61. CEA-608-B (2020, November 01). Line 21 data services. Consumer Electronics Association, Available online: https://webstore.ansi.org/standards/cea/cea6082008r2014ansi.
62. CEA-708-B (2020, November 01). Digital television (DTV) closed captioning. Consumer Electronics Association, Available online: https://www.scribd.com/document/70239447/CEA-708-B.
63. CEA CEB16 (2020, November 01). Active Format Description (AFD) & Bar Data Recommended Practice. Available online: https://webstore.ansi.org/standards/cea/ceaceb162012.
64. SMPTE 2016-1 (2020, November 01). Standard for Television—Format for Active Format Description and Bar Data. Available online: https://www.techstreet.com/standards/smpte-2016-1-2009?product_id=1664006.
65. OC-SP-EP-I01-130118 (2020, November 01). Encoder Boundary Point Specification. Available online: https://community.cablelabs.com/wiki/plugins/servlet/cablelabs/alfresco/download?id=2a4f4cc6-3763-40b9-9ace-7de923559187.
66. (2020, November 01). FairPlay Streaming. Available online: https://developer.apple.com/streaming/fps/.
67. (2020, November 01). PlayReady. Available online: https://www.microsoft.com/playready/overview/.
68. (2020, November 01). Widevine. Available online: https://www.widevine.com/solutions/widevine-drm.
69. ISO/IEC 14496-12:2015 (2020, November 01). Information Technology—Coding of Audio-Visual Objects—Part 12: ISO Base Media File Format. Available online: https://www.iso.org/standard/68960.html.
70. ISO/IEC 23000-19:2018 (2020, November 01). Information Technology—Coding of Audio-Visual Objects—Part 19: Common Media Application Format (CMAF) for Segmented Media. Available online: https://www.iso.org/standard/71975.html.
71. (2020, November 01). ID3 Tagging System. Available online: http://www.id3.org/id3v2.3.0.
72. W3C WebVTT (2020, November 01). The Web Video Text Tracks. Available online: http://dev.w3.org/html5/webvtt/.
73. W3C TTML1 (2020, November 01). Timed Text Markup Language 1. Available online: https://www.w3.org/TR/2018/REC-ttml1-20181108/.
74. W3C IMSC1 (2020, November 01). TTML Profiles for Internet Media Subtitles and Captions 1.0. Available online: https://dvcs.w3.org/hg/ttml/raw-file/tip/ttml-ww-pro-33files/ttml-ww-profiles.html.
75. Apple (2020, November 01). Incorporating Ads into A Playlist. Available online: https://developer.apple.com/documentation/http_live_streaming/example_playlists_for_http_live_streaming/incorporating_ads_into_a_playlist.
76. ANSI/SCTE 30 2017 (2020, November 01). Digital Program Insertion Splicing API. Available online: https://webstore.ansi.org/standards/scte/ansiscte302017.
77. ANSI/SCTE 172 2011 (2020, November 01). Constraints on AVC Video Coding for Digital Program Insertion. Available online: https://webstore.ansi.org/preview-pages/SCTE/preview_SCTE+172+2011.pdf.
78. SMPTE 259:2008 (2020, November 01). SMPTE Standard—For Television—SDTV—Digital Signal/Data—Serial Digital Interface. Available online: https://ieeexplore.ieee.org/document/7292109.
79. SMPTE 292-1:2018 (2020, November 01). SMPTE Standard—1.5 Gb/s Signal/Data Serial Interface. Available online: https://ieeexplore.ieee.org/document/8353270.
80. SMPTE 2110-20:2017 (2020, November 01). SMPTE Standard—Professional Media over Managed IP Networks: Uncompressed Active Video. Available online: https://ieeexplore.ieee.org/document/8167389.
81. (2020, November 01). AWS Direct Connect. Available online: https://aws.amazon.com/directconnect/.
82. (2020, November 01). Azure ExpressRoute. Available online: https://azure.microsoft.com/en-us/services/expressroute/.
83. (2020, November 01). FFMPEG Filter Documentation. Available online: https://ffmpeg.org/ffmpeg-filters.html.
84. Vanam, R., and Reznik, Y. (2020, January 25–28). Temporal Sampling Conversion using Bi-directional Optical Flows with Dual Regularization. Proceedings of the IEEE International Conference on Image Processing (ICIP), Abu Dhabi, UAE.10.1109/ICIP40778.2020.9191325 ↗
85. (2020, November 01). Teranex Standards Converters. Available online: https://www.blackmagicdesign.com/products/teranex.
86. (2020, November 01). Grass Valley KudosPro Converters. Available online: https://www.grassvalley.com/products/kudospro/.
87. Apple (2020, November 01). Protocol Extension for Low-Latency HLS (Preliminary Specification). Available online: https://developer.apple.com/documentation/http_live_streaming/protocol_extension_for_low-latency_hls_preliminary_specification.
88. DASH-IF (2020, November 01). DASH-IF ATSC3.0 IOP. Available online: https://dashif.org/docs/DASH-IF-IOP-for-ATSC3-0-v1.1.pdf.
89. Law, W. (2020, November 01). Ultra Low Latency with CMAF. Available online: https://www.akamai.com/us/en/multimedia/documents/white-paper/low-latency-streaming-cmaf-whitepaper.pdf.
90. (2020, November 01). Brightcove VideoCloud System. Available online: https://www.brightcove.com/en/online-video-platform.