IFS - First Online Film Festival

Debut of Our New Video Platform

For the last several months, we have been working on a major upgrade of our streaming media platform. While our legacy platform was very advanced, it has been two years since we last refreshed our system. As it always does, technology marches on, and we like to stay at the leading edge of the industry.

 This upgrade is a top-to-bottom total rework of our video infrastructure and feature set:

  • Cloud-based online storage system for video masters and distribution files
  • Globally-distributed content delivery network with 53 distribution points located all around the world
  • New cloud-based encoding technology
  • Entirely new and expanded encoding profiles based on our last two years of real-world experience with our student body
  • New security and encryption technology for protecting our video assets
  • New transport technology for both video-on-demand and live events
  • New embedded video players for all of our videos with better cross-platform capabilities and advanced features such as closed captioning, multiple audio tracks for foreign-language dubs and commentary tracks, screencasting to Chromecast devices and social sharing

Our objectives were to make a better, faster and less expensive system to operate with:

  • Eleven 9s survivability (99.999999999%)
  • Very secure infrastructure and encrypted transport
  • High node-count distribution points located all over the world
  • Massively redundant with out-of-region failover for disaster protection
  • Massively scalable to serve any number of simultaneous users for streams
  • Increased individual connection speeds for each user that allows true 1080p high-definition streaming and our upcoming 4k (UltraHD) conversion
  • Expanded HLS streaming that will ultimately replace our current RTMP streaming. Our form of HLS delivery will support more devices, in both Flash and HTML-5, such as almost all desktop browsers, Apple iOS devices such as iPhones and iPads and Android smartphones and tablets

Storage Cloud

We set up a cloud-based storage system that is high-redundant and geographically distributed for fail-over protection. The system is highly survivable for protection against loss of a stored file. The storage system is also highly secure and can only be accessed by our administrators and the content delivery network (CDN). The storage system stores all of our master files as well as encoded distribution files.

Cloud-Based Transcoder

When we finish editing a video, we made a high-bit-rate master file using an intermediate master file format. We upload the master file to our cloud-based storage system. These masters are very large files, and we use gigabit-per-second fiber connections to make the transfer. From the master repository, the master file is available to our cloud-based transcoder that is composed of thousands of individual encoder instances working in concert. The transcoder farm uses our master files as source material and encodes our Adaptive Streaming distribution and manifest files. The control of the transcoder farm derives from a set of encoding profiles that are highly technical and have been custom developed to meet our needs. Jobs are loaded into a production pipeline and queued for processing. As each job finishes, the encoded files and manifest files are written back to their assigned storage location in our storage cloud.

Content Delivery Network (CDN)

When each individual user requests to view a video, the content delivery network determines which of the CDN's node location would best serve the end user requesting the video. Currently, the CDN can choose any of our 53 node locations from all over the world. Once the serving node is selected, the CDN downloads the video to the serving node (at multi-gigabit-per-second core network speeds). The video files get cached in the node from our storage cloud and play them out to the end user requesting to see the video. The video files will live in the cache for 24 hours to serve any replay to the original requesting user and any other nearby user that come during the 24-hour period. This feature allows us to serve a large portion of the population of the planet as if they were all local.

The locations of our CDN nodes are:

United States

  • Atlanta, GA
  • Ashburn, VA (3)
  • Dallas/Ft. Worth, TX (2)
  • Hayward, CA
  • Jacksonville, FL
  • Los Angeles, CA (2)
  • Miami, FL
  • New York, NY (3)
  • Newark, NJ
  • Palo Alto, CA
  • San Jose, CA
  • Seattle, WA
  • South Bend, IN
  • St. Louis, MO

South America

  • São Paulo, Brazil
  • Rio de Janeiro, Brazil

Europe

  • Amsterdam, The Netherlands (2)
  • Dublin, Ireland
  • Frankfurt, Germany (3)
  • London, England (3)
  • Madrid, Spain
  • Marseille, France
  • Milan, Italy
  • Paris, France (2)
  • Stockholm, Sweden
  • Warsaw, Poland

Asia

  • Chennai, India
  • Hong Kong (2)
  • Mumbai, India
  • Manila, the Philippines
  • Osaka, Japan
  • Seoul, Korea (2)
  • Singapore (2)
  • Taipei, Taiwan
  • Tokyo, Japan (2)

Australia

  • Melbourne, Australia
  • Sydney, Australia

The CDN not only allows the best possible performance, but it also allows extreme availability. In the unlikely event that any one or more of the 53 data centers where to totally fail, the other remaining nodes simply absorbs the load.

The resulting design also provides extreme scalability. Since the 53 data centers are distributed close to population centers and serve as forward-deployed caches, we can serve large numbers of users from each location. If one data center becomes too heavily loaded to provide optimal performance, the excess load is load-balanced to another data center. The total capacity of the system is extreme.

Without exaggeration, the CDN can serve millions of simultaneous users with a high degree of reliability and performance.

In addition to its core features, the CDN also allows us to stream both RTMP and HLS transport streams. Further, the CDN supports AES encryption technology and key management for all of our video streams. 

Embedded Media Player

Each video or playlist is assigned to an advanced media player that is embedded into every web page that contains a video to play. The media player code and all of its supporting files are also served from the CDN just like media so the page loads with the best possible speed and scalability.

The embedded player contains the user interface and the programming to exploit all of the features and functions of our infrastructure. Each user interacts with the embedded player through simple and intuitive controls and the embedded player, in turn, interacts with all of the infrastructures to deliver and control the video and the provided features and functions.

We have used earlier-generation players from this same vendor but in this upgrade we have migrated to the latest generation player and moved up to the maximum number of features provided by this player.

In this stage of the upgrade, we will implement most of the new feature, saving only a few for later in the year.

Upgrade Schedule

We performed this upgrade in three planned phases beginning in the last week of November, 2014 and completed the first two phases by the middle of January, 2015. The first two phases dealt almost exclusively with infrastructure, and both phases are in full production now. We are now serving all video traffic for this website from the new infrastructure. Phase 3 began during the first week in February, completed within a couple of weeks and is in final cross-device testing now. Phase 3 dealt with our new embedded media player and includes all of our new features and functions that will be available to our end users. As the user interface and the visible face of the platform, Phase 3 is far more visible to end users and ties everything together into a fully integrated system.

With the system completed and tested, it is time to unleash it for the world to see and use. Our film festival will be the public debut of the full platform and its first large-scale usage load.