The Making of VES: the Cosmos Microservice for Netflix Video Encoding
Netflix Tech Blog
by Netflix Technology Blog
1w ago
Liwei Guo, Vinicius Carvalho, Anush Moorthy, Aditya Mavlankar, Lishan Zhu This is the second post in a multi-part series from Netflix. See here for Part 1 which provides an overview of our efforts in rebuilding the Netflix video processing pipeline with microservices. This blog dives into the details of building our Video Encoding Service (VES), and shares our learnings. Cosmos is the next generation media computing platform at Netflix. Combining microservice architecture with asynchronous workflows and serverless functions, Cosmos aims to modernize Netflix’s media processing pipelines wi ..read more
Visit website
Reverse Searching Netflix’s Federated Graph
Netflix Tech Blog
by Netflix Technology Blog
2w ago
By Ricky Gardiner, Alex Hutter, and Katie Lefevre Since our previous posts regarding Content Engineering’s role in enabling search functionality within Netflix’s federated graph (the first post, where we identify the issue and elaborate on the indexing architecture, and the second post, where we detail how we facilitate querying) there have been significant developments. We’ve opened up Studio Search beyond Content Engineering to the entirety of the Engineering organization at Netflix and renamed it Graph Search. There are over 100 applications integrated with Graph Search and nearly 50 i ..read more
Visit website
Sequential Testing Keeps the World Streaming Netflix Part 2: Counting Processes
Netflix Tech Blog
by Netflix Technology Blog
1M ago
Sequential A/B Testing Keeps the World Streaming Netflix Part 2: Counting Processes Michael Lindon, Chris Sanden, Vache Shirikian, Yanjun Liu, Minal Mishra, Martin Tingley Have you ever encountered a bug while streaming Netflix? Did your title stop unexpectedly, or not start at all? In the first installment of this blog series on sequential testing, we described our canary testing methodology for continuous metrics such as play-delay. One of our readers commented What if the new release is not related to a new play/streaming feature? For example, what if the new release includes modified ..read more
Visit website
Supporting Diverse ML Systems : Netflix Tech Blog
Netflix Tech Blog
by Netflix Technology Blog
1M ago
David J. Berg, Romain Cledat, Kayla Seeley, Shashank Srikanth, Chaoying Wang, Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding. The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow, an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems. Since i ..read more
Visit website
Bending pause times to your will with Generational ZGC
Netflix Tech Blog
by Netflix Technology Blog
1M ago
The surprising and not so surprising benefits of generations in the Z Garbage Collector. By Danny Thomas, JVM Ecosystem Team The latest long term support release of the JDK delivers generational support for the Z Garbage Collector. Netflix has switched by default from G1 to Generational ZGC on JDK 21 and later, because of the significant benefits of concurrent garbage collection. More than half of our critical streaming video services are now running on JDK 21 with Generational ZGC, so it’s a good time to talk about our experience and the benefits we’ve seen. If you’re interested in how we us ..read more
Visit website
Evolving from Rule-based Classifier: Machine Learning Powered Auto Remediation in Netflix Data…
Netflix Tech Blog
by Netflix Technology Blog
1M ago
Evolving from Rule-based Classifier: Machine Learning Powered Auto Remediation in Netflix Data Platform by Binbing Hou, Stephanie Vezich Tamayo, Xiao Chen, Liang Tian, Troy Ristow, Haoyuan Wang, Snehal Chennuru, Pawan Dixit This is the first of the series of our work at Netflix on leveraging data insights and Machine Learning (ML) to improve the operational automation around the performance and cost efficiency of big data jobs. Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto ..read more
Visit website
Announcing bpftop: Streamlining eBPF performance optimization
Netflix Tech Blog
by Netflix Technology Blog
2M ago
By Jose Fernandez Today, we are thrilled to announce the release of bpftop, a command-line tool designed to streamline the performance optimization and monitoring of eBPF programs. As Netflix increasingly adopts eBPF [1, 2], applying the same rigor to these applications as we do to other managed services is imperative. Striking a balance between eBPF’s benefits and system load is crucial, ensuring it enhances rather than hinders our operational efficiency. This tool enables Netflix to embrace eBPF’s potential. Introducing bpftop bpftop provides a dynamic real-time view of running eBPF programs ..read more
Visit website
Introducing SafeTest: A Novel Approach to Front End Testing
Netflix Tech Blog
by Netflix Technology Blog
2M ago
by Moshe Kolodny In this post, we’re excited to introduce SafeTest, a revolutionary library that offers a fresh perspective on End-To-End (E2E) tests for web-based User Interface (UI) applications. The Challenges of Traditional UI Testing Traditionally, UI tests have been conducted through either unit testing or integration testing (also referred to as End-To-End (E2E) testing). However, each of these methods presents a unique trade-off: you have to choose between controlling the test fixture and setup, or controlling the test driver. For instance, when using react-testing-libra ..read more
Visit website
Rebuilding Netflix Video Processing Pipeline with Microservices
Netflix Tech Blog
by Netflix Technology Blog
3M ago
Liwei Guo, Anush Moorthy, Li-Heng Chen, Vinicius Carvalho, Aditya Mavlankar, Agata Opalach, Adithya Prakash, Kyle Swanson, Jessica Tweneboah, Subbu Venkatrav, Lishan Zhu This is the first blog in a multi-part series on how Netflix rebuilt its video processing pipeline with microservices, so we can maintain our rapid pace of innovation and continuously improve the system for member streaming and studio operations. This introductory blog focuses on an overview of our journey. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this proces ..read more
Visit website
All of Netflix’s HDR video streaming is now dynamically optimized
Netflix Tech Blog
by Netflix Technology Blog
5M ago
by Aditya Mavlankar, Zhi Li, Lukáš Krasula and Christos Bampis High dynamic range (HDR) video brings a wider range of luminance and a wider gamut of colors, paving the way for a stunning viewing experience. Separately, our invention of Dynamically Optimized (DO) encoding helps achieve optimized bitrate-quality tradeoffs depending on the complexity of the content. HDR was launched at Netflix in 2016 and the number of titles available in HDR has been growing ever since. We were, however, missing the systematic ability to measure perceptual quality (VMAF) of HDR streams since VMAF was l ..read more
Visit website

Follow Netflix Tech Blog on FeedSpot

Continue with Google
Continue with Apple
OR