Cloud Native + Open Source Virtual Summit China 2020

A great variety of workloads are surging into the Cloud. As the de facto operating system of the Cloud, the Kubernetes eco-system is soon faced with this challenge: How to manage hybrid workloads to achieve high resource utilization while accomplishing variant SLOs？
In this talk, we will share practices of consolidating hybrid workloads, including e-commerce services and business-critical AI jobs, in Kubernetes clusters of Alibaba. We elaborate on critical details of the enhancements we have made: 1. a real-time pipeline to stream the cluster metrics into the the scheduling system; 2. an efficient algorithm estimation of the upcoming resource consumption patterns; 3. an SLO-oriented scheduling policy that opportunistically schedules best-effort pods leveraging allocated but not used resources. Lastly, we'll share statistics of how the entire system works in production clusters.