Towards Cloud-Native Distributed Machine Learning Pipelines at Scale - Yuan Tang | PyData Global

Towards Cloud-Native Distributed Machine Learning Pipelines at Scale Speaker: Yuan Tang Summary This talk presents various best practices and challenges on building large, efficient, scalable, and reliable distributed machine learning pipelines using cloud-native technologies such as Argo Workflows and Kubeflow as well as how they fit into Python ecosystem with cutting-edge distributed machine learning frameworks such as TensorFlow and PyTorch. Description Presentation slides: In recent years, advances in machine learning have made tremendous progress yet large scale machine learning still remains challenging. With the variety of machine learning frameworks such as TensorFlow and PyTorch, it’s not easy to automate the process of training machine learning models on distributed Kubernetes clusters. Machine learning re