2020 Ghost Day Keynote: On Deep Learning of Sets

Deep learning is traditionally concerned with ordered data such as images (ordered pixels) or natural language sequences (ordered tokens). In many cases, like multiple-object tracking or epidemiological modelling, there is no such order, and data are best treated as sets. In this talk, we will consider sets and how their lack of structure influences deep learning model design. To this end, we will divide set learning into three problems: set to vector, vector to set, and set to set. We will explore the cons