Building Visual Navigation Foundation Models with Scalable Simulation Data

Building a general navigation system using only an external camera is a promising goal. In this talk, I will introduce some explorations in this direction based on scalable simulated navigation data. First, I will elaborate on the motivation for using simulated data. Then, I will present the details of constructing the data pipeline. Finally, I will introduce several works on how to train a capable navigation policy with the simulation data.