Learning Latent Dynamics for Planning from Pixels

Video of the PlaNet agent learning to solve a variety of continuous control tasks from images in 2000 attempts. Previous agents that do not learn a model of the environment often require 50 times as many attempts to reach comparable performance.

Paper: https://arxiv.org/pdf/1811.04551.pdf
Website: https://danijar.com/planet