By Eric Liang and Richard Liaw and Clement Gehring In this blog post, we explore a functional paradigm for implementing reinforcement learning (RL) algorithms. The paradigm will be that developers write the numerics of their algorithm as independent, pure functions, and then use a library to compile them into policies that can be trained at scale. We share how these ideas were implemented in RLlib’s , eliminating thousands of lines of “glue” code and bringing support for Keras and .