http://incompleteideas.net/book/the-book-2nd.html

Reinforcement Learning: An Introduction

Small book cover

Richard S. Sutton
and Andrew G. Barto

Second Edition (see here for the first edition)
MIT Press, Cambridge, MA, 2018

Buy from Amazon
Errata and Notes
Full Pdf  Without Margins
Code
Solutions -- send in your solutions for a chapter, get the official
ones back (currently incomplete)
Slides and Other Teaching Aids
Links to pdfs of the literature sources cited in the book (Many
thanks to Daniel Plop!)
Latex Notation -- Want to use the book's notation in your own work?
Download this .sty file and this example of its use

---------------------------------------------------------------------