Monte Carlo and TD Learning
Dynamic Programming needed a fully known model of the environment — real problems rarely offer one. This page introduces the two foundational ways to learn value functions purely from experience: waiting to see how things actually turned out, or updating immediately using your own current guess.