Exploration Strategies
Every algorithm in this section has quietly relied on some exploration mechanism — ε-greedy, entropy bonuses — without asking whether that mechanism is actually a good one. An agent that only ever exploits what it currently believes is best will never discover a better option it hasn't tried; exploration is what makes discovery possible at all.