Posts
Notes on reinforcement learning, language models, and what I learn along the way.
- The World Models Today
How world models represent hidden state, learn dynamics, and turn predictions into decisions, with five animated explanations.
- Reward shaping without changing the task
I changed the rewards, kept the better route, and watched the learner choose the worse one. A small experiment about what it means to give an agent advice.
- What uncertainty can tell a planner
I kept giving a model more evidence. Its intervals narrowed around the wrong answer. The useful question became which observation could change its mind.
- Policy gradients and the meaning of credit
I gave a learner an action that always helped, then watched it learn from luck. An experiment about what an update can—and cannot—tell us.