Posts

What I'm studying, explained in my own words

  • · 36 min read

    Maximum-Entropy RL: The 1-Step Problem

    Working through why an entropy bonus turns argmax into softmax and max into log-sum-exp, step by step, then following it into soft value iteration, SAC and robust RL.

    RL