Letter #5 - In which we’re scared but we do it anyway.
“Whatever scares you, go do it.”
Or you know, don’t. Maybe there’s a good reason for being scared and you’re walking right into a trap by ignoring the signs. Who knows?
Just a perfect day
You made me forget myself
I thought I was
Someone else, someone good
Beautiful. I generally prefer the Various Artists version, but man, the piano in Lou Reed’s original version kills me every time.
Remember last week’s Reinforcement Learning woes? The idea was that you needed to be careful in picking the reward function when doing RL, otherwise you risk the agent coming up with some ‘creative’ solutions. Well, this paper fixes the ‘creative’ solutions bit (albeit only on physics-based character skills) by having the model imitate a reference movement and then perform certain tasks. The results are a treat to watch, especially compared to other approaches.
P.S. if you’re the reading type, the full paper is here.
Not sure what you just read? Take a look at this post.
Enjoyed it? Subscribe to my tiny newsletter and get new issues straight to your inbox. Every week, on Tuesdays.