smooth activations you can differentiate through, and very cheap-to-evaluate derivatives www.youtube.com/watch?v=uXt8...