https://harinboy.github.io/posts/TimeUniformAzuma/
Tighter Time-Uniform Concentration Inequality for the UCB Algorithm - Harin Lee