Slicing Return Distributions: A Practical Route to Multivariate Distributional RL
Sliced divergences make it practical to compare multivariate return distributions. They offer an attractive solution for multi-objective distributional RL and beyond. Their use in TD learning still leaves some open questions.