#math/KL-divergence

📐 Advanced Mathematics / optimum-theories

2. Kullback-Leibler divergence

The KL divergence evaluates the difference of two different distributions, It's often a powerful tool for make two distributions coincide in the training of deep-learning neural networks.