Skip to main content

Blog

2025

The beautiful origin of Cross-Entropy Loss
Cross-Entropy Loss is commonly used in classification tasks in Machine Learning, and has a relatively simple equation. But where does this formula actually come from? In this article, we’ll walk through its intuitive and mathematical origins from probability and KL divergence.