Shannon entropy is a core concept in machine learning and information theory, particularly in decision tree modeling. To date, no studies have extensively and quantitatively applied Shannon entropy in ...

The aim of this paper is to propose a general theoretical construction that allows us to associate a given class of complex systems with a suitable information measure adapted to this class, and ...

Entropy is one of the most useful concepts in science but also one of the most confusing. This article serves as a brief introduction to the various types of entropy that can be used to quantify the ...