In terms of communication theory, Entropy is identical to Information, which is identical to Freedom of choice. Entropy is used to quantify information. In physical systems, it measures the degree of randomness, or shuffledness.
Linking here
- Reading Notes: Recent Contributions To The Mathematical Theory Of Communication Reading notes from 'Recent Contributions To The Mathematical Theory Of Communication' by Warren Weaver.