A discussion of some of the subtleties of differential entropy. This also contains a review of discrete entropy, various entropy-related information quantities such as mutual information, and a listing of various axiomatic formulations.

Read the Notes (PDF)