@Jacob_Biamonte @manlius84 Diagram is from the Cover/Thomas textbook Elements of Information Theory, see also http://boffosocko.com/2014/10/03/information-theory-is-the-new-central-discipline/