Information Theory is the New Central Discipline

Replied to Information Theory is the new central discipline. by Nassim Nicholas Taleb (facebook.com)

INFORMATION THEORY is the new central discipline. This graph was from 20y ago in the seminal book Cover and Thomas, as the field was starting to be defined. Now Information Theory has been expanded to swallow even more fields.

Born in, of all disciplines, Electrical Engineering, the field has progressively infiltrating probability theory, computer science, statistical physics, data science, gambling theory, ruin problems, complexity, even how one deals with knowledge, epistemology. It defines noise/signal, order/disorder, etc. It studies cellular automata. You can use it in theology (FREE WILL & algorithmic complexity). As I said, it is the MOTHER discipline.

I am certain much of Medicine will naturally grow to be a subset of it, both operationally, and in studying how the human body works: the latter is an information machine. Same with linguistics. Same with political “science”, same with… everything.

I am saying this because I figured out what the long 5th volume of the INCERTO will be. Cannot say now with any precision but it has to do with a variant of entropy as the core natural generator of Antifragility.

[Revised to explain that it is not *replacing* other disciplines, just infiltrating them as the point was initially misunderstood…]

Nassim Nicholas Taleb via Facebook

[My comments posted to the original Facebook post follow below.]

I’m coming to this post a bit late as I’m playing a bit of catch up, but agree with it wholeheartedly.

In particular, applications to molecular biology and medicine are really beginning to come to a heavy boil in just the past five years. This particular year is the progenitor of what appears to be the biggest renaissance for the application of information theory to the area of biology since Hubert Yockey, Henry Quastler, and Robert L. Platzman’s “Symposium on Information Theory in Biology at Gatlinburg, Tennessee” in 1956.

Upcoming/recent conferences/workshops on information theory in biology include:

BIRS Workshop: Biological and Bio-Inspired Information Theory
Entropy and Information in Biological Systems at NIMBios
CECAM Workshop: Entropy in Biomolecular Systems
ALife breakout session on Information Theoretic Incentives for Artificial Life (which will also spawn off a special issue of the journal Entropy):

At the beginning of September, Christoph Adami posted an awesome and very sound paper on arXiv entitled “Information-theoretic considerations concerning the origin of life” which truly portends to turn the science of the origin of life on its head.

I’ll note in passing, for those interested, that Claude Shannon’s infamous master’s thesis at MIT (in which he applied Boolean Algebra to electric circuits allowing the digital revolution to occur) and his subsequent “The Theory of Mathematical Communication” were so revolutionary, nearly everyone forgets his MIT Ph.D. Thesis “An Algebra for Theoretical Genetics” which presaged the areas of cybernetics and the current applications of information theory to microbiology and are probably as seminal as Sir R.A Fisher’s applications of statistics to science in general and biology in particular.

For those commenting on the post who were interested in a layman’s introduction to information theory, I recommend John Robinson Pierce’s An Introduction to Information Theory: Symbols, Signals and Noise (Dover has a very inexpensive edition.) After this, one should take a look at Claude Shannon’s original paper. (The MIT Press printing includes some excellent overview by Warren Weaver along with the paper itself.) The mathematics in the paper really aren’t too technical, and most of it should be comprehensible by most advanced high school students.

For those that don’t understand the concept of entropy, I HIGHLY recommend Arieh Ben-Naim’s book Entropy Demystified The Second Law Reduced to Plain Common Sense with Seven Simulated Games. He really does tear the concept down into its most basic form in a way I haven’t seen others come remotely close to and which even my mother can comprehend (with no mathematics at all). (I recommend this presentation to even those with Ph.D.’s in physics because it is so truly fundamental.)

For the more advanced mathematicians, physicists, and engineers Arieh Ben-Naim does a truly spectacular job of extending ET Jaynes’ work on information theory and statistical mechanics and comes up with a more coherent mathematical theory to conjoin the entropy of physics/statistical mechanics with that of Shannon’s information theory in A Farewell to Entropy: Statistical Thermodynamics Based on Information.

For the advanced readers/researchers interested in more at the intersection of information theory and biology, I’ll also mention that I maintain a list of references, books, and journal articles in a Mendeley group entitled “ITBio: Information Theory, Microbiology, Evolution, and Complexity.”

Venn Diagram of how information theory relates to other fields. — Figure 1.1 [page 2] from
Thomas M. Cover and Joy Thomas’s textbook *Elements of Information Theory*, Second Edition
(John Wiley & Sons, Inc., 2006) [First Edition, 1991]

Reply to What is the Bibliotheca Fictiva?

Replied to What is the Bibliotheca Fictiva? by Isabelle Kargon (The Sheridan Libraries Blog)

From antiquity to current times, there have always been writers devising literary forgeries of all kinds, either copying an existing book from the classical period or simply creating a fake original edition to trick collectors and scholars into purchasing a book that would be difficult to compare to any other. Some forgers do it for financial gain, some for ideological reasons, and some probably because of an impish instinct to prove that they can fool respectable scholars into believing an item is genuine.
There are some famous examples of forgeries, like The Donation of Constantine, a document supposedly written by Emperor Constantine (285-337 AD) and granting to Pope Sylvester I large territories of the Western Roman Empire as a token of gratitude for having converted him. Actually, the document was a forgery from the eighth century. This was not revealed before the 15^th century, when Lorenzo Valla published the Discourse on the Forgery of the Alleged Donation of Constantine, in which he revealed numerous anachronisms. The Catholic Churchsuppressed this work for many years before conceding, centuries later, that the Donation was a fake.

Pope Sylvester receiving imperial power from Emperor Constantine.

The Johns Hopkins University recently acquired one of the most comprehensive collections of literary forgeries: the Arthur and Janet Freeman Collection of Literary and Historical Forgery, also called the Bibliotheca Fictiva. Arthur Freeman is an antiquarian book dealer. He and his wife Janet Ing Freeman are scholars who wrote a book, reviewed here, about John Payne Collier, a nineteenth-century scholar and literary forger who published a number of fake documents on Shakespeare. Their collection includes 1,200 items covering many centuries, and they wanted it to belong to a research library, which is how these astonishing books are currently being made accessible for consultation in the Sheridan Libraries Special Collections. You will be able to discover works by Joannes Annius de Viterbo, by Thomas James Wise, and many others. Enjoy!

Any intention of acquiring the new text Bibliotheca Fictiva by Freedman as well? http://www.quaritch.com/wp-content/uploads/sites/23/2014/09/Bibliotheca-Fictiva.pdf

I’m not seeing it available on Amazon yet…

Inquire in the Margine

If the Page satisfie not, inquire in the Margine:

John Selden (1584-1654), English jurist and a scholar
in Illustrations (1612), a commentary on Poly-Olbion, a poem by Michael Drayton
in the margin next to ‘A table to the chiefest passages, in the Illustrations, which, worthiest of observation, are not directed unto by the course of the volume.’

See Leopold. See Molly. Hear Molly’s Soliloquy.

Instagram filter used: Normal

BIRS Workshop on Biological and Bio-Inspired Information Theory | Storify Stream

Over the span of the coming week, I’ll be updating (and archiving) the stream of information coming out of the BIRS Workshop on Biological and Bio-Inspired Information Theory.

Editor’s note: On 12/12/17 Storify announced they would be shutting down. As a result, I’m changing the embedded version of the original data served by Storify for an HTML copy which can be found below: