Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.
Comments: 19 pages, 2 figures. To appear in Philosophical Transaction of the Royal Society A
Subjects: Adaptation and Self-Organizing Systems (nlin.AO); Information Theory (cs.IT); Biological Physics (physics.bio-ph); Quantitative Methods (q-bio.QM)
Cite as:arXiv:1601.06176 [nlin.AO] (or arXiv:1601.06176v1 [nlin.AO] for this version)From: Christoph Adami
[v1] Fri, 22 Jan 2016 21:35:44 GMT (151kb,D) [.pdf]
Bookmarks
Marvin Minsky, Pioneer in Artificial Intelligence, Dies at 88 | The New York Times
Professor Minsky laid the foundation for the field by demonstrating the possibilities of imparting common-sense reasoning to computers.
Source: Marvin Minsky, Pioneer in Artificial Intelligence, Dies at 88 – The New York Times
Quantum Biological Information Theory by Ivan B. Djordjevic | Springer
From the publisher’s website:
This book is a self-contained, tutorial-based introduction to quantum information theory and quantum biology. It serves as a single-source reference to the topic for researchers in bioengineering, communications engineering, electrical engineering, applied mathematics, biology, computer science, and physics. The book provides all the essential principles of the quantum biological information theory required to describe the quantum information transfer from DNA to proteins, the sources of genetic noise and genetic errors as well as their effects.
- Integrates quantum information and quantum biology concepts;
- Assumes only knowledge of basic concepts of vector algebra at undergraduate level;
- Provides a thorough introduction to basic concepts of quantum information processing, quantum information theory, and quantum biology;
- Includes in-depth discussion of the quantum biological channel modelling, quantum biological channel capacity calculation, quantum models of aging, quantum models of evolution, quantum models on tumor and cancer development, quantum modeling of bird navigation compass, quantum aspects of photosynthesis, quantum biological error correction.
Source: Quantum Biological Information Theory | Ivan B. Djordjevic | Springer
I’ll note that it looks like it also assumes some reasonable facility with quantum mechanics in addition to the material listed above.
Springer also has a downloadable copy of the preface and a relatively extensive table of contents for those looking for a preview. Dr. Djordjevic has been added to the ever growing list of researchers doing work at the intersection of information theory and biology.
The Information Theory of Life | Quanta Magazine
The Information Theory of Life: The polymath Christoph Adami is investigating life’s origins by reimagining living things as self-perpetuating information strings.
Why math? JHU mathematician on teaching, theory, and the value of math in a modern world | Hub
Click through for the full interview: Q+A with Richard Brown, director of undergraduate studies in Johns Hopkins University’s Department of Mathematics
https://youtu.be/kg2mOl042ng
3 Rules of Academic Blogging
Not only is the form alive and well, but one of its most vibrant subsections is in academe.
Winter Q-BIO Quantitative Biology Meeting February 15-18, 2016
The Winter Q-BIO Quantitative Biology Meeting is coming up at the Sheraton Waikiki in Oahu, HI, USA
A predictive understanding of living systems is a prerequisite for designed manipulation in bioengineering and informed intervention in medicine. Such an understanding requires quantitative measurements, mathematical analysis, and theoretical abstraction. The advent of powerful measurement technologies and computing capacity has positioned biology to drive the next scientific revolution. A defining goal of Quantitative Biology (qBIO) is the development of general principles that arise from networks of interacting elements that initially defy conceptual reasoning. The use of model organisms for the discovery of general principles has a rich tradition in biology, and at a fundamental level the philosophy of qBIO resonates with most molecular and cell biologists. New challenges arise from the complexity inherent in networks, which require mathematical modeling and computational simulation to develop conceptual “guideposts” that can be used to generate testable hypotheses, guide analyses, and organize “big data.”
The Winter q-bio meeting welcomes scientists and engineers who are interested in all areas of q-bio. For 2016, the meeting will be hosted at the Sheraton Waikiki, which is located in Honolulu, on the island of Oahu. The resort is known for its breathtaking oceanfront views, a first-of-its-kind recently opened “Superpool” and many award-winning dining venues. Registration and accommodation information can be found via the links at the top of the page.
The Mathematics Literature Project
“The Mathematics Literature Project intends to survey the state of the freely accessible mathematics literature. In particular, it will index freely accessible URLs for mathematics articles. These are legitimately hosted copies of the article (i.e. at publishers, the arXiv, institutional repositories, or authors’ homepages), which are freely available in any browser, anywhere in the world.”
Obituary: Wes Craven
Wes Craven, the famed maestro of horror known for the Nightmare on Elm Street and Scream franchises, died Sunday after a battle with brain cancer. He was 76.
Obituary: Wes Craven, Horror Maestro, Dies at 76 – Hollywood Reporter

Stephen Hawking says he’s solved a black hole mystery, but physicists await the proof
Physicist Stephen Hawking made a splash this week when he announced that he had solved a vexing conundrum that had puzzled generations of leading physicists -- including the 73-year-old scientific superstar himself -- for the better part of a half-century.
Breaking the code | The Economist
Brief book overview of Matthew Cobb's "Life’s Greatest Secret" from The Economist.
Life’s Greatest Secret: The Story of the Race to Crack the Genetic Code. By Matthew Cobb. Basic Books; 434 pages; $29.99. Profile Books; £25.
In 1953 James Watson and Francis Crick, with the help of Rosalind Franklin and Maurice Wilkins, described the structure of the molecule at the heart of life. Deoxyribonucleic acid, better known as DNA, was, they said, a double helix, two spirals joined across the middle by pairs of four chemical bases, like a twisted ladder. That work earned Messrs Crick, Watson and Wilkins a Nobel prize and a place in the history books. The image of the double helix now often stands for biology, or even science, itself.
But this was merely the most visible breakthrough in a long struggle to understand the engine of life—how traits are inherited, mutated and weeded out by natural selection, and how the whole mysterious process works at the biochemical level. It is that lesser-known history that Matthew Cobb, a professor of animal behaviour at the University of Manchester, aims to sketch in his book, which has been shortlisted for the Royal Society’s Winton prize for science writing.
The result is a fascinating reminder of just how hard-won are the seemingly obvious facts of modern biology. The development of genetics was a tale of confusion, accident, frustration and the occasional flash of insight. It was, says Dr Cobb, as important as the Manhattan or Apollo projects, but with no government support and little money, carried out by scientists interested in the question for its own sake.
The researchers started from almost total ignorance. William Harvey, better known for describing the circulation of the blood, wondered in the 17th century what could explain why children’s skin colour was often a blend of their parents’, whereas they share a sex with only one, and can have an eye colour different from either.
In the late 19th century a monk, Gregor Mendel, established, through experiments on pea plants, the basic rules of inherited traits. A Danish biologist, Wilhelm Johannsen, coined the term “gene” in 1909 to describe whatever it was that Mendel had found. But as late as 1933 scientists were still debating whether genes were physical things or just useful abstractions, and how they could transmit traits. Scientists knew that DNA existed, but many considered it a boring bit of scaffolding in the cell. Proteins, which come in zillions of different varieties, were seen by many as the only things exciting enough to account for all the diversity seen in life.
After the second world war, ideas from information theory, arising out of wartime work on computers and automation, percolated into biology. Once the structure of DNA had been established, those ideas helped crack the problem of how the four chemical bases do their job. Proteins are built by stringing together 20 different sorts of amino acid. Strings of three bases within a DNA molecule represent these amino acids, but with 64 such triplets, there is much redundancy which information theory alone could not fully explain. Years of painstaking lab-work were needed to reconcile theory with reality.
Dr Cobb is good on the human side of the story, showing science as fuelled by rivalry, jealousy, competitiveness and wonder. The only downside is that he must marshal hundreds of scientists across several disciplines into around 300 pages of narrative. The results can sometimes be dense, and readers without a command of biological jargon will frequently find themselves consulting the glossary for guidance. But the cracking of the code of life is a great story, of which this is an accomplished telling.
The Math That Connects Pluto to DNA — NOVA Next | PBS
How a mathematical breakthrough from the 1960s now powers everything from spacecraft to cell phones.

Molecular Programming Project
“The Molecular Programming Project aims to develop computer science principles for programming information-bearing molecules like DNA and RNA to create artificial biomolecular programs of similar complexity. Our long-term vision is to establish molecular programming as a subdiscipline of computer science — one that will enable a yet-to-be imagined array of applications from chemical circuitry for interacting with biological molecules to nanoscale computing and molecular robotics.”
Source: MPP: Home
Science & Cooking: From Haute Cuisine to Soft Matter Science | edX
Top chefs and Harvard researchers explore how everyday cooking and haute cuisine can illuminate basic principles in physics and engineering, and vice versa.
8th Annual North American School of Information Theory (NASIT)
Application deadline: June 7, 2015
The School of Information Theory will bring together over 100 graduate students, postdoctoral scholars, and leading researchers for four action-packed days of learning, stimulating discussions, professional networking and fun activities, all on the beautiful campus of the University of California, San Diego (UCSD) and in the nearby beach town of La Jolla.
- Tutorials by some of the best known researchers in information theory and related fields
- Poster presentations by student participants with feedback and discussion
- Panel discussion on “IT: Academia vs. Industry Perspectives”
- Social events and fun activities




