What is Information? by Christoph Adami

Bookmarked What is Information? [1601.06176] by Christoph AdamiChristoph Adami (arxiv.org)

Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.

Comments: 19 pages, 2 figures. To appear in Philosophical Transaction of the Royal Society A
Subjects: Adaptation and Self-Organizing Systems (nlin.AO); Information Theory (cs.IT); Biological Physics (physics.bio-ph); Quantitative Methods (q-bio.QM)
Cite as:arXiv:1601.06176 [nlin.AO] (or arXiv:1601.06176v1 [nlin.AO] for this version)

From: Christoph Adami
[v1] Fri, 22 Jan 2016 21:35:44 GMT (151kb,D) [.pdf]

A proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.

Marvin Minsky, Pioneer in Artificial Intelligence, Dies at 88 | The New York Times

Professor Minsky laid the foundation for the field by demonstrating the possibilities of imparting common-sense reasoning to computers.

Source: Marvin Minsky, Pioneer in Artificial Intelligence, Dies at 88 – The New York Times

Quantum Biological Information Theory by Ivan B. Djordjevic | Springer

Bookmarked Quantum Biological Information Theory (Springer, 2015)
Springer recently announced the publication of the book Quantum Biological Information Theory by Ivan B. Djordjevic, in which I’m sure many readers here will have interest. I hope to have a review of it shortly after I’ve gotten a copy. Until then…

From the publisher’s website:

This book is a self-contained, tutorial-based introduction to quantum information theory and quantum biology. It serves as a single-source reference to the topic for researchers in bioengineering, communications engineering, electrical engineering, applied mathematics, biology, computer science, and physics. The book provides all the essential principles of the quantum biological information theory required to describe the quantum information transfer from DNA to proteins, the sources of genetic noise and genetic errors as well as their effects.

  • Integrates quantum information and quantum biology concepts;
  • Assumes only knowledge of basic concepts of vector algebra at undergraduate level;
  • Provides a thorough introduction to basic concepts of quantum information processing, quantum information theory, and quantum biology;
  • Includes in-depth discussion of the quantum biological channel modelling, quantum biological channel capacity calculation, quantum models of aging, quantum models of evolution, quantum models on tumor and cancer development, quantum modeling of bird navigation compass, quantum aspects of photosynthesis, quantum biological error correction.

Source: Quantum Biological Information Theory | Ivan B. Djordjevic | Springer

9783319228150I’ll note that it looks like it also assumes some reasonable facility with quantum mechanics in addition to the material listed above.

Springer also has a downloadable copy of the preface and a relatively extensive table of contents for those looking for a preview. Dr. Djordjevic has been added to the ever growing list of researchers doing work at the intersection of information theory and biology.

The Information Theory of Life | Quanta Magazine

Bookmarked The Information Theory of Life (Quanta Magazine)
The Information Theory of Life: The polymath Christoph Adami is investigating life’s origins by reimagining living things as self-perpetuating information strings.

Why math? JHU mathematician on teaching, theory, and the value of math in a modern world | Hub

Bookmarked Why math? JHU mathematician on teaching, theory, and the value of math in a modern world (The Hub)
Great to see this interview with my friend and mathematician Richard Brown from Johns Hopkins Unviersity.  Psst: He’s got an interesting little blog, or you can follow some of his work on Facebook and Twitter.

Click through for the full interview: Q+A with Richard Brown, director of undergraduate studies in Johns Hopkins University’s Department of Mathematics

 

https://youtu.be/kg2mOl042ng

3 Rules of Academic Blogging

Bookmarked 3 Rules of Academic Blogging (The Chronicle of Higher Education)
Not only is the form alive and well, but one of its most vibrant subsections is in academe.

1. Pick the right platform.
2. Write whatever you want.
3. Write for the sake of writing.

Winter Q-BIO Quantitative Biology Meeting February 15-18, 2016

Bookmarked Winter Q-BIO Quantitative Biology Meeting February 15-18, 2016 (w-qbio.org)
The Winter Q-BIO Quantitative Biology Meeting is coming up at the Sheraton Waikiki in Oahu, HI, USA

A predictive understanding of living systems is a prerequisite for designed manipulation in bioengineering and informed intervention in medicine. Such an understanding requires quantitative measurements, mathematical analysis, and theoretical abstraction. The advent of powerful measurement technologies and computing capacity has positioned biology to drive the next scientific revolution. A defining goal of Quantitative Biology (qBIO) is the development of general principles that arise from networks of interacting elements that initially defy conceptual reasoning. The use of model organisms for the discovery of general principles has a rich tradition in biology, and at a fundamental level the philosophy of qBIO resonates with most molecular and cell biologists. New challenges arise from the complexity inherent in networks, which require mathematical modeling and computational simulation to develop conceptual “guideposts” that can be used to generate testable hypotheses, guide analyses, and organize “big data.”

The Winter q-bio meeting welcomes scientists and engineers who are interested in all areas of q-bio. For 2016, the meeting will be hosted at the Sheraton Waikiki, which is located in Honolulu, on the island of Oahu. The resort is known for its breathtaking oceanfront views, a first-of-its-kind recently opened “Superpool” and many award-winning dining venues. Registration and accommodation information can be found via the links at the top of the page.

Source: Winter Q-BIO Quantitative Biology Meeting

The Mathematics Literature Project

Bookmarked The Mathematics Literature Project (tqft.net)

“The Mathematics Literature Project intends to survey the state of the freely accessible mathematics literature. In particular, it will index freely accessible URLs for mathematics articles. These are legitimately hosted copies of the article (i.e. at publishers, the arXiv, institutional repositories, or authors’ homepages), which are freely available in any browser, anywhere in the world.”

Obituary: Wes Craven

Bookmarked Wes Craven Dead: Movies 'Scream', 'Nightmare on Elm Street' Horrified Viewers (The Hollywood Reporter)
Wes Craven, the famed maestro of horror known for the Nightmare on Elm Street and Scream franchises, died Sunday after a battle with brain cancer. He was 76.
Saddened to  hear that filmmaker and fellow Johns Hopkins University alum Wes Craven has passed away this afternoon. He was certainly a scholar and a gentleman and will be missed terribly.

Obituary: Wes Craven, Horror Maestro, Dies at 76 – Hollywood Reporter 

Wes Craven
Wes Craven

Stephen Hawking says he’s solved a black hole mystery, but physicists await the proof

Bookmarked Stephen Hawking says he's solved a black hole mystery, but physicists await the proof by Eryn BrownEryn Brown (latimes.com)
Physicist Stephen Hawking made a splash this week when he announced that he had solved a vexing conundrum that had puzzled generations of leading physicists -- including the 73-year-old scientific superstar himself -- for the better part of a half-century.

Breaking the code | The Economist

Bookmarked Breaking the code (The Economist)
Brief book overview of Matthew Cobb's "Life’s Greatest Secret" from The Economist.
For those interested in some of the history behind genetics, evolution, biology and information theory, the following book, which I just saw the attached review in The Economist, is likely to be of interest:

Life’s Greatest Secret: The Story of the Race to Crack the Genetic Code. By Matthew Cobb. Basic Books; 434 pages; $29.99. Profile Books; £25.

In 1953 James Watson and Francis Crick, with the help of Rosalind Franklin and Maurice Wilkins, described the structure of the molecule at the heart of life. Deoxyribonucleic acid, better known as DNA, was, they said, a double helix, two spirals joined across the middle by pairs of four chemical bases, like a twisted ladder. That work earned Messrs Crick, Watson and Wilkins a Nobel prize and a place in the history books. The image of the double helix now often stands for biology, or even science, itself.

But this was merely the most visible breakthrough in a long struggle to understand the engine of life—how traits are inherited, mutated and weeded out by natural selection, and how the whole mysterious process works at the biochemical level. It is that lesser-known history that Matthew Cobb, a professor of animal behaviour at the University of Manchester, aims to sketch in his book, which has been shortlisted for the Royal Society’s Winton prize for science writing.

The result is a fascinating reminder of just how hard-won are the seemingly obvious facts of modern biology. The development of genetics was a tale of confusion, accident, frustration and the occasional flash of insight. It was, says Dr Cobb, as important as the Manhattan or Apollo projects, but with no government support and little money, carried out by scientists interested in the question for its own sake.

The researchers started from almost total ignorance. William Harvey, better known for describing the circulation of the blood, wondered in the 17th century what could explain why children’s skin colour was often a blend of their parents’, whereas they share a sex with only one, and can have an eye colour different from either.

In the late 19th century a monk, Gregor Mendel, established, through experiments on pea plants, the basic rules of inherited traits. A Danish biologist, Wilhelm Johannsen, coined the term “gene” in 1909 to describe whatever it was that Mendel had found. But as late as 1933 scientists were still debating whether genes were physical things or just useful abstractions, and how they could transmit traits. Scientists knew that DNA existed, but many considered it a boring bit of scaffolding in the cell. Proteins, which come in zillions of different varieties, were seen by many as the only things exciting enough to account for all the diversity seen in life.

After the second world war, ideas from information theory, arising out of wartime work on computers and automation, percolated into biology. Once the structure of DNA had been established, those ideas helped crack the problem of how the four chemical bases do their job. Proteins are built by stringing together 20 different sorts of amino acid. Strings of three bases within a DNA molecule represent these amino acids, but with 64 such triplets, there is much redundancy which information theory alone could not fully explain. Years of painstaking lab-work were needed to reconcile theory with reality.

Dr Cobb is good on the human side of the story, showing science as fuelled by rivalry, jealousy, competitiveness and wonder. The only downside is that he must marshal hundreds of scientists across several disciplines into around 300 pages of narrative. The results can sometimes be dense, and readers without a command of biological jargon will frequently find themselves consulting the glossary for guidance. But the cracking of the code of life is a great story, of which this is an accomplished telling.

Source: Breaking the code | The Economist, 

 

Life’s Greatest Secret

The Math That Connects Pluto to DNA — NOVA Next | PBS

Bookmarked The Math That Connects Pluto to DNA by Alex RileyAlex Riley (NOVA Next | PBS)
How a mathematical breakthrough from the 1960s now powers everything from spacecraft to cell phones.
Concurrent with the recent Pluto fly by, Alex Riley has a great popular science article on PBS that helps put the application of information theory and biology into perspective for the common person. Like a science version of “The Princess Bride”, this story has a little bit of everything that could be good and entertaining: information theory, biology, DNA, Reed-Solomon codes, fossils, interplanetary exploration, mathematics, music, genetics, computers, and even paleontology. Fans of Big History are sure to love the interconnections presented here.

Reed-Solomon codes correct for common transmission errors, including missing pixels (white), false signals (black), and paused transmissions (the white stripe).
Reed-Solomon codes correct for common transmission errors, including missing pixels (white), false signals (black), and paused transmissions (the white stripe).

Microscopic view of glass DNA storage beads

Molecular Programming Project

Bookmarked Molecular Programming Project (Molecular Programming Project)
 

“The Molecular Programming Project aims to develop computer science principles for programming information-bearing molecules like DNA and RNA to create artificial biomolecular programs of similar complexity. Our long-term vision is to establish molecular programming as a subdiscipline of computer science — one that will enable a yet-to-be imagined array of applications from chemical circuitry for interacting with biological molecules to nanoscale computing and molecular robotics.”

Source: MPP: Home

Science & Cooking: From Haute Cuisine to Soft Matter Science | edX

Bookmarked Science & Cooking: From Haute Cuisine to Soft Matter Science (edX)
Top chefs and Harvard researchers explore how everyday cooking and haute cuisine can illuminate basic principles in physics and engineering, and vice versa.
 

 

 

8th Annual North American School of Information Theory (NASIT)

Bookmarked 8th Annual North American School of Information Theory (NASIT) (nasit15.ucsd.edu)
August 10-13, 2015 – UC San Diego, La Jolla, California
Application deadline: June 7, 2015

The School of Information Theory will bring together over 100 graduate students, postdoctoral scholars, and leading researchers for four action-packed days of learning, stimulating discussions, professional networking and fun activities, all on the beautiful campus of the University of California, San Diego (UCSD) and in the nearby beach town of La Jolla.

  • Tutorials by some of the best known researchers in information theory and related fields
  • Poster presentations by student participants with feedback and discussion
  • Panel discussion on “IT: Academia vs. Industry Perspectives”
  • Social events and fun activities