I got a ton of requests for this.... A time lapse for every hit of Ichiro's @mlb career. pic.twitter.com/w8uhzlSnp0
— Daren Willman (@darenw) May 6, 2018
Tag: statistical mechanics
❤️ VioricaMarian1 tweet about afternoon classes
I once taught an 8 am college class. So many grandparents died that semester. I then moved my class to 3 pm. No more deaths. And that, my friends, is how I save lives.
— Viorica Marian (@VioricaMarian1) May 5, 2018
I wonder what a statistical analysis would do to improve peoples’ lives if registrars attempted to put the mass of classes in the middle of the day? Would educational outcomes improve along with peoples’ psyches? Many schedulers are trying to maximize based on the scarcity of classroom resources. What if they maximized on mental health and classroom performance? Is classroom scheduling potentially a valuable public health tool?
Syndicated copies to:🎧 Episode 07 Hallelujah  Revisionist History
In 1984, Elvis Costello released what he would say later was his worst record: Goodbye Cruel World. Among the most discordant songs on the album was the forgettable “The Deportees Club.” But then, years later, Costello went back and rerecorded it as “Deportee,” and today it stands as one of his most sublime achievements.
“Hallelujah” is about the role that time and iteration play in the production of genius, and how some of the most memorable works of art had modest and undistinguished births.
And here I thought I knew a lot about the story of Hallelujah. I haven’t read any of the books on its history, nor written any myself, but this short story does have a good bit I’ve not heard before in the past. I did read quite a bit when Cohen passed away, and even spent some time making a Spotify playlist with over five hours of covers.
The bigger idea here of immediate genius versus “slow cooked” genius is the fun one to contemplate. I’ve previously heard stories about Mozart’s composing involved his working things out in his head and then later putting them on paper much the same way that a “cow pees” (i.e. all in one quick go or a fast flood.)
Another interesting thing I find here is the insanely small probability that the chain of events that makes the song popular actually happens. It seems worthwhile to look at the statistical mechanics of the production of genius. Perhaps applying Ridley’s concepts of “Ideas having sex” and Dawkin’s “meme theory” (aka selfish gene) could be interestingly useful. What does the state space of genius look like?
Syndicated copies to:🎧 Episode 06 My Little Hundred Million  Revisionist History
In the early ’90s, Hank Rowan gave $100 million to a university in New Jersey, an act of extraordinary generosity that helped launch the greatest explosion in educational philanthropy since the days of Andrew Carnegie and the Rockefellers. But Rowan gave his money to Glassboro State University, a tiny, almost bankrupt school in South Jersey, while almost all of the philanthropists who followed his lead made their donations to elite schools such as Harvard and Yale. Why did no one follow Rowan’s example?
“My Little Hundred Million” is the third part of Revisionist History’s educational miniseries. It looks at the hidden ideologies behind giving and how a strange set of ideas has hijacked educational philanthropy.
The key idea laid out stunningly here is strong links versus weak links.
I’m generally flabbergasted by the general idea proposed here and will have to do some more research in the near future to play around further with the ideas presented. Fortunately, in addition to the education specific idea presented, Gladwell also comes up with an additional few examples in sports by using the differences between soccer and basketball to show the subtle differences.
If he and his lab aren’t aware of the general concept, I would recommend this particular podcast and the concept of strong and weak links to César Hidalgo (t) who might actually have some troves of economics data to use to play around with some general modeling to expand upon these ideas. I’ve been generally enamored of Hidalgo’s general thesis about the overall value of links as expressed in Why Information Grows: The Evolution of Order, from Atoms to Economies^{1}. I often think of it with relation to political economies and how the current administration seems to be (often quietly) destroying large amounts of value by breaking down a variety of economic, social, and political links within the United States as well as between our country and others.
I wonder if the additional ideas about the differences between strong and weak links might further improve these broader ideas. The general ideas behind statistical mechanics and statistics make me think that Gladwell, like Hidalgo, is certainly onto a strong idea which can be continued to be refined to improve billions of lives. I’ll have to start some literature searches now…
References
🎧 Episode 04 Carlos Doesn’t Remember  Revisionist History
Carlos is a brilliant student from South Los Angeles. He attends an exclusive private school on an academic scholarship. He is the kind of person the American meritocracy is supposed to reward. But in the hidden details of his life lies a cautionary tale about how hard it is to rise from the bottom to the top—and why the American school system, despite its best efforts, continues to leave an extraordinary amount of talent on the table.
Eric Eisner and students from his YES Program featured above. Photo credit: David Lauridsen and Los Angeles Magazine “Carlos Doesn’t Remember” is the first in a threepart Revisionist History miniseries taking a critical look at the idea of capitalization—the measure of how well America is making use of its human potential.
Certainly a stunning episode! Some of this is just painful to hear though.
We should easily be able to make things simpler, fairer, and more resilient for a lot of the poor we’re overlooking in society. As a larger group competing against other countries, we’re heavily undervaluing a major portion of our populace, and we’re going to need them just to keep pace. America can’t be the “greatest” country without them.
Syndicated copies to:🔖 Can entropy be defined for and the Second Law applied to the entire universe? by Arieh BenNaim  Arxiv
This article provides answers to the two questions posed in the title. It is argued that, contrary to many statements made in the literature, neither entropy, nor the Second Law may be used for the entire universe. The origin of this misuse of entropy and the second law may be traced back to Clausius himself. More resent (erroneous) justification is also discussed.
Statistical Physics, Information Processing, and Biology Workshop at Santa Fe Institute
The Santa Fe Institute, in New Mexico, is a place for studying complex systems. I’ve never been there! Next week I’ll go there to give a colloquium on network theory, and also to participate in this workshop.
I just found out about this from John Carlos Baez and wish I could go! How have I not managed to have heard about it?
Syndicated copies to:Stastical Physics, Information Processing, and Biology
Workshop
November 16, 2016 – November 18, 2016
9:00 AM
Noyce Conference RoomAbstract.
This workshop will address a fundamental question in theoretical biology: Does the relationship between statistical physics and the need of biological systems to process information underpin some of their deepest features? It recognizes that a core feature of biological systems is that they acquire, store and process information (i.e., perform computation). However to manipulate information in this way they require a steady flux of free energy from their environments. These two, interrelated attributes of biological systems are often taken for granted; they are not part of standard analyses of either the homeostasis or the evolution of biological systems. In this workshop we aim to fill in this major gap in our understanding of biological systems, by gaining deeper insight in the relation between the need for biological systems to process information and the free energy they need to pay for that processing.The goal of this workshop is to address these issues by focusing on a set three specific question:
 How has the fraction of free energy flux on earth that is used by biological computation changed with time?;
 What is the free energy cost of biological computation / function?;
 What is the free energy cost of the evolution of biological computation / function.
In all of these cases we are interested in the fundamental limits that the laws of physics impose on various aspects of living systems as expressed by these three questions.
Purpose: Research Collaboration
SFI Host: David Krakauer, Michael Lachmann, Manfred Laubichler, Peter Stadler, and David Wolpert
Network Science by AlbertLászló Barabási
I ran across a link to this textbook by way of a standing Google alert, and was excited to check it out. I was immediately disappointed to think that I would have to wait another month and change for the physical textbook to be released, but made my preorder directly. Then with a bit of digging around, I realized that individual chapters are available immediately to quench my thirst until the physical text is printed next month.
The textbook is available for purchase in September 2016 from Cambridge University Press. Preorder now on Amazon.com.
If you’re not already doing so, you should follow Barabási on Twitter.
Syndicated copies to:Its beautiful! Help me share the good news! Available here https://t.co/ZGuO06dV74 and here https://t.co/BCwq9PBLlZ. pic.twitter.com/8mnV0SOVWw
— Laszlo Barabasi (@barabasi) August 3, 2016
Weekly Recap: Interesting Articles 7/247/31 2016
Went on vacation or fell asleep at the internet wheel this week? Here’s some of the interesting stuff you missed.
Science & Math
 Context Specific and Differential Gene Coexpression Networks via Bayesian Biclustering  PLOS Computational Biology
 The Competing Incentives of Academic Research in Mathematics
 [1607.08473] Quantum circuits and lowdegree polynomials over F_2
 This Physics Pioneer Walked Away from it All  Nautilus
 Monumental proof to torment mathematicians for years to come: Conference on Shinichi Mochizuki’s work inspires cautious optimism.  Nature
 What Your Brain Looks Like When It Solves a Math Problem  New York Times
 Habits of Highly Mathematical People
 Why You Should Care About HighDimensional Sphere Packing  Roots of Unity
 Initial steps toward reproducible research
 Bridging the Curation Gap between Research and Libraries – A Case Study
 Quantum steampunk: Quantum information applied to thermodynamics
 How Vector Space Mathematics Reveals the Hidden Sexism in Language
 How Sound Can Make Food Taste Better  Nautilus
 Top 10 algorithms of 20th century numerical analysis, from a talk by Alex Townsend
 UK vs. US: Who’s got the right way to teach math(s)?  Math with Bad Drawin
 Physics & Caffeine: Stop Motion Film Uses a Cup of Coffee to Explain Key Co
 The Water Kingdom: A Secret History of China by Philip Ball (review)
 The master of them all: Book review for”Leonhard Euler: Mathematical Genius in the Enlightenment”  The Economist
 Biologists Search for New Model Organisms: The bulk of biological research is centered on a handful of species. Are we missing a huge chunk of life’s secrets?
 Onesentence proof of Fermat’s theorem on sums of two squares  Fermat’s Library
 This protein designer aims to revolutionize medicines and materials
 Our last common ancestor inhaled hydrogen from underwater volcanoes
 Meet Luca, The Ancestor of All Living Things  New York Times
 *Disconnected, fragmented, or united? a transdisciplinary review of network
 What’s Behind A Science vs. Philosophy Fight?  Big Think
 What is a “Neutral Network” Anyway? An Exploration and Rediscovery of the Aims of Net Neutrality in Theory and Practice
 The Brachistochrone Curve: The Problem of Quickest Descent  Fermat’s Library
 In what sense is Quantum Mechanics a theory of information?  Quora
 Major transitions in information technology  Philosophical Transactions of
 Human brain mapped in unprecedented detail: Nearly 100 previously unidentified brain areas revealed by examination of the cerebral cortex.  Nature
 Cell biologists should specialize, not hybridize: Dry cell biologists, who bridge computer science and cell biology, should have a pivotal role in driving effective team science, says Assaf Zaritsky  Nature
 Internet 3.0: How we take back control from the giants  New Scientist
 How a Guy From a Montana Trailer Park Overturned 150 Years of Biology  The Atlantic
 People can sense single photons  Nature News & Comment
 Defining synergy thermodynamically using quantitative measurements of entropy and free energy
 A Prime Case of Chaos  AMS.org
 Murray GellMann (video interviews) – YouTube
 Mathematics & Chalk: A teary goodbye to Hagomoro  Jeremy Kun
Publishing
 Want to Change Academic Publishing? Just Say No  Chronicle
 Textbooks Show Aging Signs: Curated Guides Are Next – 10+ Disruptive Factors Transforming the World of Education and Learning — Consequences, Opportunities, Tools
 Simon & Schuster, Penguin, Random House Don’t Want to Talk About Their Ebook Sales
 Amazon Sales Rank: Taming the Algorithm  SelfPublishing Author Advice
 What Authors Should Know About Advance Review Copies
 Ingram Launches Ingram Academic Services
 How a Publishing House Designs a Book Cover
 How Indie Bookstores Help Drive Book Discoverability
 How to Grow Your Email List
 3 Ways Indie Publishers Sell Books  Digital Book World
 10 SelfPublishing Trends to Watch
 Ingram Launches Academic Services for University Presses and Academic Publishers
 Indigo Goes Where Amazon, B&N, Goodreads, and a Dozen Publishers and Startus Have Dared to Tread
 How To Make An Ebook Feel More Like A Real Book
 Looking for open digital collections – Wynken de Worde
Indieweb, Internet, Identity, Blogging, Social Media
 What is Open Source?
 Microformats with Tantek Çelik  tlks.io https://www.youtube.com/watch?v=kDQigkxyiqE
 My Text Editor is Absolutely Sublime  Devon Zuegel
 My zsh aliases  Devon Zuegel
 XOXO Festival
 Web Design in 4 minutes
 Custom Elements
 Design Principles
 Infographic: The Optimal Length for Every Social Media Update
 Notes For New (and Potential) Twitter Followers  Whatever
 How Blogs Work Today – Whatever
 My reply to: How Blogs Work Today  Whatever
 Unicode Character ‘ZERO WIDTH SPACE’ (U 200B)
 A Book Apart, Practical SVG
 Gillmor Gang Trumpathon
 The best news aggregation service – The Sweet Setup
 Social Startup Sprinklr Is Now Valued At $1.8 Billion After $105 Million Raise  Forbes
 Epeus’ epigone: Digital publics, Conversations and Twitter
General
 The New Meaning of Success
 7 Lessons from the Future of Content: Part One — Tools Are Cheap, Time Is Expensive
 7 Lessons from the Future of Content: Part Two — Let’s Play Risk
 Aron Pilhofer Joining Temple University School of Media and Communication
 Secrets and agents: George Akerlof’s 1970 paper, “The Market for Lemons”, is a foundation stone of information economics. The first in our series on seminal economic ideas  The Economist
 John Oliver has the takedown of Donald Trump’s Republican convention
 Reference: New Interactive Map Of 100,000 Photos and Videos Reveal “Lost London in the Victorian Era”
 “better modifiers than “insane(ly)” (Grammar and Usage)
 A lesson in the errors of statistical thinking: Nate Silver on Trump
 Trump & Putin. Yes, It’s Really a Thing
 Charlie Parker Plays with Dizzy Gillespie in Only Footage Capturing the “Bird” in True Live Performance
 Let Me Remind You Fuckers Who I Am (Shit HRC Can’t Say/satire)
What is Information? by Christoph Adami
Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.
A proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.
Comments: 19 pages, 2 figures. To appear in Philosophical Transaction of the Royal Society A
Subjects: Adaptation and SelfOrganizing Systems (nlin.AO); Information Theory (cs.IT); Biological Physics (physics.bioph); Quantitative Methods (qbio.QM)
Cite as:arXiv:1601.06176 [nlin.AO] (or arXiv:1601.06176v1 [nlin.AO] for this version)
From: Christoph Adami
[v1] Fri, 22 Jan 2016 21:35:44 GMT (151kb,D) [.pdf]
Source: Christoph Adami [1601.06176] What is Information? on arXiv
Syndicated copies to:The Information Universe Conference
Yesterday, via a notification from Lanyard, I came across a notice for the upcoming conference “The Information Universe” which hits several of the sweet spots for areas involving information theory, physics, the origin of life, complexity, computer science, and microbiology. It is scheduled to occur from October 79, 2015 at the Infoversum Theater in Groningen, The Netherlands.
I’ll let their site speak for itself below, but they already have an interesting line up of speakers including:
Keynote speakers
 Erik Verlinde, Professor Theoretical Physics, University of Amsterdam, Netherlands
 Alex Szalay, Alumni Centennial Professor of Astronomy, The Johns Hopkins University, USA
 Gerard ‘t Hooft, Professor Theoretical Physics, University of Utrecht, Netherlands
 Gregory Chaitin, Professor Mathematics and Computer Science, Federal University of Rio de Janeiro, Brasil
 Charley Lineweaver, Professor Astronomy and Astrophysics, Australian National University, Australia
 Lude Franke, Professor System Genetics, University Medical Center Groningen, Netherlands
Conference synopsis from their homepage:
Additional details about the conference including the participants, program, venue, and registration can also be found at their website.
Syndicated copies to:NIMBioS Workshop: Information Theory and Entropy in Biological Systems
Over the next few days, I’ll be maintaining a Storify story covering information related to and coming out of the Information Theory and Entropy Workshop being sponsored by NIMBios at the Unviersity of Tennessee, Knoxville.
For those in attendance or participating by watching the live streaming video (or even watching the video afterthefact), please feel free to use the official hashtag #entropyWS, and I’ll do my best to include your tweets, posts, and material into the story stream for future reference.
For journal articles and papers mentioned in/at the workshop, I encourage everyone to join the Mendeley.com group ITBio: Information Theory, Microbiology, Evolution, and Complexity and add them to the group’s list of papers. Think of it as a collaborative online journal club of sorts.
Those participating in the workshop are also encouraged to take a look at a growing collection of researchers and materials I maintain here. If you have materials or resources you’d like to contribute to the list, please send me an email or include them via the suggestions/submission form or include them in the comments section below.
Resources for Information Theory and Biology
 Researchers
 References and Journal Articles
 Books
 Related Academic, Research Institutes, Societies, Groups, and Organizations
 Conferences, Workshops, and Symposia
 Bionet.InfoTheory (Google Group/Usenet Group)
 #ITBio on Twitter
RSS Feed for BoffoSocko posts tagged with #ITBio
Syndicated copies to:
BIRS Workshop on Biological and BioInspired Information Theory  Storify Stream
Over the span of the coming week, I’ll be updating (and archiving) the stream of information coming out of the BIRS Workshop on Biological and BioInspired Information Theory.
Editor’s note: On 12/12/17 Storify announced they would be shutting down. As a result, I’m changing the embedded version of the original data served by Storify for an HTML copy which can be found below:
Edit
BIRS: Biological and BioInspired Information Theory
A 5 Day workshop on Biology and Information Theory hosted by the Banff International Research Station

I know where I’ll be in Oct 2014! Let’s hear it for Biology & Information Theory! https://www.birs.ca/events/2014/5dayworkshops/14w5170 … #ITBio #Banff @andreweckford

. @andreweckford You might be interested in this grouping of research papers: http://www.mendeley.com/groups/2545131/itbio/ … #ITBio #Banff

Wishing I was at the Gene Regulation and Information Theory meeting starting tomorrow http://bit.ly/XnHRZs #ITBio

#ITBio: @andreweckford has a new book on Molecular Communication available Oct 31. http://bit.ly/15uEUzF

Mathematical and Statistical Models for Genetic Coding starts today. http://www.am.hsmannheim.de/genetic_code_2013.php?id=1 … @andreweckford might borrow attendees for BIRS

John Baez has announced a workshop on Entropy & Information in Biological Systems http://johncarlosbaez.wordpress.com/2013/11/02/entropyandinformationinbiologicalsystems/ … #NIMBioS #ITBio @andreweckford

Mathematical Foundations for Information Theory in DiffusionBased Molecular Communications http://bit.ly/1aTVR2c #ITBio

Bill Bialek giving plenary talk “Information flow & order in real biological networks” at Feb 2014 workshop http://mnd.ly/19LQH8f #ITBio

Workshop on Information Theoretic Incentives for Artificial Life http://jhu.md/1lM8tAn #ITBio #ALife14 @alifeofficial @14thALIFE @cxdig

Researchers working in information theory & biology http://jhu.md/1gieQGR #ITBio @andreweckford @ChristophAdami @wbialek @johnhawks

Currently organizing my Banff workshop on bioinformation theory … https://www.birs.ca/events/2014/5dayworkshops/14w5170 …

Last RT: wonder what the weather is going to be like at the end of October for my @BIRS_Math workshop

@JoVanEvery I’m organizing a workshop in Banff in October … hopefully this isn’t a sign of weather to come!

Special issue of Entropy: “Information Theoretic Incentives for Cognitive Systems” http://boffosocko.com/2014/09/19/specialissueofentropyinformationtheoreticincentivesforcognitivesystems/ … #ITBio #CallForSubmissions

Next week @BIRS_Math: Biological and BioInspired Information Theory http://www.birs.ca/events/2014/5dayworkshops/14w5170 …  Live @ http://www.birs.ca/live #bioinformatics

Andrew Eckford (York University), The Landscape http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410270858Eckford.mp4 …

“Not an obvious connection between utility and information, just as there is no obvious connection between energy and entropy” @BIRS_Math

Peter Thomas (Case Western Reserve University), Signal Transduction and Information Theory http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410270940Thomas.mp4 …

Following @andreweckford @BIRS_Math 4 updates/video from Biological & BioInspired Information Theory https://storify.com/ChrisAldrich/biologicalandbioinspiredinformationtheory … @cxdig #ITBio

Live now: Nicolo Michelusi of @USCViterbi on Stochastic Model for Electron Transfer in Bacterial Cables http://www.birs.ca/live #ITBio

Nicolo Michelusi (University of Southern California), A Stochastic Model for Electron Transfer in Bacterial Cables http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410271450Michelusi.mp4 …

“Timing is fundamental … subsumes timevarying concentration channel” @cnmirose @BIRS_Math

Chris Rose (Rutgers University), Molecular Communication Channels: timing vs. payload http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410271538Rose.mp4 …

Standard opening quote of these talks: “I’m not a biologist, but …” @BIRS_Math

Stefan Moser (ETH Zurich), Capacity Bounds of the Memoryless AIGN Channel – a ToyModel for Molecular Communicat… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410271610Moser.mp4 …

Biodiversity, Entropy and ThermodynamicsI’m giving a short 30minute talk at a workshop on Biological and BioInspired Information Theory at the Banff International Research Institute. I’ll say more about the workshop later, but here’s my talk: * Biodiversity, entropy and thermodynamics. Most of the people at this workshop study neurobiology and cell signalling, not evolutionary game theory or…

Weisi Guo (University of Warwick), Communication Envelopes for Molecular Diffusion and Electromagnetic Wave Propag… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410271643Guo.mp4 …


.@Storify stream coming out of @BIRS_Math: Biological & BioInspired Information Theory this week: http://boffosocko.com/2014/10/27/birsworkshoponbiologicalandbioinspiredinformationtheorystorifystream/ …


Terrific introduction of Canada/Banff by Andrew Eckford (York)The Landscape http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410270858Eckford.mp4 …”

@andreweckford “The Landscape” to become a permanent resource for @BIRS_Math participants http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410270858Eckford.mp4 …”

Biological and BioInspired Information Theory workshop videos! http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos … @BIRS_Math

.@ChrisAldrich @andreweckford @Storify @BIRS_Math Sounds like a fascinating workshop on bioinformation theory in Banff.

Mathematical Modeling of Biological Processes (by Avner Friedman & ChiuYen Kao) http://www.amazon.com/MathematicalModelingBiologicalProcessesModelling/dp/3319083139/ref=as_sl_pc_ss_til?tag=compldiges20&linkCode=w01&linkId=3H5F3QNHI6IDWAFQ&creativeASIN=3319083139 …

Toby Berger, winner of the 2002 Shannon award, speaking right now. @BIRS_Math

Naftali Tishby (Hebrew University of Jerusalem), Sensing and acting under information constraints – a principled a… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281032Tishby.mp4 …

“…places such as BIRS and the Banff Centre exist to facilitate the exchange and pursuit of knowledge.” S. Sundaram http://www.birs.ca/testimonials/#testimonial1454 …

We’re going for a hike tomorrow. Many thanks to Lukas at the @ParksCanada info centre in Banff for helpful advice! @BIRS_Math

Behnaam Aazhang (Rice University), RealTime Network Modulation for Intractable Epilepsy http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281337Aazhang.mp4 …

Alexander Dimitrov (Washington State University), Invariant signal processing in auditory biological systems http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281416Dimitrov.mp4 …

Joel Zylberberg (University of Washington), Communicating with noisy signals: lessons learned from the mammalian v… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281450Zylberberg.mp4 …

Robert Schober (Universitat ErlangenNurnberg), Intersymbol interference mitigation in diffusive molecular communi… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281549Schober.mp4 …

Rudolf Rabenstein (FriedrichAlexanderUniversitat ErlangenNurnberg (FAU)), Modelling Molecular Communication Cha… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281627Rabenstein.mp4 …

THis week @BIRS_Math ” Biological and BioInspired Information Theory ” @thebanffcentre #biology #math @NSF

“Your theory might match the data, but the data might be wrong” – Crick @BIRS_Math

So information theory seems to be a big deal in ecology. @BIRS_Math

Tom Schneider (National Institutes of Health), Three Principles of Biological States: Ecology and Cancer http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410290904Schneider.mp4 …

“In biodiversity, the entropy of an ecosystem is the expected … information we gain about an organism by learning its species” @BIRS_Math

Seriously, I’m blown away by this work in information theory in ecology. Huge body of work; I had no idea. @BIRS_Math

.@andreweckford @QuantaMagazine had a nice overview of some of John Harte’s work in September http://bit.ly/1DwIWCD @BIRS_Math

ChanByoung Chae (Yonsei University), Molecular MIMO: From Theory to Practice http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410281705Chae.mp4 …

John Baez (University of California, Riverside), Biodiversity, entropy and thermodynamics http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410291038Baez.mp4 …

I encourage @BIRS_Math attendees at Biological & BioInspired Information Theory to contribute references here: http://bit.ly/1jQwObk

Christoph Adami (Michigan State University), Some InformationTheoretic Musings Concerning the Origin and Evolutio… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410291114Adami.mp4 …

Twitter Lists for @BIRS_Math workshop #Biology #InformationTheory:
#ITBIO: http://bit.ly/1yIfzfJ
#complexitytheory http://bit.ly/1scfZbw 
ICYMI @ChristophAdami had great paper: Informationtheoretic Considerations on Origin of Life on arXiv http://bit.ly/1yIhK2Q @BIRS_Math

Sensing and Acting Under Information ConstraintsI’m having a great time at a workshop on Biological and BioInspired Information Theory in Banff, Canada. You can see videos of the talks online. There have been lots of good talks so far, but this one really blew my mind: * Naftali Tishby, Sensing and acting under information constraints—a principled approach to biology and…

I’m listening to a talk on the origin of life at a workshop on Biological and BioInspired Information Theory. … https://plus.google.com/117562920675666983007/posts/gqFL7XY3quF …

Ilya Nemenman @EmoryUniversity on Predictive information http://bit.ly/1titfOw
Follow his research: http://bit.ly/1tithFW @BIRS_Math 

Ilya Nemenman (Emory University), Predictive information http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410300907Nemenman.mp4 …

Toby Berger (University of Virginia), Neruoscience Applications of GIG Distributions http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410280914Berger.mp4 …

Daniel Polani (University of Hertfordshire), Informational Principles in PerceptionAction Loops http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301038Polani.mp4 …

Fascinating stuff! #Information Theory #Entropy #Thermodynamics #Chemistry #Physics & lastly #Life itself: https://medium.com/thephysicsarxivblog/informationtheoryandtheoriginoflife4cf6b93d156c …

Didn’t get enough information theory & biology this week @BIRS_Math? Apply for NIMBioS workshop in April 2015 http://bit.ly/1yIeiWe #ITBio

Amin Emad (University of Illinois at UrbanaChampaign), Applications of Discrete Mathematics in Bioinformatics http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301329Emad.mp4 …

Paul Bogdan (University of Southern California), Multiscale Analysis Reveals Complex Behavior in Bacteria Populati… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301401Bogdan.mp4 …

Robert Shaw (ProtoLife Inc.), Information and Causality in a ReactionDiffusion System http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301434Shaw.mp4 …

Lubomir Kostal (Institute of Physiology, Academy of Sciences of the Czech Republic), Efficient information transmi… http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301534Kostal.mp4 …

Nima Soltani (Stanford University), Applications of Directed Information to Neuroscience http://www.birs.ca/events/2014/5dayworkshops/14w5170/videos/watch/201410301647Soltani.mp4 …

@lrvarshney I shoulda invited you to this BIRS workshop …

@conservativelez I’m a big fan of your dad’s research & was reminded of much of it via a workshop on Biological Information Theory

@conservativelez Though he may not have been able to attend, he can catch most of the talks online if he’d like https://www.birs.ca/events/2014/5dayworkshops/14w5170 …

Depressed that @BIRS_Math Workshop on Biological & BioInspired Information Theory is over? Relive it here: http://bit.ly/1rF3G4B #ITBio

Kudos @andreweckford, Toby Berger, Peter Thomas, @NGhoussoub, @BIRS_Math & friends on a fantastic workshop! http://bit.ly/1ckttZq

This @BIRS_Math Workshop was biggest thing in #informationtheory & #biology since the Gatlinburg Symposium in 1956. http://bit.ly/1rF4RRr

1/ Everyone I talked to said it was the best workshop they’d ever been to, and they’d like to do a followup workshop @BIRS_Math

2/ There is an amazing diversity of work under the umbrella of “information theory”. @BIRS_Math

3/ Much of this work is outside the IT mainstream, and an issue is that people use different terms for related concepts. @BIRS_Math

4/ Some community building is in order. I think this workshop was a good first step. @BIRS_Math

5/ Many many thanks to @BIRS_Math and huge kudos to @NGhoussoub for excellent service to the Canadian scientific community. BIRS is a gem.

6/ Also many thanks to the participants for their excellent talks, and to @ChrisAldrich for maintaining a Storify.

@andreweckford Perhaps we could consider tying in our friends from @sfiscience? @MelMitchell1 https://www.birs.ca/events/2014/5dayworkshops/14w5170 … @BIRS_Math #complexity

Entropy and Information in Biological Systems (Part 1)John Harte is an ecologist who uses maximum entropy methods to predict the distribution, abundance and energy usage of species. Marc Harper uses information theory in bioinformatics and evolutionary game theory. Harper, Harte and I are organizing a workshop on entropy and information in biological systems, and I’m really excited about it!

Entropy and Information in Biological Systems (Part 2)John Harte, Marc Harper and I are running a workshop! Now you can apply here to attend: * Information and entropy in biological systems, National Institute for Mathematical and Biological Synthesis, Knoxville Tennesee, WednesdayFriday, 810 April 2015. Click the link, read the stuff and scroll down to “CLICK HERE” to apply.

BioInspired Information TheoryThere will be a 5day workshop on Biological and BioInspired Information Theory at BIRS from Sunday the 26th to Friday the 31st of October, 2014. It’s being organized by * Toby Berger (University of Virginia) * Andrew Eckford (York University) * Peter Thomas (Case Western Reserve University) BIRS is the Banff International Research Station,…

Andrew Eckford: The BlogHow does it feel to (co)write a book and hold the finished product in your hands? About like this: Many, many thanks to my excellent coauthors, Tadashi Nakano and Tokuko Haraguchi, for their hard work; thanks to Cambridge for accepting this project and managing it well; and thanks to Satoshi Hiyama for writing a nice blurb.

Andrew Eckford: The BlogYou may have seen our PLOS ONE paper about tabletop molecular communication, which received loads of media coverage. One of the goals of this paper was to show that anyone can do experiments in molecular communication, without any wet labs or expensive apparatus.

Meeting: Gene Regulation and Information Theoryhttp://www.uniulm.de/~sschober/fachgruppe/Meeting2013/Meeting2013.shtml
Information Theory is the New Central Discipline
[My comments posted to the original Facebook post follow below.]
I’m coming to this post a bit late as I’m playing a bit of catch up, but agree with it wholeheartedly.
In particular, applications to molecular biology and medicine are really beginning to come to a heavy boil in just the past five years. This particular year is the progenitor of what appears to be the biggest renaissance for the application of information theory to the area of biology since Hubert Yockey, Henry Quastler, and Robert L. Platzman’s “Symposium on Information Theory in Biology at Gatlinburg, Tennessee” in 1956.
Upcoming/recent conferences/workshops on information theory in biology include:
 BIRS Workshop: Biological and BioInspired Information Theory
 Entropy and Information in Biological Systems at NIMBios
 CECAM Workshop: Entropy in Biomolecular Systems
 ALife breakout session on Information Theoretic Incentives for Artificial Life (which will also spawn off a special issue of the journal Entropy):
At the beginning of September, Christoph Adami posted an awesome and very sound paper on arXiv entitled “Informationtheoretic considerations concerning the origin of life” which truly portends to turn the science of the origin of life on its head.
I’ll note in passing, for those interested, that Claude Shannon’s infamous master’s thesis at MIT (in which he applied Boolean Algebra to electric circuits allowing the digital revolution to occur) and his subsequent “The Theory of Mathematical Communication” were so revolutionary, nearly everyone forgets his MIT Ph.D. Thesis “An Algebra for Theoretical Genetics” which presaged the areas of cybernetics and the current applications of information theory to microbiology and are probably as seminal as Sir R.A Fisher’s applications of statistics to science in general and biology in particular.
For those commenting on the post who were interested in a layman’s introduction to information theory, I recommend John Robinson Pierce’s An Introduction to Information Theory: Symbols, Signals and Noise (Dover has a very inexpensive edition.) After this, one should take a look at Claude Shannon’s original paper. (The MIT Press printing includes some excellent overview by Warren Weaver along with the paper itself.) The mathematics in the paper really aren’t too technical, and most of it should be comprehensible by most advanced high school students.
For those that don’t understand the concept of entropy, I HIGHLY recommend Arieh BenNaim’s book Entropy Demystified The Second Law Reduced to Plain Common Sense with Seven Simulated Games. He really does tear the concept down into its most basic form in a way I haven’t seen others come remotely close to and which even my mother can comprehend (with no mathematics at all). (I recommend this presentation to even those with Ph.D.’s in physics because it is so truly fundamental.)
For the more advanced mathematicians, physicists, and engineers Arieh BenNaim does a truly spectacular job of extending ET Jaynes’ work on information theory and statistical mechanics and comes up with a more coherent mathematical theory to conjoin the entropy of physics/statistical mechanics with that of Shannon’s information theory in A Farewell to Entropy: Statistical Thermodynamics Based on Information.
For the advanced readers/researchers interested in more at the intersection of information theory and biology, I’ll also mention that I maintain a list of references, books, and journal articles in a Mendeley group entitled “ITBio: Information Theory, Microbiology, Evolution, and Complexity.”
Syndicated copies to:How to Sidestep Mathematical Equations in Popular Science Books
In the publishing industry there is a general ruleofthumb that every mathematical equation included in a book will cut the audience of science books written for a popular audience in half – presumably in a geometric progression. This typically means that including even a handful of equations will give you an effective readership of zero – something no author and certainly no editor or publisher wants.
I suspect that there is a corollary to this that every picture included in the text will help to increase your readership, though possibly not by as proportionally a large amount.
In any case, while reading Melanie Mitchell’s text Complexity: A Guided Tour [Cambridge University Press, 2009] this weekend, I noticed that, in what appears to be a concerted effort to include an equation without technically writing it into the text and to simultaneously increase readership by including a picture, she cleverly used a picture of Boltzmann’s tombstone in Vienna! Most fans of thermodynamics will immediately recognize Boltzmann’s equation for entropy, , which appears engraved on the tombstone over his bust.
I hope that future mathematicians, scientists, and engineers will keep this in mind and have their tombstones engraved with key formulae to assist future authors in doing the same – hopefully this will help to increase the amount of mathematics that is deemed “acceptable” by the general public.