Beauty, Melody, and Entropy are an Equivalence Class

Suppose that we were asked to arrange the following in two categories-- distance, mass, electric force, entropy, beauty, melody. I think there are the strongest grounds for placing entropy alongside beauty and melody and not with the first three. Sir Arthur Stanley Eddington, OM, FRS (1882-1944), a British astronomer, physicist, and mathematician in The Nature of…

Entropy Is Universal Rule of Language | Wired Science

Read Entropy Is Universal Rule of Language by Lisa Grossman (Wired)
The amount of information carried in the arrangement of words is the same across all languages, even languages that aren't related to each other. This consistency could hint at a single common ancestral language, or universal features of how human brains process speech. "It doesn't matter what language or style you take," said systems biologist…
The research this article is based on is quite interesting for those doing language research.

Reply to The Man Who Tried to Redeem the World with Logic | Nautilus

Replied to The Man Who Tried to Redeem the World with Logic by Amanda GefterAmanda Gefter (Nautilus)
McCulloch and Pitts were destined to live, work, and die together. Along the way, they would create the first mechanistic theory of the mind, the first computational approach to neuroscience, the logical design of modern computers, and the pillars of artificial intelligence.
Quick note of a factual and temporal error: the article indicates: After all, it had been Wiener who discovered a precise mathematical definition of information: The higher the probability, the higher the entropy and the lower the information content. In fact, it was Claude E. Shannon, one of Wiener's colleagues, who wrote the influential A…

👓 The Man Who Tried to Redeem the World with Logic | Issue 21: Information – Nautilus

Read The Man Who Tried to Redeem the World with Logic (Nautilus)
Walter Pitts was used to being bullied. He’d been born into a tough family in Prohibition-era Detroit, where his father, a boiler-maker,…
Highlights, Quotes, Annotations, & Marginalia McCulloch was a confident, gray-eyed, wild-bearded, chain-smoking philosopher-poet who lived on whiskey and ice cream and never went to bed before 4 a.m.  ❧ Now that is a business card title! March 03, 2019 at 06:01PM McCulloch and Pitts were destined to live, work, and die together. Along the way, they…

🎧 Episode 085 How Networks Learn An Interview with Cesar Hidalgo | Human Current

Listened to Episode 085 How Networks Learn An Interview with Cesar Hidalgo by Haley Campbell-GrossHaley Campbell-Gross from HumanCurrent

In this episode, Haley talks with physicist, complexity scientist, and MIT professor, Cesar Hidalgo. Hidalgo discusses his interest in the physics of networks and complex system science and shares why he believes these fields are so important. He talks about his book, Why Information Grows: The Evolution of Order, from Atoms to Economies, which takes a scientific look at global economic complexity. Hidalgo also shares how economic development is linked to making networks more knowledgeable.

Cesar Hidalgo

Quotes from this episode:

“Thinking about complexity is important because people have a tendency to jump into micro explanations for macro phenomenon.” — Cesar Hidalgo

“I think complex systems give you not only some practical tools to think about the world, but also some sort of humbleness because you have to understand that your knowledge and understanding of how the systems work is always very limited and that humbleness gives you a different attitude and perspective and gives you some peace.” — Cesar Hidalgo

“The way that we think about entropy in physics and information theory come from different traditions and sometimes that causes a little bit of confusion, but at the end of the day it’s the number of different ways in which you can arrange something.” — Cesar Hidalgo

“To learn more complex activities you need more social reinforcement.” — Cesar Hidalgo

“When we lead groups we have to be clear about the goals and the main goal to keep in mind is that of learning.” — Cesar Hidalgo

“Everybody fails, but not everyone learns from their failures.” — Cesar Hidalgo

“Learning is not just something that is interesting to study, it is actually a goal.” — Cesar Hidalgo

A solid interview here with Cesar Hidalgo. His book has been incredibly influential on my thoughts for the past two years, so I obviously highly recommend it. He's got a great description of entropy here. I was most surprised by his conversation about loneliness, but I have a gut feeling that's he's really caught onto…

👓 Tenured Faculty Position at Princeton University | IEEE Information Theory Society

Read Tenured Faculty Position at Princeton University (itsoc.org)
The Department of Electrical Engineering at Princeton University seeks outstanding applicants for a tenured appointment at the Associate or Full Professor level, effective as early as September 1, 2019. The search is open to candidates specializing in areas related to information sciences and systems, with strength in core fundamentals and an interest in applications areas such as networks, machine learning, energy systems, cyber-physical systems, robotics and control, wireless communications, biology, etc. The successful candidate should have a Ph.D. in Electrical Engineering or a related field, demonstrated excellence in academic research, and a proven track record of teaching and advising undergraduate and graduate students (if currently holding an academic appointment). We seek faculty members who will create a climate that embraces excellence and diversity, with a strong commitment to teaching and mentoring that will enhance the work of the department and attract and retain a diverse student body. Candidates must complete an online faculty application at: https://www.princeton.edu/acad-positions/position/4801; a detailed curriculum vitae, descriptions of teaching and research interests, reprints of selected publications, and the names and addresses of three references should be uploaded as .pdf documents via the on-line application. This position is subject to Princeton University's background check policy. To ensure full consideration, applications should be received by November 15, 2018, but the search will remain open until the position is filled.
Wow! Verdu hasn't even started experiencing entropy yet...

📺 A Universal Theory of Life: Math, Art & Information by Sara Walker

Watched A Universal Theory of Life: Math, Art & Information from TEDxASU
Dr. Walker introduces the concept of information, then proposes that information may be a necessity for biological complexity in this thought-provoking talk on the origins of life. Sara is a theoretical physicist and astrobiologist, researching the origins and nature of life. She is particularly interested in addressing the question of whether or not “other laws of physics” might govern life, as first posed by Erwin Schrodinger in his famous book What is life?. She is currently an Assistant Professor in the School of Earth and Space Exploration and Beyond Center for Fundamental Concepts in Science at Arizona State University. She is also Fellow of the ASU -Santa Fe Institute Center for Biosocial Complex Systems, Founder of the astrobiology-themed social website SAGANet.org, and is a member of the Board of Directors of Blue Marble Space. She is active in public engagement in science, with recent appearances on “Through the Wormhole” and NPR’s Science Friday.
https://www.youtube.com/watch?v=kXnt79JhrbY Admittedly, she only had a few short minutes, but it would have been nice if she'd started out with a precise definition of information. I suspect the majority of her audience didn't know the definition with which she's working and it would have helped focus the talk. Her description of Speigelman's Monster was relatively…

🔖 Irreversibility and Heat Generation in the Computing Process by R. Landauer

Bookmarked Irreversibility and Heat Generation in the Computing Process (ieeexplore.ieee.org)
It is argued that computing machines inevitably involve devices which perform logical functions that do not have a single-valued inverse. This logical irreversibility is associated with physical irreversibility and requires a minimal heat generation, per machine cycle, typically of the order of kT for each irreversible function. This dissipation serves the purpose of standardizing signals and making them independent of their exact logical history. Two simple, but representative, models of bistable devices are subjected to a more detailed analysis of switching kinetics to yield the relationship between speed and energy dissipation, and to estimate the effects of errors induced by thermal fluctuations.
A classical paper in the history of entropy.

Book Review: Son of Fletch by Gregory Mcdonald

Read Son of Fletch by Gregory Mcdonald (Vintage Crime/Black Lizard)
Plot It was a dark and stormy night... In eleven novels in the series, one of them was bound to start off like this, in a sense. Like most in the Fletch series, the story is off like a shot from the beginning, but then just a tad into the first act there's another huge…

🔖 H-theorem in quantum physics by G. B. Lesovik, et al.

Bookmarked H-theorem in quantum physics (Nature.com)
Abstract Remarkable progress of quantum information theory (QIT) allowed to formulate mathematical theorems for conditions that data-transmitting or data-processing occurs with a non-negative entropy gain. However, relation of these results formulated in terms of entropy gain in quantum channels to temporal evolution of real physical systems is not thoroughly understood. Here we build on the…

🔖 Advanced Data Analysis from an Elementary Point of View by Cosma Rohilla Shalizi

Bookmarked Advanced Data Analysis from an Elementary Point of View by Cosma Rohilla Shalizi (stat.cmu.edu)
Advanced Data Analysis from an Elementary Point of View by Cosma Rohilla Shalizi This is a draft textbook on data analysis methods, intended for a one-semester course for advance undergraduate students who have already taken classes in probability, mathematical statistics, and linear regression. It began as the lecture notes for 36-402 at Carnegie Mellon University.…

Weekly Recap: Interesting Articles 7/24-7/31 2016

Some of the interesting things I saw and read this week

A New Thermodynamics Theory of the Origin of Life | Quanta Magazine

Bookmarked A New Physics Theory of Life by Natalie Wolchover (quantamagazine.org)
Jeremy England, a 31-year-old physicist at MIT, thinks he has found the underlying physics driving the origin and evolution of life.
References: Jeremy L. England Lab Talks Statistical physics of self-replication, Jeremy L. England; J. Chem. Phys. 139, 121923 (2013); doi: 10.1063/1.4818538 Statistical Physics of Adaptation, Nikolai Perunov, Robert Marsland, and Jeremy England, arXiv, December 8, 2014 Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences, Gavin E. Crooks, arXiv, February 1,…

Introduction to Information Theory | SFI’s Complexity Explorer

The Santa Fe Institute's free online course "Introduction to Information Theory" taught by Seth Lloyd via Complexity Explorer.