I'm a biomedical and electrical engineer with interests in information theory, complexity, evolution, genetics, signal processing, IndieWeb, theoretical mathematics, and big history.
I'm also a talent manager-producer-publisher in the entertainment industry with expertise in representation, distribution, finance, production, content delivery, and new media.
Artificial Life aims to understand the basic and generic principles of life, and demonstrate this understanding by producing life-like systems based on those principles. In recent years, with the advent of the information age, and the widespread acceptance of information technology, our view of life has changed. Ideas such as “life is information processing” or “information holds the key to understanding life” have become more common. But what can information, or more formally Information Theory, offer to Artificial Life?
One relevant area is the motivation of behaviour for artificial agents, both virtual and real. Instead of learning to perform a specific task, informational measures can be used to define concepts such as boredom, empowerment or the ability to predict one’s own future. Intrinsic motivations derived from these concepts allow us to generate behaviour, ideally from an embodied and enactive perspective, which are based on basic but generic principles. The key questions here are: “What are the important intrinsic motivations a living agent has, and what behaviour can be produced by them?”
Related to an agent’s behaviour is also the question on how and where the necessary computation to realise this behaviour is performed. Can information be used to quantify the morphological computation of an embodied agent and to what degree are the computational limitations of an agent influencing its behaviour?
Another area of interest is the guidance of artificial evolution or adaptation. Assuming it is true that an agent wants to optimise its information processing, possibly obtain as much relevant information as possible for the cheapest computational cost, then what behaviour would naturally follow from that? Can the development of social interaction or collective phenomena be motivated by an informational gradient? Furthermore, evolution itself can be seen as a process in which an agent population obtains information from the environment, which begs the question of how this can be quantified, and how systems would adapt to maximise this information?
The common theme in those different scenarios is the identification and quantification of driving forces behind evolution, learning, behaviour and other crucial processes of life, in the hope that the implementation or optimisation of these measurements will allow us to construct life-like systems.
According to their release, the open access journal Entropywill sponsor the workshop by an open call with a special issue on the topic of the workshop. More details will be announced to emails received via itialife@gmail.com and over the alife and connectionists mailing lists.
To put it saucily: information theory is something like the logarithm of probability theory. In early modern times the logarithm simplified multiplication into addition which was more accessible to calculation. Today, information theory transforms many quantities of probability theory into quantities which allow simpler bookkeeping.
More seriously, information theory is one of the most universal concepts with applications in computer science, mathematics, physics, biology, chemistry and other fields. It allows a lucid and transparent analysis of many systems and provides a framework to study and compare seemingly different systems using the same language and notions.
Dr. Daniel Polani, reader in Artificial Life, University of Hertfordshire
in “Research Questions”
Not only a great quote, but an interesting way to view the subjects.
Pros: Delightful To Use, Roomy , Excellent Design and Engineering, Napoleon Pocket, Lightweight , Great Strap Length, High Quality, Attractive, Great Craftsmanship, Comfortable , Durable
Best Uses: Commuting, School, Office, Day Trips, Computer Laptop, Airplane travel
I spent quite a while (months/years) looking at almost every messenger bag in existence (and even contemplated designing my own) for my mobile office and for weekly trips to study abstract mathematics at UCLA. I’ve been through dozens of bags (including one that could only charitably have been called a “murse”) and had problems with all of them – particularly shoulder and neck problems from carrying around so much weight. The Timbuk2 Command messenger bag ($139, medium, black) seems to have remedied all of that. My neck and shoulder pains have gone away because this bag is simply so comfortable it feels like I’m carrying half the load that I used to.
The two length adjustment mechanisms on the shoulder strap of this bag should be a requirement for every bag on the planet. I simply don’t know how I managed without them for all this time and now I can never go back. One makes it dead simple to take the bag on and off and the other allows for additional easy length change – the combination makes the bag wear incredibly comfortably.
As an engineer I can readily appreciate some of the very subtle design and manufacturing elements that truly make this bag a wonder. It’s not only functional and sturdy, but it’s both beautiful inside and out. Timbuk2 has certainly put some serious thought into how to make a bag. In particular the velcro strips at the top of the the flap to keep water out, the Napoleon pocket (so one doesn’t have to completely open the bag to retrieve frequently used items), the plastic strips sewn into the lining to provide additional internal structural support, and an ingenious custom pocket at the bottom of the bag for my cables and computer power brick are simply genius.
My only minor caveats about the bag are:
Although there are quite a number of great and useful pockets, I could do with maybe half a dozen more for daily use to keep either small items (I carry my desk in my bag) or organizing additional papers from floating around inside the bag. One can’t really fault Timbuk2 for this as it’s personal preference on my part and I haven’t seen any other bags on the market with a better designed grouping of pocket spaces for such things.
Having a slightly larger water bottle carrier on the outside of the bag would also be excellent, but it’s nearly perfect for my Zojirushi stainless steel thermos and most small (<16 ounce) plastic water bottles. I’ll mention that one of Timbuk2’s line of Classic messenger bags includes internal water bottle pockets for those that desire something like this — or who need full waterproof interiors. The Command bag is roomy enough that I’ve also contemplated using a Camelback-type of fluid reservoir and drinking tube inside for longer day-trips.
As a comparison, the next closest high quality bag I’ve seen in my research is Tumi’s Alpha Bravo Benning Deluxe Messenger Bag ($275). It rates incredibly high for design and beauty, but slightly lower on the functionality scale (which still makes it one of the top 0.1% of bags on the market in my mind, so if you’ve got the money, it’s definitely worth it). It’s almost twice the price and though it’s got equivalent design touches and is made from some equivalently excellent materials with fantastic craftsmanship, it is missing some of the more interesting engineering touches including the engineering work on the shoulder strap.
Designer/Artist William Morris once said, “Have nothing in your house that you do not know to be useful, or believe to be beautiful.” My Zojirushi stainless steel mug is one of the few things I’ve ever owned that I feel truly meets both of these criteria.
The design, materials, manufacturing and workmanship of the mug are nothing short of outstanding; the aesthetics and heft in the hand are truly fantastic. I really could not want for more out of such a product. I love looking at it, I love holding it, and I love using it.
I hope one day to come back and write a review worthy of how truly great this travel mug is, but for now, suffice it to say that I’m in love. I spent a LOT of time reading reviews on Amazon and elsewhere, and searching stores and vendors to find the best thermos/mug on the planet and settled on this one. Not only is it easy and intuitive to take completely apart and wash thoroughly (too many I’ve come across are impossible to take apart and clean properly, if at all), but it seals completely and doesn’t spill.
Even better it keeps my beverages piping hot or cold for far longer than I wish it would. There have been days that I’ve filled it with hot coffee or tea and come back several times to drink it hoping that it had cooled a bit only to find it still too hot to consume. After several rounds with this over an eight hour span, I finally opened it up and put in some ice so I could finally drink my coffee. Now I often just leave the cap open (or off) to let it cool a bit more quickly, although even this is a fairly slow process. Now I try to put my beverages in at the temperature I want to drink them knowing that that’s generally the temperature they’ll be when I get around to drinking them.
I love the fact that the cap is designed with a two stage opening mechanism (which probably won’t be noticed by most users because it’s so subtle). One pushes the button and the top opens just a few millimeters. Then letting go of the button allows the top to spring back and click neatly into place so that it doesn’t fall forward and bonk one on the nose when attempting to take a drink.
When I first came across it, I will admit I was a bit reticent at it’s relatively high price (particularly in comparison with cheaper mugs on the market, many of which I’ve tried and been highly disappointed with), but the Zojirushi is certainly worth ever penny; I would not hesitate for a moment to buy more of these.
As a small aside, I will mention that due to physics and the design of the mug that it can occasionally leak a bit when filled with carbonated beverages and then shaken. Doing this creates additional interior pressure that pushes up the internal seal mechanism on the cap that allows a small amount of liquid to escape. Beyond this small category of fluids, which I infrequently use with the mug (and I’m sure others probably won’t either), it has been absolutely airtight and worry-free.
This series of 12 audio lectures is an excellent little overview of Augustine, his life, times, and philosophy. Most of the series focuses on his writings and philosophy as well as their evolution over time, often with discussion of the historical context in which they were created as well as some useful comparing/contrasting to extant philosophies of the day (and particularly Platonism.)
Early in the series there were some interesting and important re-definitions of some contemporary words. Cary pushes them back to an earlier time with slightly different meanings compared to their modern ones which certainly helps to frame the overarching philosophy presented. Without a close study of this vocabulary, many modern readers will become lost or certainly misdirected when reading modern translations. As examples, words like perverse, righteousness, and justice (or more specifically their Latin counterparts) have subtly different meanings in the late Roman empire than they do today, even in modern day religious settings.
My favorite part, however, has to have been the examples discussing mathematics as an extended metaphor for God and divinity to help to clarify some of Augustine’s thought. These were not only very useful, but very entertaining to me.
As an aside for those interested in mnemotechnic tradition, I’ll also mention that I’ve (re)discovered (see the reference to the Tell paper below) an excellent reference to the modern day “memory palace” (referenced most recently in the book Moonwalking with Einstein: The Art and Science of Remembering Everything) squirreled away in Book X of Confessions where Augustine discusses memory as:
“fields and spacious palaces” “…where are the treasures of innumerable images, brought into it from things of all sorts perceived by the senses. There is stored up, whatsoever besides we think, either by enlarging or diminishing, or any other way varying those things which the sense hath come to; and whatever else hath been committed and laid up, which forgetfulness hath not yet swallowed up and buried.”
Those interested in memes and the history of “memoria ex locis” (of which I don’t even find a reference explicitly written in the original Rhetorica ad Herrenium) would appreciate an additional reference I subsequently found in the opening (and somewhat poetic) paragraph of a paper written by David Tell on JSTOR. The earliest specific reference to a “memory palace” I’m aware of is Matteo Ricci’s in the 16th century, but certainly other references to the construct may have come earlier. Given that Ricci was a Jesuit priest, it’s nearly certain that he would have been familiar with Augustine’s writings at the time, and it’s possible that his modification of Augustine’s mention brought the concept into its current use. Many will know memory as one of the major underpinnings of rhetoric (of which Augustine was a diligent student) as part of the original trivium.
Some may shy away from Augustine because of the religious overtones which go along with his work, but though there were occasional “preachy sounding” sections in the material, they were present only to clarify the philosophy.
I’d certainly recommend this series of lectures to anyone not closely familiar with Augustine’s work as it has had a profound and continuing affect on Western philosophy, thought, and politics.
I ran across this at random and picked it up on a whim as I often do with books about concocting drinks–particularly having recently picked up a SodaStream machine for fashioning my own seltzer and sodas at the beginning of the new year. Certainly with some lovely photographs it does a reasonable job of harkening back to an older time. There are a handful of small asides and historical facts – though not nearly enough in my mind and it could have included some photos of early and mid-century soda fountains for all its talk about them. The real star of the book has to be the litany of recipes of which I’ll begin trying a few (and hopefully posting up reviews of those over time.)
I’d put this book in a similar league with my all-time favorite Charles Schumann‘s American Bar: The Artistry of Mixing Drinks which is dense with some great information and recipes for the bartender. This book isn’t quite as “hard core” as Schumann’s, but seems to come pretty close to his rigor for the art of mixology. I read an e-book version, which was generally passable, but I would likely have given it 4 stars had I read what I’m sure is a richer experience in print.
A few weeks ago I had communicated a bit with paleoanthropologist John Hawks. I wanted to take a moment to highlight the fact that he maintains an excellent blog primarily concerning his areas of research which include anthropology, genetics and evolution. Even more specifically, he is one of the few people in these areas with at least a passing interest in the topic of information theory as it relates to his work. I recommend everyone take a look at his information theory specific posts.
I’ve previously written a brief review of John Hawks’ (in collaboration with Anthony Martin) “Major Transitions in Evolution” course from The Learning Company as part of their Great Courses series of lectures. Given my interest in the MOOC revolution in higher education, I’ll also mention that Dr. Hawks has recently begun a free Coursera class entitled “Human Evolution: Past and Future“. I’m sure his current course focuses more on the area of human evolution compared with the prior course which only dedicated a short segment on this time period. Given Hawks’ excellent prior teaching work, I’m sure this will be of general interest to readers interested in information theory as it relates to evolution, biology, and big history.
I’d love to hear from others in the area of anthropology who are interested in information theoretical applications.
I have known more people whose lives have been ruined by getting a Ph.D. in physics than by drugs.
Jonathan I. Katz, Professor of Physics, Washington University, St. Louis, Mo.
in “Don’t Become a Scientist!”
In the essay, Dr. Katz provides a bevy of solid reasons why one shouldn’t become a researcher. I highly recommend everyone read it and then carefully consider how we can turn these problems around.
From the publisher’s website, they provide the following synopsis:
This book discusses information theory as a means of extracting data from large amounts of biological sequences. Utilizing the Shannon theory, the book explains using the information theory principles to interpret sequences and extract vital information. It provides a detailed overview of the practical applications in bioinformatics and includes coverage of diversity in nucleotide and amino acid sequences, sing-nucleotide polymorphism (SNP) and indel sites, binding sites in promoter regions, splicing sites, and more.
If I can manage to get an early copy, I’ll provide a review shortly.
Over the holiday I ran across a press release, which follows with web links added, for a new book on systems theory. It promises to be an excellent read on the development and philosophy of systems theory for those interested in cybernetics, information theory, complexity and related topics.
MIAMI, Fla., Dec. 19, 2013 Dr. Darrell Arnold, Assistant Professor of Philosophy and Director of the Institute for World Languages and Cultures at St. Thomas University, has published an edited volume with Routledge entitled Traditions of Systems Theory: Major Figures and Contemporary Developments. Hans-Georg Moeller, of University College Cork, Ireland, notes that the book “provides a state-of-the-art survey of the increasingly influential and fascinating field of systems theory. It is a highly useful resource for a wide range of disciplines and contributes significantly to bringing together current trends in the sciences and the humanities.” The book includes 17 articles from leading theoreticians in the field, including pieces by Ranulph Glanville, the President of the American Society for Cybernetics, as well as Debora Hammond, the former President of the International Society for Systems Sciences. It is the first comprehensive edited volume in English on the major and countervailing developments within systems theory.
Dr. Arnold writes on 19th century German philosophy, contemporary social theory, as well as technology and globalization, with a focus on how these areas relate to the environmental problematic. He has translated numerous books from German, including C. Mantzavinos’s Naturalistic Hermeneutics (Cambridge UP) and Matthias Vogel’s Media of Reason (Columbia UP). Dr. Arnold is also editor-in-chief of the Humanities and Technology Review.
For additional information on St. Thomas University academic programs and faculty publications, please contact Marivi Prado, Chief Marketing Officer, 305.474.6880; mprado@stu.edu
Dr. Darrell P. Arnold
I’ve ordered my copy and will be providing a review shortly.
A good many times I have been present at gatherings of people who, by the standards of the traditional culture, are thought highly educated and who have with considerable gusto been expressing their incredulity of scientists. Once or twice I have been provoked and have asked the company how many of them could describe the Second Law of Thermodynamics. The response was cold: it was also negative. Yet I was asking something which is the scientific equivalent of: Have you read a work of Shakespeare’s?
I now believe that if I had asked an even simpler question — such as, What do you mean by mass, or acceleration, which is the scientific equivalent of saying, Can you read? — not more than one in ten of the highly educated would have felt that I was speaking the same language. So the great edifice of modern physics goes up, and the majority of the cleverest people in the western world have about as much insight into it as their neolithic ancestors would have had.
This year is the progenitor of what appears to be the biggest renaissance for the application of information theory to the area of biology since Hubert Yockey, Henry Quastler, and Robert L. Platzman’s “Symposium on Information Theory in Biology at Gatlinburg, Tennessee” in 1956. (I might argue it’s possibly even bigger than Claude Shannon’s Ph.D. thesis.) It certainly portends to create a movement that will rapidly build upon and far surpass Norbert Weiner’s concept of Cybernetics and Ludwig von Bertalanffy’s concept of General Systems Theory.
The BIRS workshop will be a bit more general in its approach while the NIMBioS workshop has a slightly tighter view specifically on maximum entropy as applied to biology.
Even more telling (and perhaps most promising) about the two workshops is the very heavy mathematical bent both intend to make their focus. I have a theory that the bounds of science are held below the high water level of mathematics (aka are “bounded by” in mathematics-speak), so there is nothing more exciting than to see groups attempting to push the mathematics and its application further. It was both the lack of mathematical rigor and the general youth of biology (and specifically genetics and microbiology) in the 1950’s which heavily hampered the early growth of cybernetics as a movement. Fortunately this is no longer the case on either count. Now we just need more researchers who are more readily conversant in the two realms simultaneously.
I remember using volume III in Dr. James Martino‘s class many moons ago and enjoying its style. I do however have to credit all my facility in the subject to Dr. Richard Joseph who taught it to me by means of the steepest gradient possible – that of electromagnetic theory.
Augustine: Philosopher and Saint byProfessor Phillip Cary, Ph.D., Eastern University (The Learning Company, 1997)
Make Your Own Soda: Syrup Recipes for All-Natural Pop, Floats, Cocktails, and More by Anton Nocito
