David Christian, a trained historian, is one of the leading proponents of the relatively new concept of Big History, which I view as a sea-change in the way humans will begin to view not only the world but our place in it and what we might expect to come in the future. His work presents a truly monumental and profound thesis and a drastically new framework for where humankind fits into the universe. Of the broad variety of works I’ve read in the past several decades, it is simply one of the most interesting and cohesive theses I’ve come across, and I highly and unreservedly recommend it to everyone I know. I’d put it on par or above works like Jared Diamond’s Guns, Germs, and Steel and Matt Ridley’s The Rational Optimist among others for its broad impact on how I now view the world. For scientists and researchers it has the potential to be the philosophical equivalent of The Bible and in fact, like many religious texts, it is in effect a modern day “creation myth,” albeit one with a scientific underpinning.
Christian’s work was initially brought to my attention by an article in the Chronicle of Higher Education by Jeffrey R. Young in which he mentioned that Bill Gates was a big fan of Christian’s work and had recommended it himself at a TED conference. (Gates is now also a financial supporter of Christian’s Big History Project.) I myself was aware of the Learning Company’s generally excellent coursework offerings and within a few weeks got an audio copy of the course of forty-eight lectures to listen to on my daily commute.
I’ve now devoured both his rather large text on the subject as well as a lecture series he created for a course on the subject. Below are brief reviews of the two works.The magnum written opus Maps of Time: An Introduction to Big History is an interesting change of reference from a historical perspective combining the disciplines of physics, cosmology, astronomy, geology, chemistry, microbiology, evolutionary theory, archaeology, politics, religion, economics, sociology, and history into one big area of contiguous study based upon much larger timescales than those traditionally taken in the study of historical time periods. Though it takes pieces from many disciplines, it provides for an interesting, fresh, and much needed perspective on who humans are and their place in not only the world, but the entire universe.
By looking at history from a much broader viewpoint (billions of years versus the more common decades or even just a few centuries) one comes away with a drastically different perspective on the universe and life.
I’d highly recommend this to any general reader as early as they can find time to read through it, particularly because it provides such an excellent base for a variety of disciplines thereby better framing their future studies. I wish I had been able to read this book in the ninth or tenth grade or certainly at the latest by my freshman year in college – alas the general conception of the topic itself didn’t exist until after I had graduated from university.
Although I have significant backgrounds in most, if not all, of the disciplines which comprise the tapestry of big history, the background included in the book is more than adequate to give the general reader the requisite introductions to these subjects to make big history a coherent subject on its own.
This could be an extremely fundamental and life-changing book for common summer reading programs of incoming college freshman. If I could, I would make it required reading for all students at the high school level. Fortunately Bill Gates and others are helping to fund David Christian’s work to help introduce it more broadly at the high school and other educational levels.
Within David Christian’s opus, there is also a collection of audio lectures produced by The Learning Company as part of their Great Courses series which I listened to as well. The collection of forty-eight lectures is entitled Big History: The Big Bang, Life on Earth, and the Rise of Humanity (Great Courses, Course No. 8050). It provides a much quicker philosophical overview of the subject and doesn’t delve as deeply into the individual disciplines as the text does, but still provides a very cohesive presentation of the overall thesis. In fact, for me, the introduction to the topic was much better in these audio lectures than it was in the written book. Christian’s lecture style is fantastic and even better than his already excellent writing style.
Because of the scale on which we look at the past, you should not expect to find in it many of the familiar details, names, and personalities that you’ll find in other types of historical teaching and writing. For example, the French Revolution and the Renaissance will barely get a mention. They’ll zoom past in a blur. You’ll barely see them. Instead, what we’re going to see are some less familiar aspects of the past. … We’ll be looking, above all, for the very large patterns, the shape of the past.
In the audio lectures Christian highlights eight major thresholds which he uses as a framework by which to view the 13.4 billion years of history which the Universe has presently traversed. Then within those he uses the conceptualization of disparities in power/energy as the major driving forces/factors in history in a unique and enlightening way which provides a wealth of perspective on almost every topic (scientific or historical) one can consider. This allows one to see parallels and connections between seemingly disparate topics like the creations of stars and the first building of cities or how the big bang is similar to the invention of agriculture.
I can easily say that David Christian’s works on big history are some of the most influential works I’ve ever come across – and having experienced them, I can never see our universe in the same naive way again.
For those interested in taking a short and immediate look at Christian’s work, I can recommend his Ted Talk “The History of Our World in 18 Minutes” which only begins to scratch the surface of his much deeper and profound thesis: [ted id=1118]
Given how profound the topic of big history is, I’m sure I’ll be writing about and referring to it often. Posts in relation to it can be found here with the tag: “big history“.
Added material below on 21-October-2016
Reading Progress
- 03/11/2011 marked as: want to read after reading Bill Gates Promotes Professor’s Online Course at TED by Jeffrey R. Young in The Chronicle of Higher Education
- 08/26/11 started reading
- 08/27/11
- 03/01/12 “Reread some of the beginning this morning as I get back into David Christian’s audio lectures.”
- 04/28/12
- 04/30/12
- 05/03/12
- 05/05/12
- 05/23/12
- 06/02/12
- 06/14/12
- 06/17/12 ; “Technically finished reading, but need to still go through the endnotes.”
- 10/21/12
Added material below on 23-October-2016
Highlights, Quotes, & Marginalia
Preface to the 2011 Edition
In Big History and the Future of Humanity, Fred Spier has built on an earlier work of his and on the work of Eric Chaisson to produce what is currently by far the most sophisticated attempt to construct a thematic scaffolding for big history. He carefully links the idea of increasing complexity with the associated themes of energy flows and the idea of goldilocks conditions—the notion that complexity can increase only under very special conditions and within quite exacting “boundary conditions.” Here are broad theoretical ideas that can help give greater depth and coherence to the story told within big history.
Highlight (yellow) – Location 443
big history promises to open up exciting new research agendas (including the meaning of complexity and energy flows, and the role of information across many disciplines),
Highlight (yellow) – Location 483
Introduction: A Modern Creation Myth?
sociologist Émile Durkheim referred to as “anomie”: the sense of not fitting in,
Highlight (yellow) – Location 550
Russian matryoshka doll
Highlight (orange) – Location 651
Accounts of the past that focus primarily on the divisions between nations, religions, and cultures are beginning to look parochial and anachronistic—even dangerous.
Highlight (yellow) – Location 702
capacious
Highlight (orange) – Location 753
Chaisson, Eric J. Cosmic Evolution: The Rise of Complexity in Nature. Cambridge, Mass.: Harvard University Press, 2001.
Highlight (green) – Location 795
Margulis, Lynn, and Dorion Sagan. Microcosmos: Four Billion Years of Microbial Evolution. London: Allen and Unwin, 1987.
Highlight (green) – Location 844
Maynard Smith, John, and Eörs Szathmáry. The Origins of Life: From the Birth of Life to the Origins of
Highlight (green) – Location 847
Spier, Fred. The Structure of Big History: From the Big Bang until Today. Amsterdam: Amsterdam University Press, 1996.
Highlight (green) – Location 878
Part I: The Inanimate Universe
Rig-Veda
Highlight (green) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 907
This is very much how modern nuclear physics views the idea of a vacuum: it is empty but can nevertheless have shape and structure, and (as has been proved in experiments with particle accelerators) “things” and “energies” can pop out of the emptiness.
Highlight (yellow) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 923
Popol Vuh, or “Council Book,” a sixteenth-century Mayan manuscript,
Highlight (green) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 927
Dr. Lightfoot from Cambridge “proved” that God had created humans at exactly 9:00 AM on 23 October 4004 BCE.13
Highlight (yellow) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 992
The particles that did find a partner were transformed into pure energy,
Highlight (yellow) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 1088
Perhaps this is where dark matter and energy are hiding?
As an anonymous wit is supposed to have put it: “Hydrogen is a light, odorless gas which, given enough time, changes into people.”25
Highlight (yellow) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 1131
The idea that form and matter are different expressions of the same underlying essence was proposed by the Italian Giordano Bruno as early as 1584, in a book called Concerning the Cause, Principle, and One.
Highlight (yellow) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 1134
Eric Chaisson’s Cosmic Evolution (2001) is an attempt to think through the meaning of order and entropy at many different scales, from stars to microbes,
Highlight (green) – 1. The First 300,000 Years: Origins of the Universe, Time, and Space > Location 1394
The second law of thermodynamics ensures that all complex entities will eventually die; but the simpler the structure, the better its survival chances, which is why stars live so much longer than humans
Highlight (yellow) – 2. Origins of the Galaxies and Stars: The Beginnings of Complexity > Location 1521
Even in the densest part of the galaxy, the disk, regions of empty space normally contain only about one atom in each cubic centimeter. But in the earth’s atmosphere, there may be 25 billion billion molecules in the same space.15 And pouring though this matter is the energy emitted every second by the Sun. In other words, human history has taken place in a pocket of the universe that is dense in matter and packed with energy. It is the extraordinary richness and complexity of this environment that made life possible.
Highlight (yellow) – 2. Origins of the Galaxies and Stars: The Beginnings of Complexity > Location 1755
A Danish scientist, Nicholas Steno, first argued that fossils were the remains of organisms that had once lived on earth.
Highlight (yellow) – 3. Origins and History of the Earth > Location 1991
Charles Lyell first stated clearly what came to be known as the principle of uniformitarianism.
Highlight (yellow) – 3. Origins and History of the Earth > Location 1999
As the English philosopher Francis Bacon pointed out in 1620, it was easy to see from these maps that the continents looked like pieces of a jigsaw puzzle. This similarity was most striking when the west coast of Africa was matched up with the east coast of South America.
Highlight (yellow) – 3. Origins and History of the Earth > Location 2016
The idea that the continents really had drifted apart was given a thorough scientific basis in a book called The Origin of Continents and Oceans, written in 1915 by a German geographer, Alfred Wegener.
Highlight (yellow) – 3. Origins and History of the Earth > Location 2020
Gondwana sequence
Highlight (green) – 3. Origins and History of the Earth > Location 2024
uppermost layer of the earth (the lithosphere) consists of a number of rigid plates, like a cracked eggshell. There are eight large plates and seven smaller ones, as well as smaller slivers of material.
Highlight (yellow) – 3. Origins and History of the Earth > Location 2071
asthenosphere
Highlight (green) – 3. Origins and History of the Earth > Location 2072
Pangaea
Highlight (green) – 3. Origins and History of the Earth > Location 2109
Panthalass
Highlight (green) – 3. Origins and History of the Earth > Location 2109
Laurasia
Highlight (green) – 3. Origins and History of the Earth > Location 2110
Gondwanaland
Highlight (green) – 3. Origins and History of the Earth > Location 2110
Rodinia
Highlight (green) – 3. Origins and History of the Earth > Location 2113
Part II: Life On Earth
“The unfolding of events in the life cycle of an organism exhibits an admirable regularity and orderliness, unrivalled by anything we meet with in inanimate matter.”
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2158
In Schrödinger’s famous phrase, each living organism seems to have an astonishing capacity for “continually sucking orderliness from its environment.”
Highlight (blue) – 4. The Origins of Life and the Theory of Evolution > Location 2166
Unlike stars or crystals, which are general, all-purpose antientropy machines, …
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2180
Think of homoestasis vs longevity
Darwin rarely used the term evolution, perhaps because it seems to imply some sort of mystical force that drives biological change in particular directions and thus would contradict his own view of biological change as a more open-ended process.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2240
Herbert Spencer, who did the most to popularize the term,
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2242
carunculated
Highlight (orange) – 4. The Origins of Life and the Theory of Evolution > Location 2297
Erasmus Darwin, suggested that species evolved so as to adapt better to their environments.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2315
In a book first published in 1809, the French naturalist Jean-Baptiste Lamarck suggested a possible mechanism. Perhaps minor changes acquired during a creature’s lifetime could somehow be passed on to its descendants.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2317
Time we spend in the gym does not guarantee that our children will be fit.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2323
Though epigenitics may be at work; see the studies of weight of self vs peers from c. 2010
Evolution works in fits and starts, according to the modern theory of “punctuated evolution,’ which was proposed by Niles Eldridge and Stephen Jay Gould in 1972.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2481
1920s by Alexander Oparin and J. B. S. Haldane, uses the basic ideas of evolutionary theory to explain not just the evolution of life on earth but also its initial appearance.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2512
But precisely how chemical evolution generated the first living organisms remains unclear. To understand these difficulties, we must break the problem into several levels. First, we need to explain how the basic raw materials of life were created: the chemical level. Second, we need to explain how these simple organic materials were assembled into more complex structures. Finally, we need to explain the origins of the precise mechanisms of reproduction encoded in the DNA that is present in all living organisms today. At present, we have reasonably good answers to the first question; we have plausible answers to the second question; and we are still puzzled by the third question.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2519
Harold Urey and his graduate student, Stanley Miller.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2537
Fred Hoyle and Chandra Wickramasinghe have argued that Earth was seeded with life from outside. This theory is known as Panspermia.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2572
A. G. Cairns-Smith has suggested that in shallow water, tiny crystals of clay may have provided a template for the formation of more complex molecules.
Highlight (yellow) – 4. The Origins of Life and the Theory of Evolution > Location 2590
Humans do not have the 60,000 to 80,000 genes we once believed were necessary to construct us but half that number, about 30,000. Roundworms have two-thirds as many genes as us (ca. 19,000), and fruit flies just under half (ca. 13,000); even Escherichia coli, a bacterium that inhabits our gut, may have as many as 4,000 genes. So, though constructing large organisms is tougher than constructing small organisms, the difference is not as great as we once imagined.
Highlight (yellow) – 5. The Evolution of Life and the Biosphere > Location 2782
It would seem that we’re not really becoming that more complex from a relative perspective here. What is the next major jump on the hockey stick?
As Margulis and Sagan put it: “For the macrocosmic size, energy, and complex bodies we enjoy, we trade genetic flexibility.”
Highlight (blue) – 5. The Evolution of Life and the Biosphere > Location 2867
The first extensive fossil evidence of multicellular organisms dates from the Ediacaran era, ca. 590 million years ago. But the fossil record of multicellular organisms really becomes abundant during the Cambrian era, from ca. 570 million years ago.
Highlight (yellow) – 5. The Evolution of Life and the Biosphere > Location 3032
In the middle of the nineteenth century, the German biologist Ernst Haeckel suggested that all single-celled organisms be classified within a separate kingdom of Protista. Then, in the 1930s, biologists realized that there was a fundamental difference between cells with nuclei and those without. As a result, they began to divide all organisms into two distinct kingdoms, the Prokaryota (organisms whose cells had no nuclei) and the Eukaroyta (organisms whose cells had nuclei). In some systems, the Eukaryota also include all multicellular organisms. In the second half of the twentieth century, powerful arguments emerged for the creation of separate kingdoms for fungi and for viruses (which are so simplified that they cannot even reproduce without hijacking the metabolic systems of other organisms). In the 1990s, Carl Woese proposed a new large classification to distinguish between the archaea and other forms of bacteria. Like all prokaryotes, archaea do not have nuclei; but unlike other prokaryotes they take in energy neither from sunlight nor from oxygen but from other chemicals.
Highlight (yellow) – 5. The Evolution of Life and the Biosphere > Location 3057
Chixculub
Highlight (orange) – 5. The Evolution of Life and the Biosphere > Location 3188
John Maynard Smith and Eörs Szathmáry’s The Origins of Life (1999) is a history of life on Earth, constructed around the central idea of the evolution of complexity.
Highlight (green) – 5. The Evolution of Life and the Biosphere > Location 3367
Part III: Early Human History: Many Worlds
Net primary productivity (NPP) is that portion of energy from sunlight that enters the food chain through photosynthesis and is turned into plant material.
Highlight (yellow) – 6. The Evolution of Humans > Location 3418
This means that the impact of human history will be visible on scales of at least a billion years.
Highlight (yellow) – 6. The Evolution of Humans > Location 3443
new ways of extracting resources from their environments.
Highlight (yellow) – 6. The Evolution of Humans > Location 3478
We have seen that the emergence of new forms of complexity always involves the creation of large structures within which previously independent entities are locked into new forms of interdependence and new rules of cooperation.7 Following this hint, we should expect to find that the transition to human history is primarily marked not by a change in the nature of humans as individuals but rather by a change in the way individuals relate to each other.
Highlight (yellow) – 6. The Evolution of Humans > Location 3482
learning collectively
Highlight (yellow) – 6. The Evolution of Humans > Location 3512
In an article first published in 1967, two biochemists working in the United States, Vincent Sarich and Alan Wilson, argued that much genetic change is subject to similar rules.
Highlight (yellow) – 6. The Evolution of Humans > Location 3589
neoteny
Highlight (yellow) – 6. The Evolution of Humans > Location 3640
“Millennium Man”
Highlight (yellow) – 6. The Evolution of Humans > Location 3690
another possible candidate for the oldest hominine, Ardipithecus ramidus kadabba,
Highlight (yellow) – 6. The Evolution of Humans > Location 3692
gracile
Highlight (orange) – 6. The Evolution of Humans > Location 3792
It is possible that tool use evolved through a process known as Baldwinian adaptation (named after the nineteenth-century American psychologist who first described it systematically). This is a form of evolutionary change that appears to combine Darwinian and cultural elements, because behavioral changes lead to changes in an animal’s lifeways, thereby creating new selective pressures that lead, over time, to genetic changes.
Highlight (yellow) – 6. The Evolution of Humans > Location 3814
the so-called Levallois or Mousterian tools.
Highlight (yellow) – 6. The Evolution of Humans > Location 3905
neoteny
Highlight (orange) – 6. The Evolution of Humans > Location 3945
Roger Lewin’s Human Evolution (4th ed., 1999)
Highlight (green) – 6. The Evolution of Humans > Location 3985
Steven Mithen has proposed that a number of once discrete brain modules, some of which may have been present in the earliest hominines, merged quite suddenly—perhaps within the last hundred thousand years—in a sort of linguistic “big bang.”
Highlight (yellow) – 7. The Beginnings of Human History > Location 4025
The Symbolic Species, Terrence Deacon
Highlight (green) – 7. The Beginnings of Human History > Location 4033
Two factors stand out: the volume and variety of the information being pooled, and the efficiency and speed with which information is shared.
Highlight (yellow) – 7. The Beginnings of Human History > Location 4257
In a deliberately provocative essay published in 1972, the anthropologist Marshall Sahlins describes the world of the Stone Age as “the original affluent society.”
Highlight (yellow) – 7. The Beginnings of Human History > Location 4323
In his simple but influential model of social structures, Eric Wolf has suggested that “kin-ordered” societies constitute a major type of human community, one that survives in many different forms even in the modern world.26
Highlight (green) – 7. The Beginnings of Human History > Location 4364
Australian archaeologist Rhys Jones referred to such techniques as “fire stick farming.”39 Fire stick “farmers” deliberately set fire to bushland in regular cycles. In part, their aim was to prevent buildups of combustible material that could lead to hotter and more dangerous fires. But by clearing away underbrush, fire stick farming also encouraged the growth of new plants that, in turn, attracted browsers that could be hunted. Recent research suggests that such techniques may have been used as early as 45,000 years ago.40
Highlight (yellow) – 7. The Beginnings of Human History > Location 4486
Part IV: The Holocene: Few Worlds
All of recorded human history has taken place within the Holocene interglacial.
Highlight (yellow) – 8. Intensification and the Origins of Agriculture > Location 4768
allopatric
Highlight (orange) – 8. Intensification and the Origins of Agriculture > Location 4860
loess
Highlight (orange) – 8. Intensification and the Origins of Agriculture > Location 4969
The Trap of Sedentism
Highlight (yellow) – 8. Intensification and the Origins of Agriculture > Location 5240
In fact, most of human history (chronologically speaking) has taken place in communities quite innocent of state power. Even in the villages of the early agrarian era, for most people, most of the time, the important relationships were personal, local, and fairly egalitarian. Most households were self-sufficient, and people dealt with each other as people rather than as the representatives of institutions.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5442
But exploitation, like symbiosis, is never simple or unambiguous. Like predation in the nonhuman world, it can take more or less brutal forms. Lynn Margulis and Dorion Sagan observe, “In the long run, the most vicious predators, like the most dread disease-causing microbes, bring about their own ruin by killing their victims. Restrained predation—the attack that doesn’t quite kill or does kill only slowly—is a recurring theme in evolution.”
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5525
irrigation could raise agricultural productivity decisively, which is why irrigation has been one of the most revolutionary of all technological innovations.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5674
But population growth itself counts as a form of intensification, for in the era before fossil fuels, the energy resources available to human societies came mostly from human or animal muscle power.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5702
Inequality is what all top-down theories of state formation predict.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5730
as the sociologist Émile Durkheim first suggested, our thinking about the way the universe works often mirrors the way our own societies work.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5756
But most were used as sources of stored energy for their owners: where human labor power was as important a source of energy as oil is today, controlling energy meant controlling people. To make slaves more amenable to control, they were often separated at birth from their families. And, like domestic animals, many were deliberately kept in a state of infantile dependence that inflicted a sort of psychic amputation on them—they remained like children, and their helplessness made them easier to control. Both animal and human slaves could be controlled best if kept economically and psychically dependent on their owners.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 5797
druzhiny
Highlight (orange) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6004
Outside the cities, they usually had little authority over the more localized forms of violence used to collect taxes, prosecute offenders or deal with banditry, or right local injustices. These powers were exercised by local elites or kinship groups. For most individuals, the righting of wrongs remained the duty of the household or kin group, which might seek the support of local patrons or officials.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6032
Sounds like modern day Muslim middle eastern practice now…
Wolf calls “tributes.” This is justification for regarding societies with states as an entirely new type of social structure. Wolf treats the emergence of what he calls “tribute-taking” societies as a major transformation in the lifeways and the organization of human societies.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6127
They include the emergence of dense populations, which generated a complex division of labor that posed new organizational problems, led to increased need for conflict resolution and to more frequent warfare, and encouraged the building of large monumental buildings as well as the creation of some form of writing.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6136
The demographic dynamism introduced into human history by agriculture ensured that sooner or later, humans, like termites, would face the novel challenge of living in dense communities of their own species. For all the local differences, the solutions humans found in different parts of the world turned out to be remarkably similar to each other—and also strikingly similar to those found by termites and other social insects.
Highlight (yellow) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6173
Marvin Harris’s classic essay, “The Origin of Pristine States” (1978).
Highlight (green) – 9. From Power over Nature to Power over People: Cities, States, and “Civilizations” > Location 6190
we can think of four main types of societies in this era: three—foragers, independent farmers, and pastoralists—lack states; one—agrarian civilizations—has states.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6226
World historians have become increasingly sensitive to the importance of large systems of interaction, and have often analyzed them using the notion of world-systems. Immanuel Wallerstein, the originator of such theories, argued that particularly in the modern era, it was necessary to analyze not just particular nations or civilizations, but rather the larger networks of power and commerce in which they were entangled, because these networks explained features that could not be explained solely from the internal history of particular regions. Wallerstein called these networks “world-systems,” even though they did not literally embrace the entire world, on the grounds that in many regards they functioned as separate worlds.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6354
Centers of gravity gave structure and shape to large networks of exchange, while hub regions were more lightweight and were more easily transformed by the exchanges that swept through them. So it was often in hub regions that significant innovations first became important because here was where they could have the greatest impact, while the mass and momentum of centers of gravity ensured that those regions normally changed more slowly.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6421
During the reign of Sargon of Akkad (who ruled from ca. 2350 BCE for ca. 50 years), we have the first evidence for a new stage in state formation: the appearance of a state controlling several different city-states and their hinterlands.14
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6475
chinampa
Highlight (orange) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6644
Rein Taagepera has tried to measure the areas ruled by “imperial systems” of Afro-Eurasia at different dates.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6694
three other factors shaped the pace and nature of innovation in this period: population growth, the expanding activity of states, and increasing commercialization and urbanization.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6721
Scale as a Source of Innovation
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6728
“the respiration of a social structure.”
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6868
One reason for their immense influence was the overwhelming importance of the agrarian sector. Where most forms of production relied on organic materials and energy sources, agricultural output set limits to the production not just of foodstuffs but also of clothing, housing, energy, productive implements, and even parchment and paper.33 Because agriculture was the main motor of economic growth in the agrarian era, rates of innovation in agriculture dominated medium-term economic, political, and even cultural cycles.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6869
States as Sources of Accumulation
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 6998
The most stable states and the wisest rulers protected the productive base of their societies by taxing lightly, maintaining basic infrastructure, upholding law and order, and encouraging growth in rural populations and agricultural output.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7063
Thus, an eleventh-century CE Muslim prince from Tabaristan wrote in a book for his son, “Make it your constant endeavor to improve cultivation and to govern well; for understand this truth: the kingdom can be held by the army, and the army by gold; and gold is acquired through agricultural development and agricultural development through justice and equity. Therefore be just and equitable.”50
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7068
Powerful states spent freely on large prestige projects, including cities such as the Achaemenid capital, Persepolis. Such projects were designed to overawe subjects and rivals, but they also provided employment and attracted merchants and artisans.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7086
In Muscovite history, the reign of Ivan the Terrible offers a horrifying example of the dangers of excessive predation.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7113
First, elites in tribute-taking societies had to be specialists in coercion and management rather than in production.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7118
Stable and long-lived polities such as that of China thrived in part because they were rich enough and durable enough to maintain predictable and relatively light levels of taxation, which gave peasants a greater stake in productivity-raising innovations.57
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7153
as Joel Mokyr has argued, technological innovation is unlikely to happen quickly where those who work lack wealth, education, and prestige, and those who are wealthy, educated, and have prestige know nothing about productive work.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7157
Exchange, Commerce, and Urbanization
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7165
Thus urbanization itself dampened population growth, and it did so most decisively when cities grew fastest.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7289
Though tributary states normally tolerated and sometimes encouraged commerce, their predatory methods and willingness to resort to force were ever-present threats to the freedoms needed for trade to flourish. There was therefore a fundamental long-term conflict between the methods of tribute takers and those of merchants; and as long as tributary elites dominated political systems, this conflict limited the productivity-raising potential of commercial activity.
Highlight (yellow) – 10. Long Trends in the Era of Agrarian “Civilizations” > Location 7293
Part V: The Modern Era: One World
Scythians north of the Black Sea more than 2,000 years ago:
Highlight (yellow) – 11. Approaching Modernity > Location 7432
But though they are on the whole less violent, personal relations in modern urban communities also lack the intimacy and continuity of those in most traditional societies. Increasingly, they are casual, anonymous, and fleeting. These changes may help explain the loss of a clear sense of values and meaning in modern lives, a subtle and disorienting alteration in the quality of modern life that the French sociologist Émile Durkheim referred to in the late nineteenth century as “anomie.”
Highlight (yellow) – 11. Approaching Modernity > Location 7618
Interesting in light of Civility for P.M. Forni.
The German sociologist Norbert Elias has argued that these changes have reached deep within our psyches, as modern forms of work and time discipline, enforced through the market, have shaped behavior in interpersonal relations, table manners, and attitudes toward sexuality. He has shown how the “emotional economy” typical in the modern world arises out of a relaxation of external restraints combined with an intensification of internal restraints: “The compulsions arising directly from the threat of weapons and physical force gradually diminish, and . . . those forms of dependency which lead to the regulation of the affects [feelings or emotions] in the form of self-control, gradually increase.”
Highlight (yellow) – 11. Approaching Modernity > Location 7622
A system of knowledge that is good at manipulating the material world is exactly what we need. Without such knowledge, we could not possibly support a human population of 6 billion.
Highlight (yellow) – 11. Approaching Modernity > Location 7645
As Daniel Headrick writes: “Knowledge is both cause and effect of economic growth, and the information industry has been the primary cause of the acceleration of technological change in the past 200 years.”
Highlight (yellow) – 11. Approaching Modernity > Location 7685
Necessity is not always the mother of invention.
Highlight (yellow) – 11. Approaching Modernity > Location 7718
in Britain iron makers had tried to use coal for almost two centuries before Abraham Darby showed them how to use coke in the early eighteenth century.
Highlight (yellow) – 11. Approaching Modernity > Location 7728
expanding networks of exchange encouraged specialization, which stimulated innovation in productive techniques—a type of growth we can refer to as Smithian.42
Highlight (yellow) – 11. Approaching Modernity > Location 7768
From Joel Mokyr, The Lever of Riches: Technological Creativity and Economic Progress (Oxford: Oxford University Press, 1992),
Highlight (green) – 11. Approaching Modernity > Location 7772
the very nature of most premodern states suggests that as a general rule, in agrarian civilizations tribute-taking generated more wealth and certainly more power than commercial exchanges. This differential helps us understand what might at first appear puzzling: though commercial networks are as old as agrarian civilization, their impact on rates of innovation has been limited until the past two or three centuries. Why, then, did commercial exchanges suddenly become so much more significant in the modern era? Did they reach some critical threshold?
Highlight (yellow) – 11. Approaching Modernity > Location 7780
And what then is the next threshold? For think of what the Internet is doing to the entertainment industry and their reticence to go along with it.
Speaking generally, it is the steepness of this gradient of wealth that accounts for capitalism’s remarkable dynamism, just as the large temperature gradient between the Sun and the space surrounding it drives complex processes on Earth.
Highlight (yellow) – 11. Approaching Modernity > Location 7819
is the steepness of the gradient that drives wealth so efficiently through capitalist societies and that helps explain why, paradoxically, modern states have to be so much larger and more complex than the states of the tributary world.
Highlight (yellow) – 11. Approaching Modernity > Location 7823
So the onus is on the workers to ensure that their labor is productive enough to find a buyer. In this way, the economic lash can stimulate genuine, even creative, self-discipline, whereas the overseer’s whip can generate no more than grudging conformity.
Highlight (yellow) – 11. Approaching Modernity > Location 7843
J. L. Anderson’s Explaining Long-Term Economic Change (1991) is a useful introduction to the theoretical literature.
Highlight (green) – 11. Approaching Modernity > Location 7920
Robert Lopez, has called the “commercial revolution of the Middle Ages” a fundamental turning point in modern world history.
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8067
Well-to-do merchants accumulate goods and redouble their profits, while the less well-to-do sit in their shops and sell. They control the markets and daily enjoy their ease in the cities. They take advantage of the pressing needs of the government to sell at twice the normal price. Their sons do not plough or hoe. Their daughters do not raise silkworms or weave. They have fancy clothing and stuff themselves on millet and meat. They earn fortunes while suffering none of the hardships which the farmers suffer. Their wealth enables them to hobnob with princes and marquises, and to dispose of greater power than the officials.29
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8185
This quote about 2nd century BCE China sounds a lot like modern day China.
this process was completed by 1279 after the conquest of South China by the Mongols under Kublai Khan. After reunification, two of the three conditions encouraging states to support commercialization (small size and intense rivalries) vanished, and the third (easy access to rich trading systems) lasted only slightly longer.
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8270
Charles Tilly’s Coercion, Capital, and European States, AD 990–1992 (rev. ed., 1992).
Highlight (green) – 12. Globalization, Commercialization, and Innovation > Location 8567
Indeed, Spain depended so heavily on American silver that when the supply ran out in the seventeenth century, its commercial and political influence declined.
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8628
piratical
Highlight (orange) – 12. Globalization, Commercialization, and Innovation > Location 8631
wealth. The mercantilist policies of European states in the seventeenth century—such as the Navigation Acts of the English commonwealth, which protected British commerce within British colonies—are good examples of new government attitudes toward commerce and the actions that these changes encouraged. Also illustrating this trend is the proliferation throughout Europe of patent laws, which were pioneered in Venice in the fifteenth century. Governments also began to promote innovation through the founding of scientific societies or the offering of prizes.
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8641
Over time, commercialization transformed traditional tributary elites. Such transformation was most likely to occur when demands on elite incomes rose sharply in environments where commercial revenues were available for the taking. The English wool trade offers a classic example, for it tempted landowners to clear the land of tenants and replace them with sheep, particularly in the sixteenth century, when new land became available as a result of the dissolution of the monasteries.
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8648
“it is gain, whether vile or sordid, that derogates from nobility, whose proper role is to live off rents.”
Highlight (yellow) – 12. Globalization, Commercialization, and Innovation > Location 8656
the invention in France of the Jacquard loom, which pioneered the use of digital coding as a form of mechanical control (1801);
Highlight (yellow) – 13. Birth of the Modern World > Location 8951
As early as 1837, the French revolutionary Blanqui used the term industrial revolution
Highlight (yellow) – 13. Birth of the Modern World > Location 8956
For most rural dwellers, these changes were catastrophic.
Highlight (yellow) – 13. Birth of the Modern World > Location 9024
This is now what is happening in most of the rest of the world now.
The appearance of societies in which most people depended entirely on markets for their subsistence was a new phenomenon, and it gave a tremendous stimulus to commercial production of goods of mass consumption.
Highlight (yellow) – 13. Birth of the Modern World > Location 9097
The idea that atmospheric pressure was a potential source of mechanical power had a history going back at least to the sixteenth century, and it may have been familiar in China as well as in Europe.23
Highlight (yellow) – 13. Birth of the Modern World > Location 9126
In 1718, a new owner, Thomas Lombe, in an early example of planned industrial espionage, stole techniques already in use in Italy to set up an improved factory.
Highlight (yellow) – 13. Birth of the Modern World > Location 9137
Richard Arkwright’s water frame, James Hargreaves’s spinning jenny, and Samuel Crompton’s spinning mule, a modification of the jenny.24
Highlight (yellow) – 13. Birth of the Modern World > Location 9140
Karl Polanyi argues in a classic study of modernity,
Highlight (green) – 13. Birth of the Modern World > Location 9336
Where literacy spread, knowledge became more abstract and less personal, and abstract knowledge began to acquire an authority quite independent from the prestige of particular teachers.
Highlight (yellow) – 13. Birth of the Modern World > Location 9375
In the nineteenth century, beginning in Germany, science itself began to be incorporated into entrepreneurial activity as companies set up laboratories specifically to raise productivity and profits. By the late nineteenth century, scientific research was taking a leading role in processes of innovation that might have simply petered out if they had continued to rely on the technical and practical skills of individual entrepreneurs and artisans.
Highlight (yellow) – 13. Birth of the Modern World > Location 9389
Think about how this is done now and how much of it is done by universities instead of by industry. Where is his innovation happening in the future?
The modern world is ruled by larger and more impersonal forces, from faceless bureaucracies to abstractions such as “inflation,” or “the rule of law.” Where abstract forces take over the work of coercion from the landlord, the executioner, and the overseer, it is not surprising that there should emerge cosmologies ruled by equally abstract forces.
Highlight (yellow) – 13. Birth of the Modern World > Location 9395
Joel Mokyr, The Lever of Riches (1990),
Highlight (green) – 13. Birth of the Modern World > Location 9532
Charles Tilly, Coercion, Capital, and European States, AD 990–1992 (rev. ed., 1992), is good on some of the political changes associated with the Industrial Revolution.
Highlight (green) – 13. Birth of the Modern World > Location 9533
During the “great depression” of the 1870s, it became apparent for the first time that economic growth could falter because of overproduction as well as underproduction.
Highlight (yellow) – 14. The Great Acceleration of the Twentieth Century > Location 9700
Over the following decades, it became clear that in a world of steadily increasing productivity, the problem of finding (or creating) markets would shape the rhythms of economic activity much as the problem of insufficient productivity had done in the agrarian era. As a result, the modern era is dominated by cycles of activity with a different (normally a shorter) periodicity, which we know as business cycles.
Highlight (yellow) – 14. The Great Acceleration of the Twentieth Century > Location 9702
Indeed, lifestyles have changed so greatly that they may be exerting a significant evolutionary impact on human bodies.
Highlight (yellow) – 14. The Great Acceleration of the Twentieth Century > Location 9715
The tensions and dislocations of the hurricane of change affecting the entire globe will ensure that conflict remains endemic, and modern weaponry will ensure that local conflicts continue to cause great suffering.
Highlight (yellow) – 14. The Great Acceleration of the Twentieth Century > Location 10017
Lester Brown argues that “while the Agricultural Revolution transformed the earth’s surface, the Industrial Revolution is transforming the earth’s atmosphere.”
Highlight (yellow) – 14. The Great Acceleration of the Twentieth Century > Location 10049
Part VI: Perspectives On The Future
“With chaos, it is sensitivity to initial conditions that makes the dynamics unpredictable. With emergent properties, it is the general inability of observers to predict the behavior of nonlinear systems from an understanding of their parts and interactions.”
Highlight (yellow) – 15. Futures > Location 10163
it is better than doing nothing at all, just as studying the form at a racetrack is better than tossing a coin. In the long run, you will end up with more money if you study the form.
Highlight (yellow) – 15. Futures > Location 10245
the space technologies envisioned by the Russian schoolteacher Konstantin Tsiolkovsky, which enabled the first human to leave Earth on 12 April 1961 and the first human to land on another heavenly body on 21 July 1969,
Highlight (yellow) – 15. Futures > Location 10468
Appendix 2: Chaos and Order
But the patterns we detect are really there, and their existence is one of the great puzzles of the universe. Why is there order of any kind? And what rules allow the creation and evolution of ordered structures?
Highlight (yellow) – Location 10964
On Earth, the temperature differential between our sun and surrounding space provides the free energy needed to create most forms of complexity, including ourselves; energies created early in the history of our solar system drive the internal heat battery of Earth, which drives plate tectonics. These differentials enable energy to flow, and energy flows make patterns possible. And given enough time, the mere possibility of pattern makes it likely that patterns of many different kinds will eventually appear.
Highlight (yellow) – Location 11024
After the first problem—explaining how order of any kind is possible—is addressed, the second problem remains. How did complex entities emerge, and, once they had emerged, how did they sustain themselves long enough to be noticed by us (or to be us)?
Highlight (yellow) – Location 11037
Paradoxically, the tendency toward increasing entropy—the drive toward disorder—may itself be the engine that creates order.
Highlight (yellow) – Location 11039
The drive toward disorder seems to create new forms of order, just as the energy of falling water can cause droplets of water to splash upward, or a river’s current can create eddies in which small amounts of water flow against the main current.
Highlight (yellow) – Location 11044
Roughly speaking, the more complex a phenomenon is, the denser the energy flows it must juggle and the more likely it is to break down. So we should expect that as entities become more complex, they become less stable, shorter-lived, and rarer. Perhaps even a slight increase in complexity can sharply increase their fragility and, therefore, their scarcity.
Highlight (yellow) – Location 11064
What we can do is to describe some of the ways in which complex structures emerge. The fundamental rule seems to be that complexity normally emerges step by step, linking already existing patterns into larger and more complex patterns at different scales.
Highlight (yellow) – Location 11072
new rules of construction and change seem to come into play. These are known as emergent properties,
Highlight (yellow) – Location 11076
Notes
“Leibig’s Law of the Minimum . . . states that populations will be limited by critical resources (e.g., water) that are in shortest supply” (Allen W. Johnson and Timothy Earle, The Evolution of Human Societies, 2nd ed. [Stanford: Stanford University Press, 2000], pp. 14–15).
Highlight (green) – Location 11456
articles, “Immunological Time Scale for Hominid Evolution”; it was published in Science, 1 December 1967, pp. 1200–1203.
Highlight (green) – Location 11492
There is a good short survey of theories of growth in J. L. Anderson, Explaining Long-Term Economic Change (Basingstoke: Macmillan, 1991); and see the survey in Mokyr, The Lever of Riches, chap. 7 (“Understanding Technological Progress”).
Highlight (green) – Location 12288
Guide to highlight colors
Yellow–general highlights and highlights which don’t fit under another category below
Orange–Vocabulary word; interesting and/or rare word
Green–Reference to read
Blue–Interesting Quote
Gray–Typography Problem
Red–Example to work through
Editor’s Note: Data relating to reading progress was added to this post on 10/21/16. Data relating to highlights, quotes, and marginalia added on 10/23/16.
This reminds me too of the visualization tool at http://www.chronozoom.com which I found by way of David Christian and Bill Gates’s Big History Project (http://www.bighistoryproject.org) a while back. It has a variety of timelines that are interesting and valuable didactic tools.
In fact, as I think about it, since their project is aimed primarily at helping to provide highly integrated curriculum (physics, chemistry, anthropology, paleontology, biology, history, etc.) to high school teachers for high school students, you might consider some type of collaboration with their group to potentially assist in possibly providing curriculum out of the Azimuth Project. Having a more integrated and complex viewpoint on the world we live in can certainly encourage the next generation of students to help save what we’ve got.
I can provide more resources if you’re interested, though it’s quite a bit more than the comments section here could hold. A small start can be found in a brief review I wrote a few years back: http://boffosocko.com/2012/06/17/big-history/
Christian is without a doubt a historian through and through, and is quite upfront about his general lack of scientific expertise and background. He has however spent quite a bit of time working with and consulting physicists, chemists, biologists, and other scientists to supplement the appropriate portions of his bigger thesis. I would say though, that he’s got firm footing in both of C.P. Snow’s “Two Cultures.”
Christian references Prigogine only once, though includes two Prigogine related footnotes in the last quarter of the text. He’s not as Prigogine-centric as [author:César Hidalgo|13831217] is in his recent [book:Why Information Grows: The Evolution of Order, from Atoms to Economies|25472587], which touches on some of the related physics of information theory and entropy (and general complexity theory – although I don’t recall him using this specific term) as they relate to economics. I’d classify Why Information Grows as a “big history” book, though Hidalgo wasn’t aware of the conceptualization of “big history” when he wrote it.
I wrote a slightly longer review of Christian’s book(s) on my blog: http://boffosocko.com/2012/06/17/big-history/. (Perhaps I’ll have to move more detail over into my GoodReads review.)#bighistory
For several years now, I’ve been meaning to do something more interesting with the notes, highlights, and marginalia from the various books I read. In particular, I’ve specifically been meaning to do it for the non-fiction I read for research, and even more so for e-books, which tend to have slightly more extract-able notes given their electronic nature. This fits in to the way in which I use this site as a commonplace book as well as the IndieWeb philosophy to own all of one’s own data.[1]
Over the past month or so, I’ve been experimenting with some fiction to see what works and what doesn’t in terms of a workflow for status updates around reading books, writing book reviews, and then extracting and depositing notes, highlights, and marginalia online. I’ve now got a relatively quick and painless workflow for exporting the book related data from my Amazon Kindle and importing it into the site with some modest markup and CSS for display. I’m sure the workflow will continue to evolve (and further automate) somewhat over the coming months, but I’m reasonably happy with where things stand.
The fact that the Amazon Kindle allows for relatively easy highlighting and annotation in e-books is excellent, but having the ability to sync to a laptop and do a one click export of all of that data, is incredibly helpful. Adding some simple CSS to the pre-formatted output gives me a reasonable base upon which to build for future writing/thinking about the material. In experimenting, I’m also coming to realize that simply owning the data isn’t enough, but now I’m driven to help make that data more directly useful to me and potentially to others.
As part of my experimenting, I’ve just uploaded some notes, highlights, and annotations for David Christian’s excellent text Maps of Time: An Introduction to Big History[2] which I read back in 2011/12. While I’ve read several of the references which I marked up in that text, I’ll have to continue evolving a workflow for doing all the related follow up (and further thinking and writing) on the reading I’ve done in the past.
I’m still reminded me of Rick Kurtzman’s sage advice to me when I was a young pisher at CAA in 1999: His point was that if you don’t try to pass along the knowledge you found by reading, you may as well give up. Even if the thing was terrible, at least say that as a minimum. In a digitally connected era, we no longer need to rely on nearly illegible scrawl in the margins to pollinate the world at a snail’s pace.[4] Take those notes, marginalia, highlights, and meta data and release it into the world. The fact that this dovetails perfectly with Cesar Hidalgo’s thesis in Why Information Grows: The Evolution of Order, from Atoms to Economies,[3] furthers my belief in having a better process for what I’m attempting here.
Hopefully in the coming months, I’ll be able to add similar data to several other books I’ve read and reviewed here on the site.
If anyone has any thoughts, tips, tricks for creating/automating this type of workflow/presentation, I’d love to hear them in the comments!
Footnotes
[1]
“Own your data,” IndieWeb. [Online]. Available: http://indieweb.org/own_your_data. [Accessed: 24-Oct-2016]
[2]
D. Christian and W. McNeill H., Maps of Time: An Introduction to Big History, 2nd ed. University of California Press, 2011.
[3]
C. Hidalgo, Why Information Grows: The Evolution of Order, from Atoms to Economies, 1st ed. Basic Books, 2015.
[4]
O. Gingerich, The Book Nobody Read: Chasing the Revolutions of Nicolaus Copernicus. Bloomsbury Publishing USA, 2004.
Syndicated copies:
This Article was mentioned on boffosocko.com
I’ve uploaded my notes, highlights, & annotations of “Maps of Time” by @davidgchristian http://boffosocko.com/2012/06/17/big-history #BigHistory #mustread
Jeremy, glad you figured it out. If you sync your books/notes to the Kindle desktop app, you can also alternately export your notes and highlights from individual texts as raw html with one of their interface buttons. You can then more easily cut and paste into your own site. With a bit of modified CSS magic, you can format it as you like, thus: http://boffosocko.com/2012/06/17/big-history/
Your clippings file isn’t bad, but doesn’t sync across devices, so you have to export from each of your devices if you use multiple, and they’re also time ordered, so if you read multiple things at once, or interspersed, it makes for more processing between titles. There’s also a service called https://www.clippings.io/ which may give you some better raw data, though I think they charge a fee for some services.
See also http://indieweb.org/read for other ideas.
Annotation on “Annotation is now a web standard” by Jeremy Dean (hypothes.is)
What about sharing my personal annotations on my own website? Is there a way for an individual annotator to relink something like the annotations/highlights at http://boffosocko.com/2012/06/17/big-history/#Highlights%2C+Quotes%2C+%26+Marginalia back to the original document (in this case an ebook)?
I’ve started into the documentation, but I’m curious if there’s a simple way of doing this without some 3rd party like Hypothes.is, Genius, etc. or some other massive framework?
Syndicated copies to:
Related
Author: Chris Aldrich
I’m a biomedical and electrical engineer with interests in information theory, complexity, evolution, genetics, signal processing, theoretical mathematics, and big history.
I’m also a talent manager-producer-publisher in the entertainment industry with expertise in representation, distribution, finance, production, content delivery, and new media.
View all posts by Chris Aldrich
@chrisaldrich How did you add all your Goodreads highlights, notes, and annotations? Is this a WordPress plug-in? bit.ly/2nLLq08
Frame of Reference by Alix Spiegel and Hanna Rosin (Invisibilia (NPR))
audio
I often think about frames of reference having grown up in poor, rural Appalachia and then living in affluent areas of Connecticut and later Los Angeles. I’m sure it’s had more of an effect on me than I could verbalize.
The closest I’ve come to having as significant a frame of reference change as the physician who realized she had Asperger syndrome (and how she came to know), was when I worked my way through David Christian’s Big History concept. In some sense I had some background in both science and history which helped, but I cannot possibly go back to seeing the world (and the Universe we live in) the same way again.
Incidentally, the fact that this treatment seemed so effective for this woman hopefully means that some really heavy and interesting research is continuing in these areas.
The final segment was interesting from the perspective of gradations in change of reference. I was blown down by the idea of the “skin lamp.” Just the phrase and it’s horrific meaning is enough to drastically change anyone’s frame of reference.
Syndicated copies to:
Related
Author: Chris Aldrich
I’m a biomedical and electrical engineer with interests in information theory, complexity, evolution, genetics, signal processing, theoretical mathematics, and big history.
I’m also a talent manager-producer-publisher in the entertainment industry with expertise in representation, distribution, finance, production, content delivery, and new media.
View all posts by Chris Aldrich
@mrkrndvs Ultimately you could have more text than the original, so there’s really no limit to the text beyond what your system will allow. I’ve not tried annotating .pdfs, but I suspect you could do it similarly to how I’ve done books via Kindle which let’s me export/import data (example: http://boffosocko.com/2012/06/17/big-history/#Highlights,+Quotes). Having all the data on my own site (even if it’s private) allows me much easier search via categories, tags, etc. as well. Typically for books I’m using fair use guidelines, though I’m often respectful and keep lots of my data viewable only to me, so copyright isn’t a huge concern generally. For book length pieces, the Amazon Kindle will typically limit you to a percentage of the book to prevent copyright issues from the start. I don’t think I’ve ever run up against their limit. Part of the process is to get enough to excerpt the thought to be able to find it later via search and reference it. I can always refer back to the original if necessary.
For more substantive annotations I try to add them slightly off to the side in a different font/size, but you’ll also notice that some of the blue highlights also have “hidden” annotations if you hover over them with your mouse. Things can be a bit crowded with the additional highlights added by Hypothesis (and other people), though I can choose to disable them if I want for my personal work. Hopefully it’s relatively obvious based on what’s on the page which parts are the original text and which are my additions. When excerpting articles like Watters’, the canonical URL on the page points to the original, so all the SEO and links ultimately redound to the original.
Syndicated copies:
There’s so much great material out there to read and not nearly enough time. The question becomes: “How to best organize it all, so you can read even more?”
I just came across a tweet from Michael Nielsen about the topic, which is far deeper than even a few tweets could do justice to, so I thought I’d sketch out a few basic ideas about how I’ve been approaching it over the last decade or so. Ideally I’d like to circle back around to this and better document more of the individual aspects or maybe even make a short video, but for now this will hopefully suffice to add to the conversation Michael has started.
https://platform.twitter.com/widgets.js
Keep in mind that this is an evolving system which I still haven’t completely perfected (and may never), but to a great extent it works relatively well and I still easily have the ability to modify and improve it.
Overall Structure
The first piece of the overarching puzzle is to have a general structure for finding, collecting, triaging, and then processing all of the data. I’ve essentially built a simple funnel system for collecting all the basic data in the quickest manner possible. With the basics down, I can later skim through various portions to pick out the things I think are the most valuable and move them along to the next step. Ultimately I end up reading the best pieces on which I make copious notes and highlights. I’m still slowly trying to perfect the system for best keeping all this additional data as well.
Since I’ve seen so many apps and websites come and go over the years and lost lots of data to them, I far prefer to use my own personal website for doing a lot of the basic collection, particularly for online material. Toward this end, I use a variety of web services, RSS feeds, and bookmarklets to quickly accumulate the important pieces into my personal website which I use like a modern day commonplace book.
Collecting
In general, I’ve been using the Inoreader feed reader to track a large variety of RSS feeds from various clearinghouse sources (including things like ProQuest custom searches) down to individual researcher’s blogs as a means of quickly pulling in large amounts of research material. It’s one of the more flexible readers out there with a huge number of useful features including the ability to subscribe to OPML files, which many readers don’t support.
As a simple example arXiv.org has an RSS feed for the topic of “information theory” at http://arxiv.org/rss/math.IT which I subscribe to. I can quickly browse through the feed and based on titles and/or abstracts, I can quickly “star” the items I find most interesting within the reader. I have a custom recipe set up for the IFTTT.com service that pulls in all these starred articles and creates new posts for them on my WordPress blog. To these posts I can add a variety of metadata including top level categories and lower level tags in addition to other additional metadata I’m interested in.
I also have similar incoming funnel entry points via many other web services as well. So on platforms like Twitter, I also have similar workflows that allow me to use services like IFTTT.com or Zapier to push the URLs easily to my website. I can quickly “like” a tweet and a background process will suck that tweet and any URLs within it into my system for future processing. This type of workflow extends to a variety of sites where I might consume potential material I want to read and process. (Think academic social services like Mendeley, Academia.com, Diigo, or even less academic ones like Twitter, LinkedIn, etc.) Many of these services often have storage ability and also have simple browser bookmarklets that allow me to add material to them. So with a quick click, it’s saved to the service and then automatically ported into my website almost without friction.
My WordPress-based site uses the Post Kinds Plugin which takes incoming website URLs and does a very solid job of parsing those pages to extract much of the primary metadata I’d like to have without requiring a lot of work. For well structured web pages, it’ll pull in the page title, authors, date published, date updated, synopsis of the page, categories and tags, and other bits of data automatically. All these fields are also editable and searchable. Further, the plugin allows me to configure simple browser bookmarklets so that with a simple click on a web page, I can pull its URL and associated metadata into my website almost instantaneously. I can then add a note or two about what made me interested in the piece and save it for later.
Note here, that I’m usually more interested in saving material for later as quickly as I possibly can. In this part of the process, I’m rarely ever interested in reading anything immediately. I’m most interested in finding it, collecting it for later, and moving on to the next thing. This is also highly useful for things I find during my busy day that I can’t immediately find time for at the moment.
As an example, here’s a book I’ve bookmarked to read simply by clicking “like” on a tweet I cam across late last year. You’ll notice at the bottom of the post, I’ve optionally syndicated copies of the post to other platforms to “spread the wealth” as it were. Perhaps others following me via other means may see it and find it useful as well?
Triaging
At regular intervals during the week I’ll sit down for an hour or two to triage all the papers and material I’ve been sucking into my website. This typically involves reading through lots of abstracts in a bit more detail to better figure out what I want to read now and what I’d like to read at a later date. I can delete out the irrelevant material if I choose, or I can add follow up dates to custom fields for later reminders.
Slowly but surely I’m funneling down a tremendous amount of potential material into a smaller, more manageable amount that I’m truly interested in reading on a more in-depth basis.
Document storage
Calibre with GoodReads sync
Even for things I’ve winnowed down, there is still a relatively large amount of material, much of it I’ll want to save and personally archive. For a lot of this function I rely on the free multi-platform desktop application Calibre. It’s essentially an iTunes-like interface, but it’s built specifically for e-books and other documents.
Within it I maintain a small handful of libraries. One for personal e-books, one for research related textbooks/e-books, and another for journal articles. It has a very solid interface and is extremely flexible in terms of configuration and customization. You can create a large number of custom libraries and create your own searchable and sort-able fields with a huge variety of metadata. It often does a reasonable job of importing e-books, .pdf files, and other digital media and parsing out their meta data which prevents one from needing to do some of that work manually. With some well maintained metadata, one can very quickly search and sort a huge amount of documents as well as quickly prioritize them for action. Additionally, the system does a pretty solid job of converting files from one format to another, so that things like converting an .epub file into a .mobi format for Kindle are automatic.
Calibre stores the physical documents either in local computer storage, or even better, in the cloud using any of a variety of services including Dropbox, OneDrive, etc. so that one can keep one’s documents in the cloud and view them from a variety of locations (home, work, travel, tablet, etc.)
I’ve been a very heavy user of GoodReads.com for years to bookmark and organize my physical and e-book library and anti-libraries. Calibre has an exceptional plugin for GoodReads that syncs data across the two. This (and a few other plugins) are exceptionally good at pulling in missing metadata to minimize the amount that must be done via hand, which can be tedious.
Within Calibre I can manage my physical books, e-books, journal articles, and a huge variety of other document related forms and formats. I can also use it to further triage and order the things I intend to read and order them to the nth degree. My current Calibre libraries have over 10,000 documents in them including over 2,500 textbooks as well as records of most of my 1,000+ physical books. Calibre can also be used to add document data that one would like to ultimately acquire the actual documents, but currently don’t have access to.
BibTeX and reference management
In addition to everything else Calibre also has some well customized pieces for dovetailing all its metadata as a reference management system. It’ll allow one to export data in a variety of formats for document publishing and reference management including BibTex formats amongst many others.
Reading, Annotations, Highlights
Once I’ve winnowed down the material I’m interested in it’s time to start actually reading. I’ll often use Calibre to directly send my documents to my Kindle or other e-reading device, but one can also read them on one’s desktop with a variety of readers, or even from within Calibre itself. With a click or two, I can automatically email documents to my Kindle and Calibre will also auto-format them appropriately before doing so.
Typically I’ll send them to my Kindle which allows me a variety of easy methods for adding highlights and marginalia. Sometimes I’ll read .pdf files via desktop and use Adobe to add highlights and marginalia as well. When I’m done with a .pdf file, I’ll just resave it (with all the additions) back into my Calibre library.
Exporting highlights/marginalia to my website
For Kindle related documents, once I’m finished, I’ll use direct text file export or tools like clippings.io to export my highlights and marginalia for a particular text into simple HTML and import it into my website system along with all my other data. I’ve briefly written about some of this before, though I ought to better document it. All of this then becomes very easily searchable and sort-able for future potential use as well.
Here’s an example of some public notes, highlights, and other marginalia I’ve posted in the past.
Synthesis
Eventually, over time, I’ve built up a huge amount of research related data in my personal online commonplace book that is highly searchable and sortable! I also have the option to make these posts and pages public, private, or even password protected. I can create accounts on my site for collaborators to use and view private material that isn’t publicly available. I can also share posts via social media and use standards like webmention and tools like brid.gy so that comments and interactions with these pieces on platforms like Facebook, Twitter, Google+, and others is imported back to the relevant portions of my site as comments. (I’m doing it with this post, so feel free to try it out yourself by commenting on one of the syndicated copies.)
Now when I’m ready to begin writing something about what I’ve read, I’ve got all the relevant pieces, notes, and metadata in one centralized location on my website. Synthesis becomes much easier. I can even have open drafts of things as I’m reading and begin laying things out there directly if I choose. Because it’s all stored online, it’s imminently available from almost anywhere I can connect to the web. As an example, I used a few portions of this workflow to actually write this post.
Continued work
Naturally, not all of this is static and it continues to improve and evolve over time. In particular, I’m doing continued work on my personal website so that I’m able to own as much of the workflow and data there. Ideally I’d love to have all of the Calibre related piece on my website as well.
Earlier this week I even had conversations about creating new post types on my website related to things that I want to read to potentially better display and document them explicitly. When I can I try to document some of these pieces either here on my own website or on various places on the IndieWeb wiki. In fact, the IndieWeb for Education page might be a good place to start browsing for those interested.
One of the added benefits of having a lot of this data on my own website is that it not only serves as my research/data platform, but it also has the traditional ability to serve as a publishing and distribution platform!
Currently, I’m doing most of my research related work in private or draft form on the back end of my website, so it’s not always publicly available, though I often think I should make more of it public for the value of the aggregation nature it has as well as the benefit it might provide to improving scientific communication. Just think, if you were interested in some of the obscure topics I am and you could have a pre-curated RSS feed of all the things I’ve filtered through piped into your own system… now multiply this across hundreds of thousands of other scientists? Michael Nielsen posts some useful things to his Twitter feed and his website, but what I wouldn’t give to see far more of who and what he’s following, bookmarking, and actually reading? While many might find these minutiae tedious, I guarantee that people in his associated fields would find some serious value in it.
I’ve tried hundreds of other apps and tools over the years, but more often than not, they only cover a small fraction of the necessary moving pieces within a much larger moving apparatus that a working researcher and writer requires. This often means that one is often using dozens of specialized tools upon which there’s a huge duplication of data efforts. It also presumes these tools will be around for more than a few years and allow easy import/export of one’s hard fought for data and time invested in using them.
If you’re aware of something interesting in this space that might be useful, I’m happy to take a look at it. Even if I might not use the service itself, perhaps it’s got a piece of functionality that I can recreate into my own site and workflow somehow?
If you’d like help in building and fleshing out a system similar to the one I’ve outlined above, I’m happy to help do that too.
Related posts
Notes, Highlights, and Marginalia: From E-books to Online
A New Reading Post-type for Bookmarking and Reading Workflow
PressForward as an IndieWeb WordPress-based RSS Feed Reader & Pocket/Instapaper Replacement
Syndicated copies to:
Syndicated copies:
There’s so much great material out there to read and not nearly enough time. The question becomes: “How to best organize it all, so you can read even more?”
I just came across a tweet from Michael Nielsen about the topic, which is far deeper than even a few tweets could do justice to, so I thought I’d sketch out a few basic ideas about how I’ve been approaching it over the last decade or so. Ideally I’d like to circle back around to this and better document more of the individual aspects or maybe even make a short video, but for now this will hopefully suffice to add to the conversation Michael has started.
https://platform.twitter.com/widgets.js
Keep in mind that this is an evolving system which I still haven’t completely perfected (and may never), but to a great extent it works relatively well and I still easily have the ability to modify and improve it.
Overall Structure
The first piece of the overarching puzzle is to have a general structure for finding, collecting, triaging, and then processing all of the data. I’ve essentially built a simple funnel system for collecting all the basic data in the quickest manner possible. With the basics down, I can later skim through various portions to pick out the things I think are the most valuable and move them along to the next step. Ultimately I end up reading the best pieces on which I make copious notes and highlights. I’m still slowly trying to perfect the system for best keeping all this additional data as well.
Since I’ve seen so many apps and websites come and go over the years and lost lots of data to them, I far prefer to use my own personal website for doing a lot of the basic collection, particularly for online material. Toward this end, I use a variety of web services, RSS feeds, and bookmarklets to quickly accumulate the important pieces into my personal website which I use like a modern day commonplace book.
Collecting
In general, I’ve been using the Inoreader feed reader to track a large variety of RSS feeds from various clearinghouse sources (including things like ProQuest custom searches) down to individual researcher’s blogs as a means of quickly pulling in large amounts of research material. It’s one of the more flexible readers out there with a huge number of useful features including the ability to subscribe to OPML files, which many readers don’t support.
As a simple example arXiv.org has an RSS feed for the topic of “information theory” at http://arxiv.org/rss/math.IT which I subscribe to. I can quickly browse through the feed and based on titles and/or abstracts, I can quickly “star” the items I find most interesting within the reader. I have a custom recipe set up for the IFTTT.com service that pulls in all these starred articles and creates new posts for them on my WordPress blog. To these posts I can add a variety of metadata including top level categories and lower level tags in addition to other additional metadata I’m interested in.
I also have similar incoming funnel entry points via many other web services as well. So on platforms like Twitter, I also have similar workflows that allow me to use services like IFTTT.com or Zapier to push the URLs easily to my website. I can quickly “like” a tweet and a background process will suck that tweet and any URLs within it into my system for future processing. This type of workflow extends to a variety of sites where I might consume potential material I want to read and process. (Think academic social services like Mendeley, Academia.com, Diigo, or even less academic ones like Twitter, LinkedIn, etc.) Many of these services often have storage ability and also have simple browser bookmarklets that allow me to add material to them. So with a quick click, it’s saved to the service and then automatically ported into my website almost without friction.
My WordPress-based site uses the Post Kinds Plugin which takes incoming website URLs and does a very solid job of parsing those pages to extract much of the primary metadata I’d like to have without requiring a lot of work. For well structured web pages, it’ll pull in the page title, authors, date published, date updated, synopsis of the page, categories and tags, and other bits of data automatically. All these fields are also editable and searchable. Further, the plugin allows me to configure simple browser bookmarklets so that with a simple click on a web page, I can pull its URL and associated metadata into my website almost instantaneously. I can then add a note or two about what made me interested in the piece and save it for later.
Note here, that I’m usually more interested in saving material for later as quickly as I possibly can. In this part of the process, I’m rarely ever interested in reading anything immediately. I’m most interested in finding it, collecting it for later, and moving on to the next thing. This is also highly useful for things I find during my busy day that I can’t immediately find time for at the moment.
As an example, here’s a book I’ve bookmarked to read simply by clicking “like” on a tweet I cam across late last year. You’ll notice at the bottom of the post, I’ve optionally syndicated copies of the post to other platforms to “spread the wealth” as it were. Perhaps others following me via other means may see it and find it useful as well?
Triaging
At regular intervals during the week I’ll sit down for an hour or two to triage all the papers and material I’ve been sucking into my website. This typically involves reading through lots of abstracts in a bit more detail to better figure out what I want to read now and what I’d like to read at a later date. I can delete out the irrelevant material if I choose, or I can add follow up dates to custom fields for later reminders.
Slowly but surely I’m funneling down a tremendous amount of potential material into a smaller, more manageable amount that I’m truly interested in reading on a more in-depth basis.
Document storage
Calibre with GoodReads sync
Even for things I’ve winnowed down, there is still a relatively large amount of material, much of it I’ll want to save and personally archive. For a lot of this function I rely on the free multi-platform desktop application Calibre. It’s essentially an iTunes-like interface, but it’s built specifically for e-books and other documents.
Within it I maintain a small handful of libraries. One for personal e-books, one for research related textbooks/e-books, and another for journal articles. It has a very solid interface and is extremely flexible in terms of configuration and customization. You can create a large number of custom libraries and create your own searchable and sort-able fields with a huge variety of metadata. It often does a reasonable job of importing e-books, .pdf files, and other digital media and parsing out their meta data which prevents one from needing to do some of that work manually. With some well maintained metadata, one can very quickly search and sort a huge amount of documents as well as quickly prioritize them for action. Additionally, the system does a pretty solid job of converting files from one format to another, so that things like converting an .epub file into a .mobi format for Kindle are automatic.
Calibre stores the physical documents either in local computer storage, or even better, in the cloud using any of a variety of services including Dropbox, OneDrive, etc. so that one can keep one’s documents in the cloud and view them from a variety of locations (home, work, travel, tablet, etc.)
I’ve been a very heavy user of GoodReads.com for years to bookmark and organize my physical and e-book library and anti-libraries. Calibre has an exceptional plugin for GoodReads that syncs data across the two. This (and a few other plugins) are exceptionally good at pulling in missing metadata to minimize the amount that must be done via hand, which can be tedious.
Within Calibre I can manage my physical books, e-books, journal articles, and a huge variety of other document related forms and formats. I can also use it to further triage and order the things I intend to read and order them to the nth degree. My current Calibre libraries have over 10,000 documents in them including over 2,500 textbooks as well as records of most of my 1,000+ physical books. Calibre can also be used to add document data that one would like to ultimately acquire the actual documents, but currently don’t have access to.
BibTeX and reference management
In addition to everything else Calibre also has some well customized pieces for dovetailing all its metadata as a reference management system. It’ll allow one to export data in a variety of formats for document publishing and reference management including BibTex formats amongst many others.
Reading, Annotations, Highlights
Once I’ve winnowed down the material I’m interested in it’s time to start actually reading. I’ll often use Calibre to directly send my documents to my Kindle or other e-reading device, but one can also read them on one’s desktop with a variety of readers, or even from within Calibre itself. With a click or two, I can automatically email documents to my Kindle and Calibre will also auto-format them appropriately before doing so.
Typically I’ll send them to my Kindle which allows me a variety of easy methods for adding highlights and marginalia. Sometimes I’ll read .pdf files via desktop and use Adobe to add highlights and marginalia as well. When I’m done with a .pdf file, I’ll just resave it (with all the additions) back into my Calibre library.
Exporting highlights/marginalia to my website
For Kindle related documents, once I’m finished, I’ll use direct text file export or tools like clippings.io to export my highlights and marginalia for a particular text into simple HTML and import it into my website system along with all my other data. I’ve briefly written about some of this before, though I ought to better document it. All of this then becomes very easily searchable and sort-able for future potential use as well.
Here’s an example of some public notes, highlights, and other marginalia I’ve posted in the past.
Synthesis
Eventually, over time, I’ve built up a huge amount of research related data in my personal online commonplace book that is highly searchable and sortable! I also have the option to make these posts and pages public, private, or even password protected. I can create accounts on my site for collaborators to use and view private material that isn’t publicly available. I can also share posts via social media and use standards like webmention and tools like brid.gy so that comments and interactions with these pieces on platforms like Facebook, Twitter, Google+, and others is imported back to the relevant portions of my site as comments. (I’m doing it with this post, so feel free to try it out yourself by commenting on one of the syndicated copies.)
Now when I’m ready to begin writing something about what I’ve read, I’ve got all the relevant pieces, notes, and metadata in one centralized location on my website. Synthesis becomes much easier. I can even have open drafts of things as I’m reading and begin laying things out there directly if I choose. Because it’s all stored online, it’s imminently available from almost anywhere I can connect to the web. As an example, I used a few portions of this workflow to actually write this post.
Continued work
Naturally, not all of this is static and it continues to improve and evolve over time. In particular, I’m doing continued work on my personal website so that I’m able to own as much of the workflow and data there. Ideally I’d love to have all of the Calibre related piece on my website as well.
Earlier this week I even had conversations about creating new post types on my website related to things that I want to read to potentially better display and document them explicitly. When I can I try to document some of these pieces either here on my own website or on various places on the IndieWeb wiki. In fact, the IndieWeb for Education page might be a good place to start browsing for those interested.
One of the added benefits of having a lot of this data on my own website is that it not only serves as my research/data platform, but it also has the traditional ability to serve as a publishing and distribution platform!
Currently, I’m doing most of my research related work in private or draft form on the back end of my website, so it’s not always publicly available, though I often think I should make more of it public for the value of the aggregation nature it has as well as the benefit it might provide to improving scientific communication. Just think, if you were interested in some of the obscure topics I am and you could have a pre-curated RSS feed of all the things I’ve filtered through piped into your own system… now multiply this across hundreds of thousands of other scientists? Michael Nielsen posts some useful things to his Twitter feed and his website, but what I wouldn’t give to see far more of who and what he’s following, bookmarking, and actually reading? While many might find these minutiae tedious, I guarantee that people in his associated fields would find some serious value in it.
I’ve tried hundreds of other apps and tools over the years, but more often than not, they only cover a small fraction of the necessary moving pieces within a much larger moving apparatus that a working researcher and writer requires. This often means that one is often using dozens of specialized tools upon which there’s a huge duplication of data efforts. It also presumes these tools will be around for more than a few years and allow easy import/export of one’s hard fought for data and time invested in using them.
If you’re aware of something interesting in this space that might be useful, I’m happy to take a look at it. Even if I might not use the service itself, perhaps it’s got a piece of functionality that I can recreate into my own site and workflow somehow?
If you’d like help in building and fleshing out a system similar to the one I’ve outlined above, I’m happy to help do that too.
Related posts
Notes, Highlights, and Marginalia: From E-books to Online
A New Reading Post-type for Bookmarking and Reading Workflow
PressForward as an IndieWeb WordPress-based RSS Feed Reader & Pocket/Instapaper Replacement
Syndicated copies to:
Author: Chris Aldrich
I'm a biomedical and electrical engineer with interests in information theory, complexity, evolution, genetics, signal processing, theoretical mathematics, and big history.
I’m also a talent manager-producer-publisher in the entertainment industry with expertise in representation, distribution, finance, production, content delivery, and new media.
View all posts by Chris Aldrich
Syndicated copies:
There’s so much great material out there to read and not nearly enough time. The question becomes: “How to best organize it all, so you can read even more?”
I just came across a tweet from Michael Nielsen about the topic, which is far deeper than even a few tweets could do justice to, so I thought I’d sketch out a few basic ideas about how I’ve been approaching it over the last decade or so. Ideally I’d like to circle back around to this and better document more of the individual aspects or maybe even make a short video, but for now this will hopefully suffice to add to the conversation Michael has started.
Keep in mind that this is an evolving system which I still haven’t completely perfected (and may never), but to a great extent it works relatively well and I still easily have the ability to modify and improve it.
Overall Structure
The first piece of the overarching puzzle is to have a general structure for finding, collecting, triaging, and then processing all of the data. I’ve essentially built a simple funnel system for collecting all the basic data in the quickest manner possible. With the basics down, I can later skim through various portions to pick out the things I think are the most valuable and move them along to the next step. Ultimately I end up reading the best pieces on which I make copious notes and highlights. I’m still slowly trying to perfect the system for best keeping all this additional data as well.
Since I’ve seen so many apps and websites come and go over the years and lost lots of data to them, I far prefer to use my own personal website for doing a lot of the basic collection, particularly for online material. Toward this end, I use a variety of web services, RSS feeds, and bookmarklets to quickly accumulate the important pieces into my personal website which I use like a modern day commonplace book.
Collecting
In general, I’ve been using the Inoreader feed reader to track a large variety of RSS feeds from various clearinghouse sources (including things like ProQuest custom searches) down to individual researcher’s blogs as a means of quickly pulling in large amounts of research material. It’s one of the more flexible readers out there with a huge number of useful features including the ability to subscribe to OPML files, which many readers don’t support.
As a simple example arXiv.org has an RSS feed for the topic of “information theory” at http://arxiv.org/rss/math.IT which I subscribe to. I can quickly browse through the feed and based on titles and/or abstracts, I can quickly “star” the items I find most interesting within the reader. I have a custom recipe set up for the IFTTT.com service that pulls in all these starred articles and creates new posts for them on my WordPress blog. To these posts I can add a variety of metadata including top level categories and lower level tags in addition to other additional metadata I’m interested in.
I also have similar incoming funnel entry points via many other web services as well. So on platforms like Twitter, I also have similar workflows that allow me to use services like IFTTT.com or Zapier to push the URLs easily to my website. I can quickly “like” a tweet and a background process will suck that tweet and any URLs within it into my system for future processing. This type of workflow extends to a variety of sites where I might consume potential material I want to read and process. (Think academic social services like Mendeley, Academia.com, Diigo, or even less academic ones like Twitter, LinkedIn, etc.) Many of these services often have storage ability and also have simple browser bookmarklets that allow me to add material to them. So with a quick click, it’s saved to the service and then automatically ported into my website almost without friction.
My WordPress-based site uses the Post Kinds Plugin which takes incoming website URLs and does a very solid job of parsing those pages to extract much of the primary metadata I’d like to have without requiring a lot of work. For well structured web pages, it’ll pull in the page title, authors, date published, date updated, synopsis of the page, categories and tags, and other bits of data automatically. All these fields are also editable and searchable. Further, the plugin allows me to configure simple browser bookmarklets so that with a simple click on a web page, I can pull its URL and associated metadata into my website almost instantaneously. I can then add a note or two about what made me interested in the piece and save it for later.
Note here, that I’m usually more interested in saving material for later as quickly as I possibly can. In this part of the process, I’m rarely ever interested in reading anything immediately. I’m most interested in finding it, collecting it for later, and moving on to the next thing. This is also highly useful for things I find during my busy day that I can’t immediately find time for at the moment.
As an example, here’s a book I’ve bookmarked to read simply by clicking “like” on a tweet I cam across late last year. You’ll notice at the bottom of the post, I’ve optionally syndicated copies of the post to other platforms to “spread the wealth” as it were. Perhaps others following me via other means may see it and find it useful as well?
Triaging
At regular intervals during the week I’ll sit down for an hour or two to triage all the papers and material I’ve been sucking into my website. This typically involves reading through lots of abstracts in a bit more detail to better figure out what I want to read now and what I’d like to read at a later date. I can delete out the irrelevant material if I choose, or I can add follow up dates to custom fields for later reminders.
Slowly but surely I’m funneling down a tremendous amount of potential material into a smaller, more manageable amount that I’m truly interested in reading on a more in-depth basis.
Document storage
Calibre with GoodReads sync
Even for things I’ve winnowed down, there is still a relatively large amount of material, much of it I’ll want to save and personally archive. For a lot of this function I rely on the free multi-platform desktop application Calibre. It’s essentially an iTunes-like interface, but it’s built specifically for e-books and other documents.
Within it I maintain a small handful of libraries. One for personal e-books, one for research related textbooks/e-books, and another for journal articles. It has a very solid interface and is extremely flexible in terms of configuration and customization. You can create a large number of custom libraries and create your own searchable and sort-able fields with a huge variety of metadata. It often does a reasonable job of importing e-books, .pdf files, and other digital media and parsing out their meta data which prevents one from needing to do some of that work manually. With some well maintained metadata, one can very quickly search and sort a huge amount of documents as well as quickly prioritize them for action. Additionally, the system does a pretty solid job of converting files from one format to another, so that things like converting an .epub file into a .mobi format for Kindle are automatic.
Calibre stores the physical documents either in local computer storage, or even better, in the cloud using any of a variety of services including Dropbox, OneDrive, etc. so that one can keep one’s documents in the cloud and view them from a variety of locations (home, work, travel, tablet, etc.)
I’ve been a very heavy user of GoodReads.com for years to bookmark and organize my physical and e-book library and anti-libraries. Calibre has an exceptional plugin for GoodReads that syncs data across the two. This (and a few other plugins) are exceptionally good at pulling in missing metadata to minimize the amount that must be done via hand, which can be tedious.
Within Calibre I can manage my physical books, e-books, journal articles, and a huge variety of other document related forms and formats. I can also use it to further triage and order the things I intend to read and order them to the nth degree. My current Calibre libraries have over 10,000 documents in them including over 2,500 textbooks as well as records of most of my 1,000+ physical books. Calibre can also be used to add document data that one would like to ultimately acquire the actual documents, but currently don’t have access to.
BibTeX and reference management
In addition to everything else Calibre also has some well customized pieces for dovetailing all its metadata as a reference management system. It’ll allow one to export data in a variety of formats for document publishing and reference management including BibTex formats amongst many others.
Reading, Annotations, Highlights
Once I’ve winnowed down the material I’m interested in it’s time to start actually reading. I’ll often use Calibre to directly send my documents to my Kindle or other e-reading device, but one can also read them on one’s desktop with a variety of readers, or even from within Calibre itself. With a click or two, I can automatically email documents to my Kindle and Calibre will also auto-format them appropriately before doing so.
Typically I’ll send them to my Kindle which allows me a variety of easy methods for adding highlights and marginalia. Sometimes I’ll read .pdf files via desktop and use Adobe to add highlights and marginalia as well. When I’m done with a .pdf file, I’ll just resave it (with all the additions) back into my Calibre library.
Exporting highlights/marginalia to my website
For Kindle related documents, once I’m finished, I’ll use direct text file export or tools like clippings.io to export my highlights and marginalia for a particular text into simple HTML and import it into my website system along with all my other data. I’ve briefly written about some of this before, though I ought to better document it. All of this then becomes very easily searchable and sort-able for future potential use as well.
Here’s an example of some public notes, highlights, and other marginalia I’ve posted in the past.
Synthesis
Eventually, over time, I’ve built up a huge amount of research related data in my personal online commonplace book that is highly searchable and sortable! I also have the option to make these posts and pages public, private, or even password protected. I can create accounts on my site for collaborators to use and view private material that isn’t publicly available. I can also share posts via social media and use standards like webmention and tools like brid.gy so that comments and interactions with these pieces on platforms like Facebook, Twitter, Google+, and others is imported back to the relevant portions of my site as comments. (I’m doing it with this post, so feel free to try it out yourself by commenting on one of the syndicated copies.)
Now when I’m ready to begin writing something about what I’ve read, I’ve got all the relevant pieces, notes, and metadata in one centralized location on my website. Synthesis becomes much easier. I can even have open drafts of things as I’m reading and begin laying things out there directly if I choose. Because it’s all stored online, it’s imminently available from almost anywhere I can connect to the web. As an example, I used a few portions of this workflow to actually write this post.
Continued work
Naturally, not all of this is static and it continues to improve and evolve over time. In particular, I’m doing continued work on my personal website so that I’m able to own as much of the workflow and data there. Ideally I’d love to have all of the Calibre related piece on my website as well.
Earlier this week I even had conversations about creating new post types on my website related to things that I want to read to potentially better display and document them explicitly. When I can I try to document some of these pieces either here on my own website or on various places on the IndieWeb wiki. In fact, the IndieWeb for Education page might be a good place to start browsing for those interested.
One of the added benefits of having a lot of this data on my own website is that it not only serves as my research/data platform, but it also has the traditional ability to serve as a publishing and distribution platform!
Currently, I’m doing most of my research related work in private or draft form on the back end of my website, so it’s not always publicly available, though I often think I should make more of it public for the value of the aggregation nature it has as well as the benefit it might provide to improving scientific communication. Just think, if you were interested in some of the obscure topics I am and you could have a pre-curated RSS feed of all the things I’ve filtered through piped into your own system… now multiply this across hundreds of thousands of other scientists? Michael Nielsen posts some useful things to his Twitter feed and his website, but what I wouldn’t give to see far more of who and what he’s following, bookmarking, and actually reading? While many might find these minutiae tedious, I guarantee that people in his associated fields would find some serious value in it.
I’ve tried hundreds of other apps and tools over the years, but more often than not, they only cover a small fraction of the necessary moving pieces within a much larger moving apparatus that a working researcher and writer requires. This often means that one is often using dozens of specialized tools upon which there’s a huge duplication of data efforts. It also presumes these tools will be around for more than a few years and allow easy import/export of one’s hard fought for data and time invested in using them.
If you’re aware of something interesting in this space that might be useful, I’m happy to take a look at it. Even if I might not use the service itself, perhaps it’s got a piece of functionality that I can recreate into my own site and workflow somehow?
If you’d like help in building and fleshing out a system similar to the one I’ve outlined above, I’m happy to help do that too.
Related posts
Notes, Highlights, and Marginalia: From E-books to Online
A New Reading Post-type for Bookmarking and Reading Workflow
PressForward as an IndieWeb WordPress-based RSS Feed Reader & Pocket/Instapaper Replacement
Syndicated copies:
Wished for Origin Story: A Big History of Everything by David Christian (Little, Brown and Company)
As many will know, I’m enamored of Christian’s thesis of Big History, so this is going to be a must-read, though I suspect it will be a shorter and more accessible version covering a lot of similar ground to his prior heroic effort Maps of Time.
34.1509556-118.0726671
Vroman’s Bookstore, Hastings Ranch, CaliforniaSyndicated copies to:
Perhaps this example could be a useful model: https://boffosocko.com/2020/02/13/55767168/
The progress portion is coded roughly in HTML with a label as follows:
<ul><li class="bookprogress"><progress value="177" max="465">38%</progress> <label for="">38.0% done; loc 4290-4847 of 12932</label></li>
</ul>
You could always use
<p>or<span>instead oful/litags (with some app specific classes to allow the receiving site to create its own custom CSS for display. Otherwise browsers should be able to display a reasonable visual default.I’d recommend support for pages, percentages finished, and potentially even Amazon’s default location numbers, with the ability to translate back and forth potentially when given at least two of the parameters as a minimum which should allow the calculation of the others. I find in practice that it’s generally pretty rare to have both page numbers and location numbers, but it could happen.
I’ve also got an extended version available at https://boffosocko.com/2012/06/17/big-history/#READING%20PROGRESS
An updated is a post that has been edited by the author.
An updated is a post that has been edited by the author.