A note taking problem and a proposed solution

tl;dr

It’s too painful to quickly get frequent notes into note taking and related platforms. Hypothes.is has an open API and a great UI that can be leveraged to simplify note taking processes.

Note taking tools

I’ve been keeping notes in systems like OneNote and Evernote for ages, but for my memory-related research and work in combination with my commonplace book for the last year, I’ve been alternately using TiddlyWiki (with TiddlyBlink) and WordPress (it’s way more than a blog.)

I’ve also dabbled significantly enough with related systems like Roam Research, Obsidian, Org mode/Org Roam, MediaWiki, DocuWiki, and many others to know what I’m looking for.

Many of these, particularly those that can be used alternately as commonplace books and zettelkasten appeal to me greatly when they include the idea of backlinks. (I’ve been using Webmention to leverage that functionality in WordPress settings, and MediaWiki gives it grudgingly with the “what links to this page” basic functionality that can be leveraged into better transclusion if necessary.)

The major problem with most note taking tools

The final remaining problem I’ve found with almost all of these platforms is being able to quickly and easily get data into them so that I can work with or manipulate it. For me the worst part of note taking is the actual taking of notes. Once I’ve got them, I can do some generally useful things with them—it’s literally the physical method of getting data from a web page, book, or other platform into the actual digital notebook that is the most painful, mindless, and useless thing for me.

Evernote and OneNote

Older note taking services like Evernote and OneNote come with browser bookmarklets or mobile share functionality that make taking notes and extracting data from web sources simple and straightforward. Then once the data is in your notebook you can actually do some work with it. Sadly neither of these services has the backlinking functionality that I find has become de rigueur for my note taking or knowledge wrangling needs.

WordPress

My WordPress solutions are pretty well set since that workflow is entirely web-based and because WordPress has both bookmarklet and Micropub support. There I’m primarily using a variety of feeds and services to format data into a usable form that I can use to ping my Micropub endpoint. The Micropub plugin handles the post and most of the meta data I care about.

It would be great if other web services had support for Micropub this way too, as I could see some massive benefits to MediaWiki, Roam Research, and TiddlyWiki if they had this sort of support. The idea of Micropub has such great potential for great user interfaces. I could also see many of these services modifying projects like Omnibear to extend themselves to create highlighting (quoting) and annotating functionality with a browser extension.

With this said, I’m finding that the user interface piece that I’m missing for almost all of these note taking tools is raw data collection.

I’m not the sort of person whose learning style (or memory) is benefited by writing or typing out notes into my notebooks. I’d far rather just have it magically happen. Even copying and pasting data from a web browser into my digital notebook is a painful and annoying process, especially when you’re reading and collecting/curating as many notes as I tend to. I’d rather be able to highlight, type some thoughts and have it appear in my notebook. This would prevent the flow of my reading, thinking, and short annotations from being subverted by the note collection process.

Different modalities for content consumption and note taking 

Based on my general experience there are only a handful of different spaces where I’m typically making notes.

Reading online

A large portion of my reading these days is done in online settings. From newspapers, magazines, journal articles and more, I’m usually reading them online and taking notes from them there.

.pdf texts

Some texts I want to read (often books and journal articles) only live in .pdf form. While reading them in an app-specific setting has previously been my preference, I’ve taken to reading them from within browsers. I’ll explain why in just a moment, but it has to do with a tool that treats this method the same as the general online modality. I’ll note that most of the .pdf  specific apps have dreadful data export—if any.

Reading e-books (Kindle, e-readers, etc.)

If it’s not online or in .pdf format, I’m usually reading books within a Kindle or other e-reading device. These are usually fairly easy to add highlights, annotations, and notes to. While there are some paid apps that can extract these notes, I don’t find it too difficult to find the raw file and cut and paste the data into my notebook of choice. Once there, going through my notes, reformatting them (if necessary), tagging them and expanding on them is not only relatively straightforward, but it also serves as a simple method for doing a first pass of spaced repetition and review for better long term recall.

Lectures

Naturally taking notes from live lectures, audiobooks, and other spoken events occurs, but more often in these cases, I’m typically able to type them directly into my notebook of preference or I’m using something like my digital Livescribe pen for notes which get converted by OCR and are easy enough to convert in bulk into a digital notebook. I won’t belabor this part further, though if others have quick methods, I’d love to hear them.

Physical books

While I love a physical book 10x more than the next 100 people, I’ve been trying to stay away from them because I find that though they’re easy to highlight, underline, and annotate the margins, it takes too much time and effort (generally useless for memory purposes for me) to transfer these notes into a digital notebook setting. And after all, it’s the time saving piece I’m after here, so my preference is to read in some digital format if at all possible.

A potential solution for most of these modalities

For several years now, I’ve been enamored of the online Hypothes.is annotation tool. It’s open source, allows me reasonable access to my data from the (free) hosted version, and has a simple, beautiful, and fast process for bookmarking, highlighting, and annotating online texts on desktop and mobile. It works exceptionally well for both web pages and when reading .pdf texts within a browser window.

I’ve used it daily to make several thousand annotations on 800+ online web pages and documents. I’m not sure how I managed without it before. It’s the note taking tool I wished I’d always had. It’s a fun and welcome part of my daily life. It does exactly what I want it to and generally stays out of the way otherwise. I love it and recommend it unreservedly. It’s helped me to think more deeply and interact more directly with countless texts.

When reading on desktop or mobile platforms, it’s very simple to tap a browser extension and have all their functionality immediately available. I can quickly highlight a section of a text and their UI pops open to allow me to annotate, tag it, and publish. I feel like it’s even faster than posting something to Twitter. It is fantastically elegant.

The one problem I have with it is that while it’s great for collecting and aggregating my note data into my Hypothes.is account, there’s not much I can do with it once it’s there. It’s missing the notebook functionality some of these other services provide. I wish I could plug all my annotation and highlight content into spaced repetition systems or move it around and modify it within a notebook where it might be more interactive and cross linked for the long term. Sadly I don’t think that any of this sort of functionality is on Hypothes.is’ roadmap any time soon.

There is some great news however! Hypothes.is is open source and has a reasonable API. This portends some exciting things! This means that any of these wiki, zettelkasten, note taking, or spaced repetition services could leverage the UI for collecting data and pipe it into their interfaces for direct use.

As an example, what if I could quickly tell Obsidian to import all my pre-existing and future Hypothes.is data directly into my Obsidian vault for manipulating as notes? (And wouldn’t you know, the small atomic notes I get by highlighting and annotating are just the sort that one would like in a zettelkasten!) What if I could pick and choose specific course-related data from my reading and note taking in Hypothes.is (perhaps by tag or group) for import into Anki to quickly create some flash cards for spaced repetition review? For me, this combination would be my dream application!

These small pieces, loosely joined can provide some awesome opportunities for knowledge workers, students, researchers, and others. The education focused direction that Hypothes.is, many of these note taking platforms, and spaced repetition systems are all facing positions them to make a super-product that we all want and need.

An experiment

So today, as a somewhat limited experiment, I played around with my Hypothes.is atom feed (https://hypothes.is/stream.atom?user=chrisaldrich, because you know you want to subscribe to this) and piped it into IFTTT. Each post creates a new document in a OneDrive file which I can convert to a markdown .md file that can be picked up by my Obsidian client. While I can’t easily get the tags the way I’d like (because they’re not included in the feed) and the formatting is incredibly close, but not quite there, the result is actually quite nice.

Since I can “drop” all my new notes into a particular folder, I can easily process them all at a later date/time if necessary. In fact, I find that the fact that I might want to revisit all my notes to do quick tweaks or adding links or additional thoughts provides the added benefit of a first round of spaced repetition for the notes I took.

Some notes may end up being deleted or reshuffled, but one thing is clear: I’ve never been able to so simply highlight, annotate, and take notes on documents online and get them into my notebook so quickly. And when I want to do something with them, there they are, already sitting in my notebook for manipulation, cross-linking, spaced repetition, and review.

So if the developers of any of these platforms are paying attention, I (and I’m sure others) really can’t wait for plugin integrations using the full power of the Hypothes.is API that allow us to all leverage Hypothes.is’ user interface to make our workflows seamlessly simple.

Replied to Hey Pressto! Conference 2020 Submissions (2020.heypresstoconf.org)
Hello, it’s great you want to submit. Any issues please contact us. If you’d like help with your idea, feel free to contact us too. We want to help. You have until Midnight on September the 3rd to submit your idea

Using WordPress as a Digital Commonplace Book

A personal website is more than a blog. Rather than spread my digital identity & data across social media, I keep it in one spot for (re)search & re-use. I’ll show how my site is an evolution of the Renaissance era commonplace book, digital garden, second brain, or zettelkasten.

Replied to a thread (Twitter)
Niklas Luhmann’s idea of Zettelkasten impinges on some of this, but for a deep dive on how indigenous cultures all over the world did this in a pre-industrial setting look at Dr. Lynne Kelly‘s work. Specifically: Knowledge and Power in Prehistoric Societies: Orality, Memory, and the Transmission of Culture (Cambridge University Press, 2015) and When knowledge was power (2012, Latrobe University, PhD thesis). She’s got a fantastic bibliography on her website as well.

Her TED talk shows quickly how she did something similar, but with birds and bird identification. Her work has examples of how many other cultures did this as well.

Read A garden with a water feature by Jeremy CherfasJeremy Cherfas (jeremycherfas.net)
People have written some interesting things following on from the pop-up IndieWebCamp that Chris Aldrich organised a couple of weeks ago. The Garden and the Stream set out to compare and contrast wikis and weblogs and how the two might be used. It was a terrific success, and I’m sorry I wasn’t a...

Nevertheless, the very fact that I am going through my notes reflects a new habit I am trying to build, of setting time aside every week, and sometimes more often, deliberately to tend the oldest notes I have and the notes I created or edited in the past week. Old notes take longer, because I have to check old links and decide what to do if they have rotted away. Those notes also need to be reshaped in line with zettelkasten principles. That means deciding on primary tags, considering internal links, splitting the atoms of long notes and so on. At times it frustrates me, but when it goes well I do see structure emerging and with it new thoughts and new directions to follow. 

This is reminiscent of the idea that indigenous peoples regularly met at annual feasts to not only celebrate, but to review over their memory palaces and perform their rituals as a means of reviewing and strengthening their memories and ideas.
Annotated on May 09, 2020 at 07:17AM

Read Create Zettel from Reading Notes According to the Principle of Atomicity (Zettelkasten Method)
I separate collecting from processing because I don’t hack everything that pops up in my mind while I read a text into my computer. Instead, I take notes on paper.

Creativity is just connecting things. When you ask creative people how they did something, they feel a little guilty because they didn’t really do it, they just saw something. It seemed obvious to them after a while.
—Steve Jobs (via lifehacker and Zettel no. 201308301352) 

in other words, it’s just statistical thermodynamics. Eventually small pieces will float by each other and stick together in new and hopefully interesting ways. The more particles you’ve got and the more you can potentially connect or link things, the better off you’ll be.
Annotated on March 23, 2020 at 04:36PM

As I’ve been reading about Zettlekasten for part of the evening, it dawns on me that there are some likely overlaps with both my prior work on statistical mechanics and ideas of mnemonics and techniques like the method of loci. I’ll have to think of how to better memorize and specifically tag pieces of information into such a mental Zettlekasten. I wonder what might evolve?
Read The Two Forms of a Zettel (Zettelkasten Method)
In this post I try to dig into the nature of a Zettel. When philosophers speak about the nature of something they refer to its most basic qualities. If you substract one of those you would have something different.

I’ll construct two forms of a Zettel:
The Outer Form
The Inner Form
The outer form refers to entities that are necessary for its existence.
The inner form refers to entities that compose its inner structure. 

Annotated on March 23, 2020 at 05:16PM

Read The Difference Between Good and Bad Tags (Zettelkasten Method)
When I search in my archive for the tag #diet I get really annoying results. I don’t only get notes on diet. I get notes on carbohydrates, insulin sensitivity and many other. “Why is that a problem?”, you might ask. “All the above topics are relevant for diet, aren’t they?” No, and here is why.

There are two different types of tags:
Tags for topics. You use tags to group notes under a topic.
Tags for objects. You use tags to group notes around an object, real or conceptual. 

Annotated on March 23, 2020 at 05:06PM

The tags for objects are much more precise and reveal real connections. They narrow down the search way more which is hugely important if your archive grows. They only give you what you want, and not the topic which also contains what you want. 

Annotated on March 23, 2020 at 05:07PM

Read Different Kinds of Ties Between Notes (Zettelkasten Method)
After the awesome discussion of Sascha’s latest blog post, I meditated about all the different kinds of ties between notes. Here’s what I came up with.

You can translate “Folgezettel” (literally: “subsequent note”) as “note sequence”. 

Annotated on March 23, 2020 at 04:47PM

Our brain can only hold to so much information at a time. 

of course this is why I like mnemonics and specific techniques like the method of loci. We can not only retain more but the memories can be stored in interesting ways that increase their potentially creativity like creating a Zettelkasten in the brain.
Annotated on March 23, 2020 at 04:53PM

Read Create Zettel from Reading Notes According to the Principle of Atomicity (Zettelkasten Method)
As I said in my last post, my reading workflow consists of GTD-like phases: collect, process and write. While I wrote about collecting before, this post is about the three phases of processing notes. In the last section you’ll find a few example Zettels I wrote.
Read Overview: Zettelkasten Method (zettelkasten.de)

Using a Zettelkasten is about optimizing a workflow of learning and producing knowledge. The products are texts, mostly. The categories we find fit the process well at the moment are the following:

Knowledge Management: general information about what it means to work and learn efficiently.
Writing: posts on the production of lasting knowledge, and about sharing it with others through your own texts.
Reading: posts about the process of acquisition of new things and the organization of sources.

👓 Ponderance 8/6 – EDU 522 | Cooper Kean

Read Ponderance 8/6 by Cooper Kean (mrkean.com)
I am still working out the kinks of the Hypothes.is website, so i had trouble connecting my reading to my annotations, (I had made a hard copy in a lined notebook to feel like I had stepped back in time). I think there is a very big difference between free reading and reading for a purpose. In my cl...

Highlights, Quotes, Annotations, & Marginalia

I believe, and I try to emphasize to the students, that annotation is a deeply personal activity, my annotations may look different from yours because we think differently.  

We often think differently even on different readings. Sometimes upon re-reading pieces, I’ll find and annotate completely different things than I would have on the first pass. Sometimes (often with more experience and new eyes) I’ll even disagree with what I’d written on prior passes.

This process reminds me a bit of the Barbell Method of Reading
August 06, 2018 at 04:39PM

They did that to the point where  there were more asterisks on the page than stars in the sky. Despite all this, the annotations did not mean anything to the students.  

Keeping in mind that different people learn in different ways, there’s another possible way of looking at this.

Some people learn better aurally than visually. Some remember things better by writing them down. I know a few synaesthetes who likely might learn better by using various highlighting colors. Perhaps those who highlight everything are actually helping their own brains to learn by doing this?

This said, I myself still don’t understand people who are highlighting everything in their books this way. I suspect that some are just trying and imitating what they’ve seen before and just haven’t learned to read and annotate actively.

Helping students to discover how they best learn can be a great hurdle to cross, particularly at a young age. Of course, this being said, we also need to help them exercise the other modalities and pathways to help make them more well-rounded and understanding as well.
August 06, 2018 at 04:47PM

👓 The Barbell Method of Reading | Zettelkasten Method

Read The Barbell Method of Reading (Zettelkasten Method)
Our reading habit is one of the corner stones of our knowledge work habits. Reading is the most efficient way to create an influx of information that can transform into knowledge. Therefore, we should devote some thought and energy in the optimization of our reading habits. One decision we have to make is whether to read fast or thorough. Yes, this is a decision. There are a couple of techniques that could enhance your reading speed and don’t decrease comprehension. But most of the so-called “speed reading” techniques either decrease comprehension for the sake of speed or even involve skipping large parts of the text.