Eleven: Bi-directional links or backlinks

The internet allows multi-directional linking of thoughts and ideas.

Backlinks are the new cause célèbre in the broader learning space that uses the names wiki (a communal shared commonplace), digital gardens (personal wikis), and online notebooks & productivity tools like Zettelkasten and products like Notion, Roam Research, Obsidian, Evernote. These are all just variations of the commonplace in digital settings.

#HeyPresstoConf20

A note taking problem and a proposed solution

tl;dr

It’s too painful to quickly get frequent notes into note taking and related platforms. Hypothes.is has an open API and a great UI that can be leveraged to simplify note taking processes.

Note taking tools

I’ve been keeping notes in systems like OneNote and Evernote for ages, but for my memory-related research and work in combination with my commonplace book for the last year, I’ve been alternately using TiddlyWiki (with TiddlyBlink) and WordPress (it’s way more than a blog.)

I’ve also dabbled significantly enough with related systems like Roam Research, Obsidian, Org mode/Org Roam, MediaWiki, DocuWiki, and many others to know what I’m looking for.

Many of these, particularly those that can be used alternately as commonplace books and zettelkasten appeal to me greatly when they include the idea of backlinks. (I’ve been using Webmention to leverage that functionality in WordPress settings, and MediaWiki gives it grudgingly with the “what links to this page” basic functionality that can be leveraged into better transclusion if necessary.)

The major problem with most note taking tools

The final remaining problem I’ve found with almost all of these platforms is being able to quickly and easily get data into them so that I can work with or manipulate it. For me the worst part of note taking is the actual taking of notes. Once I’ve got them, I can do some generally useful things with them—it’s literally the physical method of getting data from a web page, book, or other platform into the actual digital notebook that is the most painful, mindless, and useless thing for me.

Evernote and OneNote

Older note taking services like Evernote and OneNote come with browser bookmarklets or mobile share functionality that make taking notes and extracting data from web sources simple and straightforward. Then once the data is in your notebook you can actually do some work with it. Sadly neither of these services has the backlinking functionality that I find has become de rigueur for my note taking or knowledge wrangling needs.

WordPress

My WordPress solutions are pretty well set since that workflow is entirely web-based and because WordPress has both bookmarklet and Micropub support. There I’m primarily using a variety of feeds and services to format data into a usable form that I can use to ping my Micropub endpoint. The Micropub plugin handles the post and most of the meta data I care about.

It would be great if other web services had support for Micropub this way too, as I could see some massive benefits to MediaWiki, Roam Research, and TiddlyWiki if they had this sort of support. The idea of Micropub has such great potential for great user interfaces. I could also see many of these services modifying projects like Omnibear to extend themselves to create highlighting (quoting) and annotating functionality with a browser extension.

With this said, I’m finding that the user interface piece that I’m missing for almost all of these note taking tools is raw data collection.

I’m not the sort of person whose learning style (or memory) is benefited by writing or typing out notes into my notebooks. I’d far rather just have it magically happen. Even copying and pasting data from a web browser into my digital notebook is a painful and annoying process, especially when you’re reading and collecting/curating as many notes as I tend to. I’d rather be able to highlight, type some thoughts and have it appear in my notebook. This would prevent the flow of my reading, thinking, and short annotations from being subverted by the note collection process.

Different modalities for content consumption and note taking 

Based on my general experience there are only a handful of different spaces where I’m typically making notes.

Reading online

A large portion of my reading these days is done in online settings. From newspapers, magazines, journal articles and more, I’m usually reading them online and taking notes from them there.

.pdf texts

Some texts I want to read (often books and journal articles) only live in .pdf form. While reading them in an app-specific setting has previously been my preference, I’ve taken to reading them from within browsers. I’ll explain why in just a moment, but it has to do with a tool that treats this method the same as the general online modality. I’ll note that most of the .pdf  specific apps have dreadful data export—if any.

Reading e-books (Kindle, e-readers, etc.)

If it’s not online or in .pdf format, I’m usually reading books within a Kindle or other e-reading device. These are usually fairly easy to add highlights, annotations, and notes to. While there are some paid apps that can extract these notes, I don’t find it too difficult to find the raw file and cut and paste the data into my notebook of choice. Once there, going through my notes, reformatting them (if necessary), tagging them and expanding on them is not only relatively straightforward, but it also serves as a simple method for doing a first pass of spaced repetition and review for better long term recall.

Lectures

Naturally taking notes from live lectures, audiobooks, and other spoken events occurs, but more often in these cases, I’m typically able to type them directly into my notebook of preference or I’m using something like my digital Livescribe pen for notes which get converted by OCR and are easy enough to convert in bulk into a digital notebook. I won’t belabor this part further, though if others have quick methods, I’d love to hear them.

Physical books

While I love a physical book 10x more than the next 100 people, I’ve been trying to stay away from them because I find that though they’re easy to highlight, underline, and annotate the margins, it takes too much time and effort (generally useless for memory purposes for me) to transfer these notes into a digital notebook setting. And after all, it’s the time saving piece I’m after here, so my preference is to read in some digital format if at all possible.

A potential solution for most of these modalities

For several years now, I’ve been enamored of the online Hypothes.is annotation tool. It’s open source, allows me reasonable access to my data from the (free) hosted version, and has a simple, beautiful, and fast process for bookmarking, highlighting, and annotating online texts on desktop and mobile. It works exceptionally well for both web pages and when reading .pdf texts within a browser window.

I’ve used it daily to make several thousand annotations on 800+ online web pages and documents. I’m not sure how I managed without it before. It’s the note taking tool I wished I’d always had. It’s a fun and welcome part of my daily life. It does exactly what I want it to and generally stays out of the way otherwise. I love it and recommend it unreservedly. It’s helped me to think more deeply and interact more directly with countless texts.

When reading on desktop or mobile platforms, it’s very simple to tap a browser extension and have all their functionality immediately available. I can quickly highlight a section of a text and their UI pops open to allow me to annotate, tag it, and publish. I feel like it’s even faster than posting something to Twitter. It is fantastically elegant.

The one problem I have with it is that while it’s great for collecting and aggregating my note data into my Hypothes.is account, there’s not much I can do with it once it’s there. It’s missing the notebook functionality some of these other services provide. I wish I could plug all my annotation and highlight content into spaced repetition systems or move it around and modify it within a notebook where it might be more interactive and cross linked for the long term. Sadly I don’t think that any of this sort of functionality is on Hypothes.is’ roadmap any time soon.

There is some great news however! Hypothes.is is open source and has a reasonable API. This portends some exciting things! This means that any of these wiki, zettelkasten, note taking, or spaced repetition services could leverage the UI for collecting data and pipe it into their interfaces for direct use.

As an example, what if I could quickly tell Obsidian to import all my pre-existing and future Hypothes.is data directly into my Obsidian vault for manipulating as notes? (And wouldn’t you know, the small atomic notes I get by highlighting and annotating are just the sort that one would like in a zettelkasten!) What if I could pick and choose specific course-related data from my reading and note taking in Hypothes.is (perhaps by tag or group) for import into Anki to quickly create some flash cards for spaced repetition review? For me, this combination would be my dream application!

These small pieces, loosely joined can provide some awesome opportunities for knowledge workers, students, researchers, and others. The education focused direction that Hypothes.is, many of these note taking platforms, and spaced repetition systems are all facing positions them to make a super-product that we all want and need.

An experiment

So today, as a somewhat limited experiment, I played around with my Hypothes.is atom feed (https://hypothes.is/stream.atom?user=chrisaldrich, because you know you want to subscribe to this) and piped it into IFTTT. Each post creates a new document in a OneDrive file which I can convert to a markdown .md file that can be picked up by my Obsidian client. While I can’t easily get the tags the way I’d like (because they’re not included in the feed) and the formatting is incredibly close, but not quite there, the result is actually quite nice.

Since I can “drop” all my new notes into a particular folder, I can easily process them all at a later date/time if necessary. In fact, I find that the fact that I might want to revisit all my notes to do quick tweaks or adding links or additional thoughts provides the added benefit of a first round of spaced repetition for the notes I took.

Some notes may end up being deleted or reshuffled, but one thing is clear: I’ve never been able to so simply highlight, annotate, and take notes on documents online and get them into my notebook so quickly. And when I want to do something with them, there they are, already sitting in my notebook for manipulation, cross-linking, spaced repetition, and review.

So if the developers of any of these platforms are paying attention, I (and I’m sure others) really can’t wait for plugin integrations using the full power of the Hypothes.is API that allow us to all leverage Hypothes.is’ user interface to make our workflows seamlessly simple.

👓 The tools I use to be productive with ADHD | Paul Jacobson

Read The tools I use to be productive with ADHD by Paul Jacobson (Paul Jacobson)
I just read an article about how many people with ADHD rely on services like Evernote to keep their tendencies to go off chasing squirrels in check long enough to be productive. In honor of #ADHDAwarenessMonth, we asked ADHD coach @takecontroladhd how she takes control of it with Evernote. https://t...

👓 Silence is not necessarily golden for Evernote | Paul Jacobson

Read Silence is not necessarily golden for Evernote by Paul Jacobson (Paul Jacobson)
I’ve been an Evernote user for well over a decade, and I used it daily until a couple years ago. I have almost 29,000 notes (a fair number of these notes are automatically captured using IFTTT workflows). In recent years, Evernote has been pretty quiet on its blog, and while it’s released update...

📑 Building a digital garden | Tom Critchlow

Annotated Building a digital garden by Tom CritchlowTom Critchlow (tomcritchlow.com)

Some other interesting wikis

Credit for inspiration for this whole project comes from a variety of wikis and wiki-like collections on the web:

buster.wiki/ - Strong design and everything has a date by the looks of it which enables an RSS feed. Very polished and thought through.

are.na - A platform that all the cool kids use for building personal knowledge libraries. Lightly social, perhaps the right answer but slightly questionable if they’ll be around for a long time. Ymmv.

Brendan’s /canon - this was part of the original inspiration for me. A curated list of pure stock - things that Brendan returns to again and again. He has a template you can copy too.

Worrydream’s quotes page - just a massive list of interesting quotes collected by Brett Victor. Notice how being one giant page makes it instantly searchable.

daywreckers.com - from Ben Pieratt, not quite a wiki but a very minimal site designed to collect the dots. A daily visit from me.

derek sivers’ daily journal - a post from Derek Sivers on how to keep a text-file long-term store for your ideas and notes.

And there’s lots more too - this twitter thread has a whole bunch of interesting rabbit holes.

And, you can of course find this list of wikis on my wiki :)  

An interesting list here to be sure.

As I’m thinking about it I also have to think about not only my own blog cum commonplace book, but I do also keep a private digital set of structures in OneNote (primarily) as well as some data Evernote which serve a lot of the same functionality.

👓 The Verge at work: backing up your brain | The Verge

Read The Verge at work: backing up your brain (The Verge)
The Verge at Work is a series about process. We’re not scientists, and we’re not gurus, we’re just trying to get some work done. The solutions presented here are highly personal, and highly personalized. Not the only way, but our way. Writing about the history of commonplace books in The New York Review of Books, Robert Darnton notes that readers in early modern England, from the layperson to famous minds like Francis Bacon and John Milton, “read in fits,” moving from book to book, grabbing bites, consuming and rearranging them. They’d transcribe and revisit notable passages in their commonplace books as a way to further comprehend the written word. Darnton writes, “[Reading and writing] belonged to a continuous effort to make sense of things, for the world was full of signs: you could read your way through it; and by keeping an account of your readings, you made a book of your own, one stamped with your personality.” Sixty years ago, Vannevar Bush imagined a hypertext information machine (a memex) in his essay ‘As We May Think’ that would act as an “intimate supplement” to memory. Bush imagined a desk-sized machine for keeping track of a user’s books, records, and communications, tracking what you read and your notes like a modern day version of the commonplace book. Years after reading a book or writing down a note, the user would be able to return to it, tracing written thoughts in “trails” that can be recalled, shared, and stored. “Thus science may implement the ways in which man produces, stores, and consults the record of the race,” Bush wrote, surely unaware of where hypertext would take us.

👓 Evernote lost its CTO, CFO, CPO and HR head in the last month as it eyes another fundraise | TechCrunch

Read Evernote lost its CTO, CFO, CPO and HR head in the last month as it eyes another fundraise (TechCrunch)
Evernote, the productivity app with 225 million users that lets people take notes and organise other files from their working and non-work life, has been on a mission to reset its image as the go-to service for those seeking tools to help themselves be more efficient, years after losing its place a…

👓 Evernote Lost Its CTO, CFO, CPO and HR Head in the Last Month as It Eyes Another Fundraise | Daring Fireball

Read Evernote Lost Its CTO, CFO, CPO and HR Head in the Last Month as It Eyes Another Fundraise (Daring Fireball)
I never took a liking to Evernote. Its origins as a Windows desktop app were always apparent. It had some interesting and powerful features (particularly OCR for signage in photographs — you can search for text in images) but a terrible interface. If you’re still using it, you should look into your export options.

Reply to: little by little, brick by brick

Replied to little by little, brick by brick by Liz Round (historygeek)
After Friday’s rather angsty post about feeling unsettled and unsure about my work … I’m pleased to say that I now feel vastly better. I feel more in control, although little may have changed to the average onlooker!
Thanks for the thoughts here Liz. Somehow I hadn’t heard of ReadCube, but it looks very interesting and incredibly similar to Mendeley‘s set up and functionality. I’ve been using Mendeley for quite a while now and am reasonably happy with it, particularly being able to use their bookmarklet to save things for later and then do reading and annotations within the material. If researchers in your area are using Mendeley’s social features, this is also a potential added benefit, though platforms like Academia and ResearchGate should be explored as well.

Given their disparate functionalities, you may be better off choosing one of Evernote and OneNote and separately Mendeley or ReadCube. Personally I don’t think the four are broadly interchangeable though they may be easier to work with in pairs for their separate functionalities. While I loved Evernote, I have generally gone “all in” on OneNote because it’s much better integrated with the other MS Office tools like email, calendar, and my customized to do lists there.

Another interesting option you may find for sorting/organizing thousands of documents is Calibre e-book management. It works like an iTunes but for e-books, pdfs, etc. If you use it primarily for pdfs, you can save your notes/highlights/marginalia in them directly. Calibre also allows for adding your own meta-data fields and is very extensible. The one thing I haven’t gotten it to do well (yet) is export for citation management, though it does keep and maintain all the meta data for doing so. One of the ways that Mendeley and ReadCube seem to monetize is by selling a subscription for storage so if this is an issue for you, you might consider Calibre as a free alternative.

I’ve been ever working on a better research workflow, but generally prefer to try to use platforms on which I own all the data or it’s easily exportable and then own-able. I use my own website on WordPress as a commonplace book of sorts to capture all of what I’m reading, writing, and thinking about–though much of it is published privately or saved as drafts/pending on the back end of the platform. This seems to work relatively well and makes everything pretty easily searchable for later reference.

Here are some additional posts I’ve written relatively recently which may help your thinking about how to organize things on/within your website if you use it as a research tool:

I’ve also recently done some significant research and come across what I think is the most interesting and forward-thinking WordPress plugin for academic citations on my blog: Academic Blogger’s Toolkit. It’s easily the best thing currently on the market for its skillset.

Another research tool I can’t seem to live without, though it may be more specific to some of the highly technical nature of the math, physics, and engineering I do as well as the conferences/workshops I attend, is my Livescribe.com Pulse pen which I use to take not only copious notes, but to simultaneously record the audio portion of those lectures. The pen and technology link the writing to the audio portion directly so that I can more easily relisten/review over portions which may have been no so clear the first time around. The system also has an optional and inexpensive optical character recognition plugin which can be used for converting handwritten notes into typed text which can be very handy. For just about $200 the system has been one of the best investments I’ve made in the last decade.

If you haven’t come across it yet, I also highly recommend regularly reading the ProfHacker blog of the Chronicle of Higher Education which often has useful tips and tools for academic research use. They also do a very good job of covering some of the though in the digital humanities which you might find appealing.