How to follow the complete output of journalists and other writers?

In a digital era with a seemingly ever-decreasing number of larger news outlets paying journalists and other writers for their work, the number of working writers who find themselves working for one or more outlets is rapidly increasing. 

This is sure to leave journalists wondering how to better serve their own personal brand either when they leave a major publication for which they’ve long held an association (examples: Walt Mossberg leaving The New York Times or Leon Wieseltier leaving The New Republic)  or alternatively when they’re just starting out and writing for fifty publications and attempting to build a bigger personal following for their work which appears in many locations (examples include nearly everyone out there).

Increasingly I find myself doing insane things to try to follow the content of writers I love. The required gymnastics are increasingly complex to try to track writers across hundreds of different outlets and dozens of social media sites and other platforms (filtering out unwanted results is particularly irksome). One might think that in our current digital media society, it would be easy to find all the writing output of a professional writer like Ta-nehisi Coates, for example, in one centralized place.

I’m also far from the only one. In fact, I recently came across this note by Kevin:

I wish there was a way to subscribe to writers the same way you can use RSS. Obviously twitter gets you the closest, but usually a whole lot more than just the articles they’ve written. It would be awesome if every time Danny Chau or Wesley Morris published a piece I’d know.

The subsequent conversation in his comments or  on Micro.blog (a fairly digital savvy crowd) was less than heartening for further ideas.

As Kevin intimates, most writers and journalists are on Twitter because that’s where a lot of the attention is. But sadly Twitter can be a caustic and toxic place for many. It also means sifting through a lot of intermediary tweets to get to the few a week that are the actual work product articles that one wants to read. This also presumes that one’s favorite writer is on Twitter, still using Twitter, or hasn’t left because they feel it’s a time suck or because of abuse, threats, or other issues (examples: Ta-Nehisi Coates, Lindy West, Sherman Alexie). 

What does the universe of potential solutions for this problem currently look like?

Potential Solutions

Aggregators

One might think that an aggregation platform like Muck Rack which is trying to get journalists to use their service and touts itself as “The easiest, unlimited way to build your portfolio, grow your following and quantify your impact—for free” might provide journalists the ability to easily import their content via RSS feeds and then provide those same feeds back out so that their readers/fans could subscribe to them easily. How exactly are they delivering on that promise to writers to “grow your following”?!

An illustrative example I’ve found on Muck Rack is Ryan O’Hanlon, a Los Angeles-based writer, who writes for  a variety of outlets including The Guardian, The New York Times, ESPN, BuzzFeed, ESPN Deportes, Salon, ESPN Brasil, FiveThirtyEight, The Ringer, and others. As of today they’ve got 410 of his articles archived and linked there. Sadly, there’s no way for a fan of his work to follow him there. Even if the site provided an RSS feed of titles and synopses that forced one to read his work on the original outlet, that would be a big win for readers, for Ryan, and for the outlets he’s writing for–not to mention a big win for Muck Rack and their promise.

I’m sure there have to be a dozen or so other aggregation sites like Muck Rack hiding out there doing something similar, but I’ve yet to find the real tool for which I’m looking. And if that tool exists, it’s poorly distributed and unlikely to help me for 80% of the writers I’m interested in following much less 5%.

Author Controlled Websites

Possibly the best choice for everyone involved would be for writers to have their own websites where they archive their own written work and provide a centralized portfolio for their fans and readers to follow them regardless of where they go or which outlet they’re writing for. They could keep their full pieces privately on the back end, but give titles, names of outlets, photos, and synopses on their sites with links back to the original as traditional blog posts. This pushes the eyeballs towards the outlets that are paying their bills while still allowing their fans to easily follow everything they’re writing. Best of all the writer could own and control it all from soup to nuts.

If I were a journalist doing this on the cheap and didn’t want it to become a timesuck, I’d probably spin up a simple WordPress website and use the excellent and well-documented PressForward project/plugin to completely archive and aggregate my published work, but use their awesome forwarding functionality so that those visiting the URLs of the individual pieces would be automatically redirected to the original outlet. This is a great benefit for writers many of whom know the pain of having written for outlets that have gone out of business, been bought out, or even completely disappeared from the web. 

Of course, from a website, it’s relatively easy to automatically cross-post your work to any number of other social platforms to notify the masses if necessary, but at least there is one canonical and centralized place to find a writer’s proverbial “meat and potatoes”. If you’re not doing something like this at a minimum, you’re just making it hard for your fans and failing at the very basics of building your own brand, which in part is to get even more readers. (Hint, the more readers and fans you’ve got, the more eyeballs you bring to the outlets you’re writing for, and in a market economy built on clicks, more eyeballs means more traffic, which means more money in the writer’s pocket. Since a portion of the web traffic would be going through an author’s website, they’ll have at least a proportional idea of how many eyeballs they’re pushing.)

I can’t help but point out that even some who have set up their own websites aren’t quite doing any of this right or even well. We can look back at Ryan O’Hanlon above with a website at https://www.ryanwohanlon.com/. Sadly he’s obviously let the domain registration lapse, and it has been taken over by a company selling shoes. We can compare this with the slight step up that Mssr. Coates has made by not only owning his own domain and having an informative website featuring his books, but alas there’s not even a link to his work for The Atlantic or any other writing anywhere else. Devastatingly his RSS feed isn’t linked, but if you manage to find it on his website, you’ll be less-than-enthralled by three posts of Lorem ipsum from 2017. Ugh! What has the world devolved to? (I can only suspect that his website is run by his publisher who cares about the book revenue and can’t be bothered to update his homepage with events that are now long past.)

Examples of some journalists/writers who are doing some interesting work, experimentation, or making an effort in this area include: Richard MacManus,  Marina Gerner, Dan Gillmor, Jay RosenBill Bennett, Jeff JarvisAram Zucker-Scharff, and Tim Harford

One of my favorite examples is John Naughton who writes a regular column for the Guardian. He has his own site where he posts links, quotes, what he’s reading, his commentary, and quotes of his long form writing elsewhere along with links to full pieces on those sites. I have no problem following some or all of his output there since his (WordPress-based) site has individual feeds for either small portions or all of it. (I’ve also written a short case study on Ms. Gerner’s site in the past as well.)

Newsletters

Before anyone says, “What about their newsletters?” I’ll admit that both O’Hanlon and Coates both have newsletters, but what’s to guarantee that they’re doing a better job of pushing all of their content though those outlets? Most of my experience with newsletters would indicate that’s definitely not the case with most writers, and again, not all writers are going to have newsletters, which seem to be the flavor-of-the month in terms of media distribution. What are we to do when newsletters are passé in 6 months? (If you don’t believe me, just recall the parable of all the magazines and writers that moved from their own websites or Tumblr to Medium.com.)

Tangential projects

I’m aware of some one-off tools that come close to the sort of notifications of writers’ work that might be leveraged or modified into a bigger tool or stand alone platform. Still, most of these are simple uni-taskers and only fix small portions of the overall problem.

Extra Extra

Savemy.News

Ben Walsh of the Los Angeles Times Data Desk has created a simple web interface at www.SaveMy.News that journalists can use to quickly archive their stories to the Internet Archive and WebCite. One can log into the service via Twitter and later download a .csv file with a running list of all their works with links to the archived copies. Adding on some functionality to add feeds and make them discoverable to a tool like this could be a boon.

Granary

Ryan Barrett has a fantastic open source tool called Granary that “Fetches and converts data between social networks, HTML and JSON with microformats2, ActivityStreams 1 and 2, AtomRSSJSON Feed, and more.” This could be a solid piece of a bigger process that pulls from multiple sources, converts them into a common format, and outputs them in a single subscribe-able location.

Splash page image and social logos from Granary.io

SubToMe

A big problem that has pushed us away from RSS and other formatted feed readers is providing an easy method of subscribing to content. Want to follow someone on Twitter? Just click a button and go. Wishing it were similar for a variety of feed types, Julien Genestoux‘s SubToMe has created a universal follow button that allows a one-click subscription option (with lots of flexibility and even bookmarklets) for following content feeds on the open web.

Splash image on SubToMe's home page

Others?

Have you seen any other writers/technologists who have solved this problem? Are there aggregation platforms that solve the problem in reverse? Small pieces that could be loosely joined into a better solution? What else am I missing?

How can we encourage more writers to take this work into their own hands to provide a cleaner solution for their audiences? Isn’t it in their own best interest to help their readers find their work?

I’ve curated portions of a journalism page on  IndieWeb wiki to include some useful examples, pointers, and resources that may help in solving portions of this problem. Other ideas and solutions are most welcome!

Owning my RSVP’s from Meetup.com using IFTTT and Webhooks to a Micropub endpoint

It’s a slightly circuitous set up and I may find a better way to do it eventually, but last night I was tinkering at a way to better own my RSVPs from Meetup.com. Previously it has been a completely manual set up, but it’s something I do often enough that the hour long investment was more than worth it. (I specifically want to own my data here because I’m hedging my bets for what ends up happening with Meetup.com in a post-WeWork bankrupcy world.)

Since I’ve been adding PESOS workflows using the Micropub endpoint on my website lately, I tried setting up a direct ping using IFTTT.com from the RSS feed from Meetup. Sadly the timestamps on that feed are not of the time that I RSVP’d, but the time the event was published. As a result the trigger seems like it would never actually fire to make a post. I also thought about taking a feed of all the events of the groups I’m a member of and feed that in, but alas, that feed doesn’t seem to exist. If that were possible, then I could create drafts of the data and then RSVP as yes, no, maybe, etc. for each of them in a slightly more manual (and thoughtful) way, but I’d also have the benefit of seeing all the notifications for everything pop up in my own website.

Since I always immediately add my RSVP’s from Meetup.com directly to my Google Calendar anyway, I thought I’d use that as the data source and trigger mechanism instead, and lo and behold! It works!

Now I can quickly RSVP via Meetup.com, use their interface to add the event to my Google Calendar, leverage IFTTT.com’s Webhook to send a Micropub request to my endpoint, and I’ve got an RSVP post with all the details on my website! It also cleverly creates syndication links on my posts as well.

Perhaps I could now use some of the infrastructure to create an upcoming events widget in a sidebar, to the home page of my site, or even on my neglected /Now page?

Since this Webhook to Micropub process is something I’ve been working on a bit, I’ll soon have a post with a step-by-step set up and an example or two of how it works, so that others can implement it too. I’ve been using it for read posts, listen posts, watches, and even for creating annotation posts on my site. Depending on the data source, some of the process can still have some manual portions, but at least I’m getting all the data I’d like to have.

Home

55 °F haze

Read Converting Webmentions to Push Notifications by Jamie TannaJamie Tanna (jvt.me)
Automagically sending push notifications to my mobile phone when I receive a Webmention.
I hadn’t thought about it before, but this seems like a nice real-time feature. Since I have an RSS feed for comments on my website, I’ve just thrown that into IFTTT with workflow that takes new feed items and then sends me a Pushbullet notification.

Cleaning up feeds, easier social following, and feed readers

I’ve been doing a bit of clean up in my feed reader(s)–cleaning out dead feeds, fixing broken ones, etc. I thought I’d take a quick peek at some of the feeds I’m pushing out as well. I remember doing some serious updates on the feeds my site advertises three years ago this week, but it’s been a while since I’ve revisited it. While every post kind/type, category, and tag on my site has a feed (often found by simply adding /feed/ to the end of those URLs), I’ve made a few custom feeds for aggregated content.

However, knowing that some feeds are broadly available from my site isn’t always either obvious or the same as being able to use them easily–one might think of it as a(n) (technical) accessibility problem. I thought I’d make a few tweaks to smooth out that user interface and hopefully provide a better user experience–especially since I’m publishing everything from my website first rather than in 30 different places online (which is a whole other UI problem for those wishing to follow me and my content). Since most pages on my site have a “Follow Me” button (courtesy of SubToMe), I just needed to have a list of generally useful feeds to provide it. While SubToMe has some instructions for suggesting lists of feeds, I’ve never gotten it to work the way I expected (or feed readers didn’t respect it, I’m not sure which?) But since most feed readers have feed discovery built in as a feature, I thought I’d leverage that aspect. Thus I threw into the <head> of my website a dozen or so links from some of the most typical feeds people may be most interested in from my site. Now you can click on the follow button, choose your favorite feed reader, and then your reader should provide you with a large list of feeds which you might want to subscribe. These now broadly include the full feed, a comments feed, feeds for all the individual kinds (bookmarks, likes, favorites, replies, listens, etc.) but potentially more useful: a “microblog feed” of all my status-related updates and a “linkblog feed” for all my link-related updates (generally favorites, likes, reads, and bookmarks).

Some of these sub-feeds may be useful in some feed readers which don’t yet have the ability for you to choose within the reader what you’d like to see. I suspect that in the future social readers will allow you to subscribe to my primary firehose or comments feeds, which are putting out about 85 and 125 posts a week right now, and you’ll be able to subscribe to those, but then within their interface be able to choose individual types by means of filters to more quickly see what I’ve been bookmarking, reading, listening to or watching. Then if you want to curl up with some longer reads, filter by articles; or if you just want some quick hits, filter by notes. And of course naturally you’ll be able to do this sort of filtering across your network too. I also suspect some of them will build in velocity filters and friend-proximity filters so that you’ll be able to see material from people who don’t post as often highlighted or to see people’s content based on your personal rankings or categories (math friends, knitting circle, family, reading group, IndieWeb community, book club, etc.). I’ve recently been enjoying Kicks Condor’s FraidyCat reader which touches on some of this work though it’s not what most people would consider a full-featured feed reader but might think of as a filter/reader dashboard sort of product.

Perhaps sometime in the future I’ll write a bit of code so that each individual page on my site that you visit will provide feeds in the header for all the particular categories, tags, and post kinds that appear on that page?That might make a clever, and simple little plugin, though honestly that’s the sort of code I would expect CMSes like WordPress to provide out of the box. Of course, perhaps broader adoption of microformats and clever readers will obviate the need for all these bits?

 

I love that Charlie provides a wealth of different things you can subscribe to from her website. My favorite is not just her “firehose”, but how she describes it in her code:

<link data-react-helmet="true" 
rel="alternate" 
type="application/rss+xml" 
title="Subscribe to everything (and I mean EVERYTHING - it is a fucking firehose)" 
href="https://www.sonniesedge.net/rss/everything.xml"/>

I wish more people provided multiple custom feeds for the content on their websites. 

In Charlie’s case, I vote for  subscribing to EVERYTHING!

On the caustic focus on temporality in social media

In thinking about the temporality of social media, I’ve realize that sites like Twitter and Facebook focus incredibly hard on the here-and-now. At best you may get a few posts that go back a day or two when reading. I find it’s very rare that anyone is interacting with my tweets from 2010 or 2013, and typically when those are being liked, it’s by bots trying to give themselves a history.

We’re being trained to dip our toes into a rapidly flowing river and not focus on deeper ideas and thoughts or reflect on longer pieces further back in our history.

On the other hand, reading more and more from my variety of feed readers, I realize that on the broader web, I’m seeing people linking to and I’m also reading much older blog posts. In the last few days alone I’ve seen serious longform material from 2001, 2005, 2006, 2011, and 2018 just a few minutes ago.

The only time I see long tail content on Twitter is when someone has it pinned to the top of their page.

Taking this a level deeper, social is thereby forcing us to not only think shallowly, but to make our shared histories completely valueless. This is allowing some to cry fake news and rewrite history and make it easier for their proponents to consume it and believe it all. Who cares about the scandals and problems of yesterday when tomorrow will assuredly be better? And then we read the next Twitter-based treat and start the cycle all over again. 

Read Publicly Sharing RSS Libraries i.e. My RSS Feeds are Yours by Kevin SmoklerKevin Smokler (Kevin Smokler)

Inspired by Matt Haughey’s public posting of the RSS Feeds he subscribes to, I’m doing the same (below).

What is RSS, you ask? A method to subscribe to what your favorite websites publish and have their updates all in a single place. Think of it as DVR for the Internet, food delivery instead of pickup except for the web. Podcasts would on the same technology and concept: Subscribe once, receive forever without asking again.

Lately though, its been making a bit of a comeback. Idea being that self-selecting your daily information diet (see: No Trump-loving-creepy-brothers-in-laws) probably means less unwilling toxicity and restless nights of non-sleep.

–highlighted December 08, 2019 at 04:26PM

This is the third time I’ve heard about RSS coming back in almost as many days, and this not long after highlighting some recent advancements in feed readers. (One of the others was Jeremy Keith at this weekend’s IndieWebCamp in San Francisco.) Kevin highlights a fantastic reason why using a feed reader can be important and more healthy than relying on the social aggregation algorithms in your not-so-friendly-neighborhood social media platforms.

Like Kevin and Matt, I think it’s a nice thing to share one’s sources and feeds. A while back I created a following page where I share a huge list of the people and sources I’m following regularly via RSS feeds, Atom Feeds, JSONFeed, and even h-feed. Everytime I follow or unfollow a source, the page auto-updates. I also provide OPML files (at the bottom of that page) so you can import them into your own feed reader. If you’re using a feed reader like Inoreader that supports OPML subscription, you can input the OPML file location and your copy of my feeds will automatically update when I make changes.

Happy reading!

Replied to The Only Way to Beat Algorithms is to Retrain Your Audience | KIRISKA.com by Y. Kiri Yu 余依笛 (KIRISKA.com)
The only way to beat social media algorithms is to get your audience off social media. Put your work on your own site. Retrain them to follow via RSS.
Small little tools like SubToMe.com might help a bit on the RSS/following front. Making the user interface simple and elegant will pull people back in to a healthier web.

I typically post all of my replies on my own website anyway, but I’ve discovered that the comment functionality on your blog isn’t working. 

Read Blog Diet: A Starter List For Your RSS Reader by Warren EllisWarren Ellis (WARREN ELLIS LTD)
People keep asking me where I find stuff, or where to start with an RSS reader. I exported my subscruptions, and damn, there are a LOT of dead blogs out there. Here is a selection of blogs from the list of ones I think are still active. Like I say, it’s just a bit of my active subscriptions list, but maybe you’ll find something you want to follow.
Thanks Warren for curating an interesting list here. I recognize a handful of great sites, including ribbon farm which makes the list twice. Can’t wait to take a look at some of the ones I don’t follow regularly. I do wish there was an OPML version of the list I could subscribe to though.

hat tip: Kicks Condor, who coincidentally highlighted this list in his most recent HREFHUNT post (2019-11-11). Kudos to Kicks for also being included in the list itself!