How to Own & Display Your Twitter Archive on Your Website in Under 10 Minutes

As part of my evolving IndieWeb experience of owning all of my own internet-based social data, last year I wanted a “quick and dirty” method for owning and displaying all of my Twitter activity before embarking on a more comprehensive method of owning all of my past tweets in a much more comprehensive way. I expected even a quick method to be far harder than the ten minute operation it turned out to be.

Back in early October, I had also replied to a great post by Jay Rosen when he redesigned his own blog PressThink. I saw a brief response from him on Twitter at the time, but didn’t get a notification from him about his slightly longer reply, which I just saw over the weekend:

I don’t like the way tweets displayed on a blog look. I am fussy about that. Would I like to have a searchable archive in my possession so I don’t lose it all when Twitter goes under? I would.

Jay Rosen, journalism professor NYU,
in reply to my comment on PressThink’s new design and third space

 

So, for his benefit as well as others who are interested in the ability to do something like this quickly and easily, I thought I’d write up a short outline of what I’d originally done so that  without spending all the time I did, others can do the same or something similar depending on their needs.

If part of Mr. Rosen’s reply doesn’t give you enough motivation for why one would want to do this, IndieWeb.org has a laundry list of motivations along with a list of dead and defunct sites and social media silos that have taken pedabytes of data with them when they died.

How to (Quickly) Own and Display Your Tweets on Your Own Site

Download all your tweets

  1. Go to: https://twitter.com/settings/account
  2. Near the bottom of the page you should see a “Your Twitter archive” section
  3. See the Request your archive button? Click it.
  4. After a (hopefully) short wait, a link to your archive should show up in your email associated with the account. Download it.
  5. Congratulations, you now own all of your tweets to date!
  6. You can open the index.html file in the downloaded folder to view all of your tweets locally on your own computer with your browser.
Click the button to request your Twitter archive be emailed to your account email address.
Click the button to request your Twitter archive be emailed to your account email address.

Display your Twitter archive

The best part is now that you’ve got all your tweets downloaded, you can almost immediately serve them from your own server without any real modification.

Simply create an (accessible–use the same permissions as other equivalent files) folder named twitter on your server and upload all the files from your download into it. You’re done. It’s really that simple!

In my case I created a subfolder within my WordPress installation, named it “twitter”, and uploaded the files. Once this is done, you should be able to go to the URL http://example.com/twitter and view them.

The twitter folder in my WordPress directory with all of the downloaded files.
The twitter folder in my WordPress directory with all of the downloaded files.

As an example and to see what my archive looks like, visit http://boffosocko.com/twitter.

Alternately one could set up a subdomain (eg. http://twitter.example.com) and serve them from there as well. You can change the URL by changing the name of the folder. As an alternate example, Kevin Marks uses the following: http://www.kevinmarks.com/tweets/.

When you’re done, don’t forget to set up a link from your website (perhaps in the main menu?) so that others can benefit from your public archive. Mine is tucked in under the “Blog” heading in my main menu.

The user interface of your Twitter archive.
The user interface of your Twitter archive.

Caveats

Unfortunately, while you’ve now got a great little archive with some reasonable UI and even some very powerful search capabilities, most of the links on the archive direct back to the originals on Twitter and don’t provide direct permalinks within the archive. It’s also a static archive, so you’ve periodically got to re-download and upload to keep your archive current.  I currently only update mine on a quarterly basis, at least until I build a more comprehensive set up.

Current Set Up

At the moment, I’m directly owning all of my Twitter activity on my social stream site, which is powered by Known, using the POSSE philosophy (Post on your Own Site, Syndicate Elsewhere). There I compose and publish all of my Tweets and re-Tweets (and even some likes) directly and then I syndicate them to Twitter in real-time. I’ve also built and documented a workflow for more quickly tweeting using my cell phone in combination with either the Twitter mobile app or their mobile site.  (Longer posts here on BoffoSocko are also automatically syndicated (originally with JetPack and currently with Social Network Auto-Poster, which provides a lot more customization) to Twitter, so I also own all of that content directly too.)

You’ll notice that on both sites, when content has been syndicated, there’s a section at the bottom of the original posts that indicates to which services the content was syndicated along with permalinks to those posts. I’m using David Shanske’s excellent Syndication Links plugin to do this.

The syndication block that follows posts on my site so one can easily/quickly see alternate versions in other social silos.
The syndication block that follows posts on my site so one can easily/quickly see alternate versions in other social silos.

Ultimately, I’d like to polish the workflow a bit and post all of my shorter Twitter-like status updates from BoffoSocko.com, but I still have some work to do to better differentiate content so that my shorter form content doesn’t muddy up or distract from the people who prefer to follow my longer-form content. Based on his comment, I also suspect that this is the same semantic issue/problem that Jay Rosen has. I’d also like to provide separate feeds/subscription options so that people can more easily consume as much or as little content from my site as they’d like.

Next steps

For those who are interested in more comprehensive solutions for owning and displaying their Tweets, I’ve looked into a few WordPress-based possibilities and like the following two which could also be potentially modified for custom display:

Both of these not only allow you to own and display your tweets, but they also automatically import new Tweets using the current API. Keep in mind that they use the PESOS philosophy (Post Elsewhere, Syndicate to your Own Site) which is less robust than POSSE, mentioned above.

I’ll note that a tremendous number of WordPress-based plugins within the plugin repository that are Twitter related predate some of the major changes in Twitter’s API in the last year or two and thus no longer work and are no longer supported, so keep this in mind if you attempt to explore other solutions.

Those with more coding ability or wokring on other CMS platforms may appreciate a larger collection of thought and notes on the Twitter wiki page created by the IndieWeb Community. [3]

Thoughts?

Do you own your own Tweets (either before or after-the-fact)? How did you do it? Feel free to tell others about your methods in the comments, or better yet, write them on your own site and send this post a webmention (see details below).

The IndieWeb movement is coding, collecting, and disseminating UI, UX, methods, and opensource code to help all netizens to better control their online identities, communicate, and connect themselves to others at IndieWeb.org. We warmly invite you to join us.

References

[1]
O. Richard, “ Ozh’ Tweet Archiver (Backup Twitter With WordPress) « planetOzh,” Planet Ozh, 21-Sep-2010. [Online]. Available: http://planetozh.com/blog/my-projects/ozh-tweet-archiver-backup-twitter-with-wordpress/. [Accessed: 05-Dec-2016]
[2]
J. Reifman, “Import and Archive Your Tweets With WordPress,” Envato Tuts+, 28-Jan-2015. [Online]. Available: http://code.tutsplus.com/tutorials/import-and-archive-your-tweets-with-wordpress–cms-22656. [Accessed: 05-Dec-2016]
[3]
“Twitter,” IndieWeb.org. [Online]. Available: http://indieweb.org/twitter. [Accessed: 05-Dec-2016]

Chris Aldrich is reading “3 Methods To Create Your Own Searchable Twitter Archive”

Read 3 Methods To Create Your Own Searchable Twitter Archive (makeuseof.com)
If you want to secure your tweets against any issues that might happen to Twitter and its servers, consider backing up your Twitter shares. If you use Twit

Chris Aldrich is reading “Twitter has a new head of product who barely uses the product”

Read Twitter has a new head of product who barely uses the product (theverge.com)
Twitter’s ceaseless search for someone to tell the social network where to go and how to get there has come to a momentary pause. The company announced today, on Twitter of course, that it has hired startup founder Keith Coleman as vice president of product. Coleman, according to his Twitter bio, is the CEO of Yes Inc., a relatively unknown Bay Area startup responsible for two social apps called Frenzy and WZD. Frenzy offers a way to make quick plans with friends, while WZD is a blend Facebook and Snapchat that lets you share what you’re doing with friends by posting photos and videos layered with emoji and text. Because Yes is joining Twitter alongside Coleman, both apps are being shut down, according to a note posted to Yes’ website. Prior to Yes, Coleman was a product lead at Google overseeing services like Gmail and its chat companion.

Chris Aldrich is reading “Let’s replace Twitter with something much better.”

Read Let's replace Twitter with something much better. by Charl BothaCharl Botha (cpbotha.net)
I love that by following certain people, my timeline has become a stream of interesting and entertaining information. I love that sometimes I am able to fit my little publication just so into the 140 characters given to me.

Warren Weaver Bot!

Liked Someone has built a Warren Weaver Bot! by WeaverbotWeaverbot (Twitter)
This is the signal for the second.
How can you not follow this twitter account?!

Now I’m waiting for a Shannon bot and a Weiner bot. Maybe a John McCarthy bot would be apropos too?!

My 10th Anniversary on Facebook

Apparently, according to Facebook, today is my 10th Anniversary using their service. Mostly I remember that it was pretty lonely for that first year as very few people I knew even had an idea what it was. Fortunately more than 1,300 people I know have joined since and made it a much more enriching experience.

Yesterday I got a thank you from Foursquare for 7 years, and it’s easily been over 8 years on Twitter. Sadly, I miss a lot of the services that started around that time that are no longer with us. Toward that end, I’ll post some thoughts tomorrow about a more pivotal anniversary about which I’m much more excited, and which portends better things for the internet…

Twitter Changes Rules on Users. No Auto-Follow. | Kyle Lacy

Replied to Twitter Changes Rules on Users. No Auto-Follow. by Kyle Lacy (kylelacy.com)
(hat tip to ZDNEt and Chris McEvoy for the lead) From ZDNet: “With no notice, Twitter yesterday “pulled the rug out from under its developers” one developer says, by discouraging auto-following and imposing 1,000 person-per-day following limits.” Now… this is not news to me because of the “pulling the rug out from under its developers” thing or the 1,000 person-per-day following limit… The news to me as a Twitter user… I don’t really remember getting a message or alert that the new limits were going to be enacted. I use Twitter on a daily basis. It seems fairly odd that I would not know about the change.
I’m personally glad they’d be implementing something like this and wish they had done it about a month ago. Eventually without any controls the site would have become a waste land. In the spirit of using it as the tool it has become, they needed to implement changes like this as the site scaled up to more and more people. It’s very similar to the changes they instituted in the fall of 2008 when they created a cap of being able to follow more than 2000 people when your own number of followers wasn’t commensurate with that number. As a game theorist, I’m sure that people will somehow find some other way to artificially game the system.

As a separate note, who really wants to waste the time building thousands and thousands of followers when none of them are really going to ever pay attention to you? Yes, it’s great to have a high number, but really what is your ultimate reach? How many people are you engaging?