How to Own & Display Your Twitter Archive on Your Website in Under 10 Minutes

As part of my evolving IndieWeb experience of owning all of my own internet-based social data, last year I wanted a “quick and dirty” method for owning and displaying all of my Twitter activity before embarking on a more comprehensive method of owning all of my past tweets in a much more comprehensive way. I expected even a quick method to be far harder than the ten minute operation it turned out to be.

Back in early October, I had also replied to a great post by Jay Rosen when he redesigned his own blog PressThink. I saw a brief response from him on Twitter at the time, but didn’t get a notification from him about his slightly longer reply, which I just saw over the weekend:

I don’t like the way tweets displayed on a blog look. I am fussy about that. Would I like to have a searchable archive in my possession so I don’t lose it all when Twitter goes under? I would.

Jay Rosen, journalism professor NYU,
in reply to my comment on PressThink’s new design and third space

 

So, for his benefit as well as others who are interested in the ability to do something like this quickly and easily, I thought I’d write up a short outline of what I’d originally done so that  without spending all the time I did, others can do the same or something similar depending on their needs.

If part of Mr. Rosen’s reply doesn’t give you enough motivation for why one would want to do this, IndieWeb.org has a laundry list of motivations along with a list of dead and defunct sites and social media silos that have taken pedabytes of data with them when they died.

How to (Quickly) Own and Display Your Tweets on Your Own Site

Download all your tweets

  1. Go to: https://twitter.com/settings/account
  2. Near the bottom of the page you should see a “Your Twitter archive” section
  3. See the Request your archive button? Click it.
  4. After a (hopefully) short wait, a link to your archive should show up in your email associated with the account. Download it.
  5. Congratulations, you now own all of your tweets to date!
  6. You can open the index.html file in the downloaded folder to view all of your tweets locally on your own computer with your browser.
Click the button to request your Twitter archive be emailed to your account email address.
Click the button to request your Twitter archive be emailed to your account email address.

Display your Twitter archive

The best part is now that you’ve got all your tweets downloaded, you can almost immediately serve them from your own server without any real modification.

Simply create an (accessible–use the same permissions as other equivalent files) folder named twitter on your server and upload all the files from your download into it. You’re done. It’s really that simple!

In my case I created a subfolder within my WordPress installation, named it “twitter”, and uploaded the files. Once this is done, you should be able to go to the URL http://example.com/twitter and view them.

The twitter folder in my WordPress directory with all of the downloaded files.
The twitter folder in my WordPress directory with all of the downloaded files.

As an example and to see what my archive looks like, visit http://boffosocko.com/twitter.

Alternately one could set up a subdomain (eg. http://twitter.example.com) and serve them from there as well. You can change the URL by changing the name of the folder. As an alternate example, Kevin Marks uses the following: http://www.kevinmarks.com/tweets/.

When you’re done, don’t forget to set up a link from your website (perhaps in the main menu?) so that others can benefit from your public archive. Mine is tucked in under the “Blog” heading in my main menu.

The user interface of your Twitter archive.
The user interface of your Twitter archive.

Caveats

Unfortunately, while you’ve now got a great little archive with some reasonable UI and even some very powerful search capabilities, most of the links on the archive direct back to the originals on Twitter and don’t provide direct permalinks within the archive. It’s also a static archive, so you’ve periodically got to re-download and upload to keep your archive current.  I currently only update mine on a quarterly basis, at least until I build a more comprehensive set up.

Current Set Up

At the moment, I’m directly owning all of my Twitter activity on my social stream site, which is powered by Known, using the POSSE philosophy (Post on your Own Site, Syndicate Elsewhere). There I compose and publish all of my Tweets and re-Tweets (and even some likes) directly and then I syndicate them to Twitter in real-time. I’ve also built and documented a workflow for more quickly tweeting using my cell phone in combination with either the Twitter mobile app or their mobile site.  (Longer posts here on BoffoSocko are also automatically syndicated (originally with JetPack and currently with Social Network Auto-Poster, which provides a lot more customization) to Twitter, so I also own all of that content directly too.)

You’ll notice that on both sites, when content has been syndicated, there’s a section at the bottom of the original posts that indicates to which services the content was syndicated along with permalinks to those posts. I’m using David Shanske’s excellent Syndication Links plugin to do this.

The syndication block that follows posts on my site so one can easily/quickly see alternate versions in other social silos.
The syndication block that follows posts on my site so one can easily/quickly see alternate versions in other social silos.

Ultimately, I’d like to polish the workflow a bit and post all of my shorter Twitter-like status updates from BoffoSocko.com, but I still have some work to do to better differentiate content so that my shorter form content doesn’t muddy up or distract from the people who prefer to follow my longer-form content. Based on his comment, I also suspect that this is the same semantic issue/problem that Jay Rosen has. I’d also like to provide separate feeds/subscription options so that people can more easily consume as much or as little content from my site as they’d like.

Next steps

For those who are interested in more comprehensive solutions for owning and displaying their Tweets, I’ve looked into a few WordPress-based possibilities and like the following two which could also be potentially modified for custom display:

Both of these not only allow you to own and display your tweets, but they also automatically import new Tweets using the current API. Keep in mind that they use the PESOS philosophy (Post Elsewhere, Syndicate to your Own Site) which is less robust than POSSE, mentioned above.

I’ll note that a tremendous number of WordPress-based plugins within the plugin repository that are Twitter related predate some of the major changes in Twitter’s API in the last year or two and thus no longer work and are no longer supported, so keep this in mind if you attempt to explore other solutions.

Those with more coding ability or wokring on other CMS platforms may appreciate a larger collection of thought and notes on the Twitter wiki page created by the IndieWeb Community. [3]

Thoughts?

Do you own your own Tweets (either before or after-the-fact)? How did you do it? Feel free to tell others about your methods in the comments, or better yet, write them on your own site and send this post a webmention (see details below).

The IndieWeb movement is coding, collecting, and disseminating UI, UX, methods, and opensource code to help all netizens to better control their online identities, communicate, and connect themselves to others at IndieWeb.org. We warmly invite you to join us.

References

[1]
O. Richard, “ Ozh’ Tweet Archiver (Backup Twitter With WordPress) « planetOzh,” Planet Ozh, 21-Sep-2010. [Online]. Available: http://planetozh.com/blog/my-projects/ozh-tweet-archiver-backup-twitter-with-wordpress/. [Accessed: 05-Dec-2016]
[2]
J. Reifman, “Import and Archive Your Tweets With WordPress,” Envato Tuts+, 28-Jan-2015. [Online]. Available: http://code.tutsplus.com/tutorials/import-and-archive-your-tweets-with-wordpress–cms-22656. [Accessed: 05-Dec-2016]
[3]
“Twitter,” IndieWeb.org. [Online]. Available: http://indieweb.org/twitter. [Accessed: 05-Dec-2016]

A miss bigger than a missed story: my final reflections on Trump and the press in 2016 | PressThink

Replied to A miss bigger than a missed story: my final reflections on Trump and the press in 2016 by Jay Rosen (PressThink)
A shift in political culture away from journalism’s grasp.
I just finished reading Jay Rosen’s fantastic piece on his reactions to the 2016 Presidential election which he wrote just before the election itself. It has a stunning take on what was going on before the election and indicates to a great extent why things have gone so drastically wrong. For those who are heavily concerned with what has happened, it also directly indicates a large part of what was missed and therefore provides the base problem so that we might all do a better job of protecting against it in the near future.

In part, he discusses the concept of fact checking and why Trump didn’t appear to care if anyone was fact checking his statements. Personally, the blatant lies that he was telling on a regular basis were even more disconcerting to me than some of this less than civil behavior. Rosen goes into some reasonable depth on this particular issue and its recent history which is very illuminating. Sadly it doesn’t make me any more happy about our present situation.

Yesterday I read something by a philosopher, Jason Stanley, that illuminated what I mean by “a miss bigger than a missed story.” Beyond Lying: Donald Trump’s Authoritarian Reality. Stanley made the point that fact checking Trump in a way missed the point. Trump was not trying to make reference to reality in what he said to win votes. He was trying to substitute “his” reality for the one depicted in news reports.

“On a certain level, the media lacked the vocabulary to describe what was happening,” Stanley writes. And I agree with that. He compares what Trump did to totalitarian propaganda, which does not attempt to depict the world but rather substitutes for it a ruthlessly coherent counter-narrative that is untroubled by any contradiction between itself and people’s experience.

I find large portions of the Trump narrative similar to the story of “The emperor with no clothes.” Reality may be what you can manage to get others to believe, but in a reasonable democracy truth must manage to win out. While I think that it’s almost certainly the case that a small minority of the populace really wanted to vote for Trump, how did he manage to capture the remainder? The “I won’t vote for Hilary segment” certainly gave him an additional fraction of the vote. Then people who were traditional Republicans who couldn’t bring themselves to vote Democrat added another piece of the pie. (Sadly, some of those who repudiated him during the end of the campaign seem to be falling right back in line for their piece of patronage.) Many are simply hurting and want to believe anyone who will give them someone to blame for it and a possible glimmer of a solution. Sadly, I expect these last people to be hurt the most at the end of the day when they realize too late that the emperor is naked.

But other than outright lying, how did Trump connect with some of the electorate? I’ve written before on Trump’s use of doubletalk, which I still feel is a significant factor in his capturing a large part of the populace. See also: Complexity isn’t a Vice: 10 Word Answers and Doubletalk in Election 2016 for this argument. Rosen’s discussion of facts is, to me, the other major missing piece.

I also wonder if it’s possibly the case that in an ever sub-specializing world that people have somehow lost the time, effort, or even inclination to attempt to put all of the facts together themselves to create a cohesive whole? Instead they rely on others to manufacture these stories on their behalf and thereby make it easier for such totalitarian propaganda to insert itself.

Perhaps the working men and women of the country aren’t spending time reading the paper anymore? It’s certainly easier to read third and fourth party stories on Twitter, Facebook, or listen to infotainment in the later hours on Fox News, MSNBC, or CNN. Why try to follow more direct sources when we can read Facebook and worry about who’s going to win this season of The Voice or The Bachelor?

As the workforce of the world continues to subspecialize, we’re going to need to be able to trust our political leaders more and more, not less and less.

[Totalitarian propaganda]’s open distortion of reality is both its greatest strength and greatest weakness.

The question is: how can we exploit the weaknesses to make the problem apparent to those who are too easily willing to believe?

What’s unusual about Trump is he’s a leading candidate and he seems to have no interest in getting important things factually correct.

It’s one thing to lie for political advantage. It’s another to keep lying to prove you have the power.

I’m hoping that some of the electorate realizes that things aren’t improving for them any time soon before too much significant damage has been done.  Just because you believe a thing doesn’t make it true or even a fact.

I’d highlighted the concept before, but perhaps it’s a good time to remind people again:

No, It’s Not Your Opinion. You’re Just Wrong. | Houston Press

Before you crouch behind your Shield of Opinion you need to ask yourself two questions: 1. Is this actually an opinion? 2. If it is an opinion how informed is it and why do I hold it?