Notice: The Tweet Nest support forum has been moved to the GitHub issue tracker. Please report all issues there. Thank you!
Post a reply

Import Twitter archive?

A forum thread posted in Tweet Nest by MadysonDesigns on Dec 17th, 2012

MadysonDesigns OP

Hello-

Since there is a limit of how many tweets you can pull from Twitter.com through JSON, is there any way to import the tweets from the official archive Twitter provides now?

http://www.businessinsider.com/how-to-download-your-twitter-archive-2012-12

According to their readme, they provide a full JSON export, so is there a fairly simple way to import?

Reply

tralafiti

I quickly wrote one but only testes with my own data so far https://github.com/tralafiti/tweetnest

Would appreciate feedback.

Reply

mikeage

Works great! It wasn’t clear from the README that you wanted the .js files directly in archive/ (I first unzipped the entire tree there), but after a 5 second look at the code, I moved them, and the import went flawlessly. Thanks!

Reply

MadysonDesigns OP

This is fantastic. Working away, all smoothly so far.

The only thing you may want to note in your readme file is not to overwrite your inc/config.php file if you have an existing instance of TweetNest.

Reply

tralafiti

Hurray - thanks for the feedback. Will fix the unclear instructions.

Reply

makemakenotnot

this just doesn’t seem to work for me. it’s driving me crazy. what did I do wrong?

Reply

jonohunt

I get an error when try to run upgrade.php:
Duplicate entry ‘44794062607360000’ for key ‘tweetid’

Is that because I already have a Tweet Nest database?

Reply

jonohunt

…nevermind.

I ignored the upgrade and just ran loadarchive. It seems fine.
Thanks!

Reply

RaamDev

I’d double-check that you didn’t accidentally create lots of duplicate tweets (that’s what happened to me when I ignored that message and ran loadarchive.php anyway).

See here: https://github.com/graulund/tweetnest/pull/45#issuecomment-15400282

Reply

liesjelogthet

Getting the files in order seems to have gone ok, but I can’t seem to make the final step. Am I the only one who can’t seem to load the loadarchive.php.
I keep getting prompted for my username/password. I looked those up in the config-file, but they are not accepted. Tips anyone?

Reply

RaamDev

That’s the Maintenance Password it’s asking for. Check your inc/config.php file:

// OPTIONAL ––––––––––––––-
// If you want to access your maintenance PHP files by HTTP, specify an admin password.
‘maintenance_http_password’ => ”,
// UNLESS YOU HAVE SSL, IT WILL BE SENT IN CLEAR TEXT, SO MAYBE NOT YOUR TWITTER (or anything else) PASSWORD!

Reply

djsteen

I did the following:

1. Upgraded to Tweet Nest 1.1.
2. Placed my Twitter archive .js files in the /archive folder.
3. Ran upgrade.php. That resulted in this message: Duplicate entry ‘28856993993199616’ for key 2
4. I decided to run loadarchive.php anyway.
5. Ran loadtweets.php

Subsequently, I have a bunch of duplicate tweets now. I read through the Github comments linked above (https://github.com/graulund/tweetnest/pull/45#issuecomment-15400282), but I don’t see a (simple) way to remove the duplicates. I’m not familiar with creating/running scripts, so baby steps would be appreciated. Or, if I just need to wait for another Tweet Nest update, then that’s fine. :)

Reply

Post a reply to this thread

Please log in with your Twitter account using the button below in order to participate.

Connect with Twitter