Want some Twitter user data?
I want to bounce this idea around and see what people think about it. For the last 4 months I have been collecting user data from twitter’s spritzer stream. Anything that Twitter’s API returns for user data like name, bio, home page, etc are all stored. A complete list of this data can be found here: http://apiwiki.twitter.com/Twitter-REST-API-Method%3A-users%C2%A0show
All of this is stored in a MySQL database that currently holds over eight million records and takes up about 3.5gigs of space. New users come in all the time via spritzer and users already in the database are updated. I also have an additional script running that updates accounts to make that process go a little quicker.
Currently I am not doing anything with this data. I was thinking I could make a website that follows people based on their bio or name but it’s been done and auto following isn’t something I like to deal with. Then I thought I could make all kinds of strange charts on stuff like what background color is most popular and such but I wasn’t a big fan of that idea either. There are many more ideas, but I’ve been busy with other things.
So, rather than let all of this data go to waste I was thinking I could offer it and the php code that I use to collect data. You can import this in to your current database and do anything you like with it. This data did take some time and effort to get and I am collecting more from Twitter. If I were to make a backup of my MySQL table monthly and each month charge $30 dollars to download a batch would that seem alright? Let me know what you think in the comments. If you need this data now send me $30 via PayPal and I’ll send you what I have. Within 2 days I’ll have a backup ready and I’ll email you a link to download it. Uncompressed it’s 3.1gigs and compressed it’s less than 1GB.
Thanks!