JCDL Tweets: The Data
This is a preliminary post about a simple data analysis of JCDL tweets.
At 12:48 pm PDT on Friday 19 June, i ran the command
curl http://search.twitter.com/search.atom\?q=jcdl+OR+jcdl2009\&rpp=100 >\ TweetsJCDL01.xml
iterating until i ran out of tweets, and thus producing five Atom format files of JCDL tweets.
I wrote a simple gawk script (it’s not JCDL specific) which produced the following data files, suitable for visualization at Many Eyes:
AuthorTweetCount.html - see below Tweets.txt - Tweet text CleanTweets.txt - Tweets without handles & tags HandleTweetCount.txt - Count of tweets, replies, retweets, & mentions Handle_Cited.txt - handle & the handle of a RT'ed user Handle_Mentioned.txt - handle & any handles mentioned in the tweet Handle_RepliedTo.txt - handle & the replied to handle Handle_Epoch.txt - handle and the tweet timestamp in epoch
The script will be available, for what it’s worth, with a BSD license, which i hope means that it can be improved freely and made far more useful.
Once i confirm the visualizations work, i’ll post about the results, and i’ll also provide the tweets in atom format, the gawk script, the results, and links to the places to play at Many Eyes.
The most preliminary result is below the cut: a list of all the twitter users who had tweets about JCDL or JCDL2009, ranked.
123 HCIR_GeneG (Gene Golovchinsky) 58 gingdottwit (Max L. Wilson) 41 dchud (Dan Chudnov) 32 Alan_Wolf (Alan_Wolf) 24 band (William L. Anderson) 19 _cb_ (_cb_) 16 judielaine (Judith Bush) 15 pmedward (Phillip M Edwards) 14 plbogen (Paul Logasa Bogen II) 7 pgwetzler (Philipp G Wetzler) 4 jschneider (Jodi Schneider) 3 rayrlarson (Ray R Larson) 3 morganmundum (Glenda Morgan) 3 mantruc (mantruc) 3 dtunkelang (Daniel Tunkelang) 2 sumo_baby (Sumo) 2 pdpinch (Peter Pinch) 2 edwardafox (edwardafox) 2 dder (David De Roure) 2 chas_thomas (Chuck Thomas) 2 bederson (bederson) 2 TXDigLibrary (TexasDigitalLibrary) 1 williamj (William J. Moner) 1 ukolndev (UKOLN) 1 sharoda (sharoda) 1 robpettengill (Rob Pettengill) 1 rikkiprince (Rikki Prince) 1 riceylively (M L Rice-Lively) 1 missmcj (misscj) 1 mariasoy (mariasoy) 1 kolorkid (Heather Leary) 1 karenwickett (Karen Wickett) 1 jmole (jon moeller) 1 jbk (Jamene) 1 james3neal (James Neal) 1 iremembernot (Lindsey) 1 infopeep (infopeep) 1 gg_austin (Garysguide Austin) 1 fak3r (fak3r) 1 edchi (edchi) 1 chirag_shah (chirag_shah) 1 boatgrrl2000 (Sarah Holsted) 1 TAC_NISO (Todd Carpenter) 1 SocialTIS (Tina Stewart) 1 PhoneJunction (Telephone Junction) 1 MSFTResearch (Microsoft Research) 1 KaskaskiaVic (Vicki Valleroy) 1 AJFerrari (Adam Ferrari)
