Twitter And Our Feelings: Real-Time Sentiment Analysis

This post describes the implementation of sentiment analysis of tweets using Python and the natural language toolkit NLTK. The post also describes the internals of NLTK related to this implementation.

Background
The purpose of the implementation is to be able to automatically classify a tweet as a positive or negative tweet sentiment wise.

The classifier needs to be trained and to do that, we need a list of manually classified tweets.

Social Interaction Analytics
This document describes how to use Google Analytics to get interaction metrics on non-Google networks such as Facebook and Twitter. Use this document to set up Analytics for your social sharing buttons if you are a site owner, a content management plug-in developer, or if you are a social network operator wanting to provide automatic social interaction reporting for users of your sharing buttons.

Favourite: @MetaGrrrl: .@wikipedia, what's it going to take for you to realize that Leslie Harpold is significant to early years of the web & deserves an article?

Favourite: @cowbite: I would like my tv to have a screensaver of whirling starlings when it's on standby, like a perpetual autumnal window.

Favourite: @mondoagogo: Cormorant! Cormorant cormorant cormorant!

Favourite: @holgate: We miss you, Leslie.

Favourite: @netik: All hail the epoch @bobspace-I'll bet that 500 years from now,there will be orthodox robots who believe the universe was created on 1/1/1970

Favourite: @jamesbridle: And you can sync your Kindle bookmarks to Readmill with a handy new bookmark: http://t.co/Q4ScD8LF - so there are no excuses.

Favourite: @ideoforms: great lab on sonifying chaotic functions with music computing undergrads, culminating in a classroom chorus of logistic maps.

Favourite: @textstats: @mildlydiverting your punctuation usage is EXTREME (92%): | EXTREME: ',' (96%) '.' (91%) | HEAVY: '?' (75%) | ABSENT: ';' (0%)

Favourite: @jaggeree: Declarative frictionfull sharing is full of meaning and is for human consumption. Frictionless sharing is full of noise and is for robots.

Favourite: @cowbite: "Perkins: trying to be a little less shit everyday"

How can Twitter, which limits users to 140 characters per tweet, have any relevance to universities and academia, where journal articles are between 3,000-8,000 words long? Can anything of academic value ever be said in just 140 characters?

Favourite: @mugla: Actually enraged by this woman who doesn't understand that advice animals are people *talking to each other* with honesty and kindness.

Favourite: @rachelcoldicutt: In honour of going to Look at Art with @BobbyChampagne, I have dressed up fancy - like Tony Hancock in The Rebel

Favourite: @Preoccupations: Phone rang too early. You think at once of what trees might have fallen, seeds of promise been rubbed out. Everything you love, right there.

Favourite: @mrjuggles: The first rule of Thesaurus Club is, you don't talk about, mention, speak of, discuss or chat about Thesaurus Club

Favourite: @realmonkeybear: @holgate @spaceboy But worth it for the security.

Favourite: @stml: "an Earthly helium balloon is essentially a bag of retired alpha particles"

Favourite: @dotcode: shit. Just got gravy on the trackpad.

Favourite: @ideoforms: by category: banana, islands, sandwich, cube, symmetry, feet, excess, ritual, olfactory, kitchen, nature, cowboys... http://t.co/PALuigMI

Favourite: @katylindemann: RT @clivelindemann: Amazingly efficient & caring NHS staff. Not the impression you get from dailyfail! <-- NHS staff incredible #ilovethenhs

Favourite: @spaceboy: the kittens have eaten/hidden/played chase with/destroyed the usb stick i need. i have a torch and a sword and am going under the sofa

Favourite: @evilymangle: That's an emergency cake in the oven. The emergency? It's Tuesday tomorrow. Best be prepared.

Favourite: @LeeBinding: I'd totally do Jimmy Wales based on his wiki picture. Besides he's clearly desperate for the cash. Jiggle, Jimmy. Jiggle for daddy.

Favourite: @severalbees: Can someone make a device to set fire to my chair if I don't reply to 20 emails by 3pm? I assume that's basically what Arduinos are for.

Favourite: @joemoransblog: In Hungary, that salt and peppery static you see on a TV screen when there's nothing on is known as hangyák háborúja or 'war of the ants'.

Depressing, somehow

A quick test of response rates on various social networks.

Applescript that automates tweeting from within keynote as you present.

Via Phil - echos a lot of what I've been thinking about Twitter recently.

This is good. Also, there is something in here about the avant garde, about absolutism, and about... well, what do we replace it with? I don't understand what the new regimens that are being fought for might look like. Post democratic?

"(Indeed, I consider curated 'web app stores' as an admission of defeat - hopefully only temporary - while search providers figure out how to augment or replace document-centric keyword algorithms with something more suitable for indexing the rich functionality of a web of apps)"<br />
<br />
Ooh, this is one of those mental model skewing moments. Huh. Web changes. New google, now, pls

via phil and blech<br />
<br />
I keep meaning to re-setup my own blog to archive everything in a big timeywimey ball of stuff.

Guidelines for Use of Tweets in Broadcast or Other Offline Media<br />
We welcome and encourage the use of Twitter in broadcast. The requirements below are in place to ensure that Twitter users receive attribution for their content, and to help provide the best experience for those watching your broadcast. At the end of this page, you'll find additional suggestions that outline what's worked best in previous broadcast integrations as well as contact info for additional questions.<br />
<br />
Graphic Display of Tweets, Usernames, or Hashtags<br />
Tweets<br />
<br />
Do:<br />
Include the Twitter logo in close proximity to the Tweets for the duration that Tweets appear in broadcast.<br />
Make sure that the Twitter logo is a reasonable size in relation to the content.<br />
Include the username with each Tweet. If you have concerns about user privacy or broadcast standards, please contact us regarding exceptions unless you have a prior agreement with Twitter.<br />
Use the full text of the Tweet. If privacy concerns or broadcast standards are c

I love you Phil. Thankyou.

. I don’t want to see arts organisations pandering to older, more conservative audiences. I want to interact with them in an online platform which allows for the demonstration of genuine personality, and lets us voice our passions. A bit like you did last night when you called Steve Norris a cunt. You care about what people say about your workplace, something that no wage packet can buy. There are organisations that would kill for their employees to give a shit about their public profile the way you give a shit about the National Theatre. If you were told to make that lame hacking excuse by your superiors, or if they did it for you, I understand completely. I would have done the same, along with a fair bit of crying and whisky drinking.

Also Mollyarty AforAnthea, DILestrade etc. These smell very strongly of James Goss.

Twitter ad network. Just come across this in echofon - seems to be done... quite well. Huh.

The point is, FORGET YOUR BRAND. You don’t own it because it is literally nothing. You can spend all sorts of time and money trying to manufacture public opinion, but ultimately, that’s up to the public, now isn’t it?<br />
You know the best way to get the public to respect your brand? Have a respectable brand. Offer a great, innovative product and make responsible, ethical business decisions. Lead the pack! Evolve! Don’t send hundreds of temp workers to the gulf to put on a show for the President. Hire those workers to actually work! Don’t dump toxic dispersant into the ocean just so the surface looks better. Collect the oil and get it out of the water! Don’t tell your employees that they can’t wear respirators while they work because it makes for a bad picture. Take a picture of those employees working safely to fix the problem. Lastly, don’t keep the press and the people trying to help you away from the disaster, open it up so people can see it and help fix it.

Parasitic fiction. great stuff. (via booktwo

What all these people are essentially saying is this: because this country was made less safe by the hasty, reckless, duplicitous way in which Tony Blair took us into war (a war which only yesterday claimed 114 more lives), and because he will never be brought to justice for that, we must live in a state of paranoid readiness, a state of nervous anxiety, a humorless state that cannot tell the difference between a joke and a threat, for the foreseeable future. Because that one, massive crime will go unpunished, we shall all be punished in thousands of interesting ways.<br />
<br />
As Robert Harris said, while we stand at airport security with our shoes in our hands, Tony Blair floats unimpeded through another part of the terminal.<br />
<br />
As we sit by a ruined Tube station, picking rubble out of our hair, Tony Blair is on his way to a thousand quid a plate dinner in a bulletproof limo.

"Although I appreciate that many people find Twitter to be valuable, I find it a truly awful way to exchange thoughts and ideas. It creates a mentally stunted world in which the most complicated thought you can think is one sentence long. It’s a cacophony of people shouting their thoughts into the abyss without listening to what anyone else is saying. Logging on gives you a page full of little hand grenades: impossible-to-understand, context-free sentences that take five minutes of research to unravel and which then turn out to be stupid, irrelevant, or pertaining to the television series Battlestar Galactica."

Twitter4J is a Java library for TwitterAPI.

twitter athletes

Lists of olympians

[[I have come across this quote twice today in different contexts]]

OK, it's just a twitter client - but I'm bookmarking this for the REALLY CUTE KIWI on the design that hides when you mouse over it

@mildlydiverting/decode09-digitalart

The Indianapolis Museum of Art and the New Orleans Museum of Art have a Super Bowl bet...the loser loans a significant piece of art to the winner for three months. The directors of the two museums trash talked back and forth via email and Twitter before agreeing on the paintings to be loaned.

Twitter analytics engine - very clear policies

Twitter analytics tools

a boom in telegraphic code books that reduced both common and complex phrases into single words. Dozens of different codes were published; many catered to specific occupations and all promised efficiency.

Oh, this is genius. via mr Begbie. Yay colourlovers

"arse plasma" from "the hideous mirrorworld of fuck"

More for post on new netiquette. Does no-one remember usenet? Sigh.

I have a longer post brewing about the new netiquette, now 'real' people and 'celebrities' are paying attention to the web.

Twitter bots

Auto update twitter->facebook etc

AWESOME

Sweet.