State of the Union, mood of the country & MapReduce


This is what I was working outside Strata’11 today – a quick big data/hadoop project – running MapReduce on SOTU for my “Building Clouds with AWS” book for Pragmatic Press.

Two MapReduce jobs – one that splits and sums words/another that deletes commonly used words, inverts and let the identity mapper sort the list by the word count, and a little cut-and-paste to Excel – voila ! we have the top 16 relevant words in selected SOTU that reflects the mood of the country at that time period !

Interesting observations about the priorities of the country at the time of the presidencies – Obama, GWB, Clinton, JFK, FDR, Lincoln and George Washington.

Advertisements

One thought on “State of the Union, mood of the country & MapReduce

  1. Pingback: Tweets that mention State of the Union, mood of the country & MapReduce « My missives -- Topsy.com

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s