Word2Vec with Apache Spark

I tried to use Word2Vec with Apache Spark. Used the first Harry Potter book as Corpus.

Some Interesting results 

Similarities for "Ron"

Hermione 0.8892348408699036

watch 0.8258942365646362

"and 0.7972607016563416

Similarities for "Hermione"

Ron 0.9096277952194214

"and 0.8301450610160828

Hooch 0.829563319683075

Ron and Hermione end up getting married in the last book.  

Similarities for "Voldemort"

Quirrell's 0.9311719536781311

laughing 0.9307642579078674

Similarities for "Harry"

Hermione 0.7319877743721008

George 0.7252205014228821

Harry Potter Corpus

http://cdn.preterhuman.net/texts/literature/books_by_title/G%20-%20M/JK%20Rowling%20-%20(1)Harry%20Potter%20and%20the%20Sorcerer's%20Stone%2078500%20words.txt

API Refrence

http://spark.apache.org/docs/latest/mllib-feature-extraction.html#word2vec

So what is word2vec. It is a shallow neural network model. In short it tries to predict the contextual word from its surroundings and vice - versa. 

Life and Beyond

Hi Folks,
Sorry for not writing a blog post for a long time. I have been busy :).
To begin with I would like to declare that I am a MOOC-aholic. I have completed over 10 MOOC since 2013. I strongly feel that we have reached a point where we need to teach ourselves how to learn. MOOCS are on of the best ways to learn.

Currently I am following 2 MOOCs
Machine Learning: Classification
Analytics Edge

There is a hunger .... well a different kind of hunger or one might even say thirst for knowledge. My aim this year would be:
a) Contribute to Open Source
b) Expert in at-least one programming language


- Adios Amigo