Where to find viterbi algorithm transition values for natural language processing?
- by Rodrigo Salazar
I just watched a video where they used Viterbi algorithm to determine whether certain words in a sentence are intended to be nouns/verbs/adjs etc, they used transition and emission probabilities, for example the probability of the word 'Time' being used as a verb is known (emission) and the probability of a noun leading onto a verb (transition).
http://www.youtube.com/watch?v=O_q82UMtjoM&feature=relmfu (The video)
How can I find a good dataset of transition and emission probabilities for this use-case?
Or EVEN just a single example with all the probabilities displayed, I want to use realistic numbers in a demonstration.