Does anybody know if there is

Answered by Petra Rolfsdotter
Fråga: 
Does anybody know if there is specific tokenizer for Twitter?
Svar: 

Hi.

Thanks for your question. Here is your answer

This is a rather technical question. I will try to answer it the best I can. As I can see, tokenization has some disambiguation. My guess is that you want to know if there is an tokenizator that can segment sentences into words. A search on the net shows that there seems to be many different tokenizators for use with Twitter. Here is a link to one of these (java)

https://code.google.com/p/clearnlp/wiki/Tokenizer

Kind regards Petra

20 October 2014 - 11:08