stanford pos tagger runs out of memory?
- by goh
my stanford tagger ran out of memory. Is it because the text has to be properly formatted? This is because i use it to tag html contents, with the tags stripped, but there may have quite a excessive amount of newlines.
here is the error:
BlockquoWARNING: Untokenizable: ? (char in decimal: 9829)
Exception in thread "main"…