INoriTokenizer
Tokenizer that ships with the analysis-nori plugin
The regular expression pattern, defaults to \W+.
The Nori tokenizer uses the mecab-ko-dic dictionary by default. A user_dictionary with custom nouns (NNG) may be appended to
the default dictionary. This property allows you to specify a path to this file on disk
The Nori tokenizer uses the mecab-ko-dic dictionary by default. A user_dictionary with custom nouns (NNG)
can be specified inline with this property