PathHierarchyTokenizerDescriptor
public class PathHierarchyTokenizerDescriptor : TokenizerDescriptorBase<PathHierarchyTokenizerDescriptor, IPathHierarchyTokenizer>, IPathHierarchyTokenizer, ITokenizer
public PathHierarchyTokenizerDescriptor()
The buffer size to use, defaults to 1024.
The character delimiter to use, defaults to /.
An optional replacement character to use. Defaults to the delimiter
Generates tokens in reverse order, defaults to false.
Controls initial tokens to skip, defaults to 0.