Instance Method


Sets the language of the text to be tokenized.


func setLanguage(_ language: NLLanguage)

See Also

Configuring a Tokenizer

var string: String?

The text to be tokenized.

var unit: NLTokenUnit

The linguistic unit that this tokenizer uses.

struct NLTokenizer.Attributes

Hints about the contents of the string for the tokenizer.