Instance Property

string

The text to be tokenized.

Declaration

var string: String? { get set }

See Also

Configuring a Tokenizer

func setLanguage(NLLanguage)

Sets the language of the text to be tokenized.

var unit: NLTokenUnit

The linguistic unit that this tokenizer uses.

struct NLTokenizer.Attributes

Hints about the contents of the string for the tokenizer.