Legacy Documentclose button

Important: The information in this document is obsolete and should not be used for new development.

Previous Book Contents Book Index Next

Inside Macintosh: Text /
Chapter 6 - Script Manager / Script Manager Reference
Routines

Tokenization

The Script Manager provides a way to take programming-language text in an arbitrary script system and break it into tokens: language-independent symbols that can be used as input to a parser. The IntlTokenize function uses information in a script system's tokens ('itl4') resource to convert text to tokens that stand for names, symbols, comments, and quoted literals.

Subtopics
IntlTokenize
Previous Book Contents Book Index Next

© Apple Computer, Inc.
6 JUL 1996