Legacy Documentclose button

Important: The information in this document is obsolete and should not be used for new development.

Apple Developer Connection
Advanced Search
Member Login Log In | Not a Member? Contact ADC

Previous Book Contents Book Index Next

Inside Macintosh: Text /
Chapter 6 - Script Manager / Script Manager Reference
Routines

Tokenization

The Script Manager provides a way to take programming-language text in an arbitrary script system and break it into tokens: language-independent symbols that can be used as input to a parser. The IntlTokenize function uses information in a script system's tokens ('itl4') resource to convert text to tokens that stand for names, symbols, comments, and quoted literals.

Subtopics
IntlTokenize
Previous Book Contents Book Index Next

© Apple Computer, Inc.
6 JUL 1996

Get information on Apple products.
Visit the Apple Store online or at retail locations.
1-800-MY-APPLE

Copyright © 2007 Apple Inc.
All rights reserved. | Terms of use | Privacy Notice