Legacy Document

Important: The information in this document is obsolete and should not be used for new development.

Inside Macintosh: Text /: Appendix B - International Resources / Tokens Resource (Type 'itl4')

The Token-String Copy Routine
When it creates a token list, the IntlTokenize function offers the option of also returning Pascal strings that are the normalized equivalents of the tokens it generates. IntlTokenize uses the token-string copy routine to create those strings and store them in a canonical format in a string list.
Canonical format means that the string-copy routine converts all numerals into standard ASCII numbers and converts the decimal separator to a period. For example, it would convert the Thai number "248" into one token, tokenAltNum, with an associated Pascal string of '248'.

Shop the Apple Online Store (1-800-MY-APPLE), visit an Apple Retail Store, or find a reseller.