| C# |
|---|
| public class CodeTokenizer |
| #ctor | Initializes an object instance. |
| ClearRemainingTokens | Clears all the remaining tokens; starting with the specified token index. (E) |
| CombineXmlCommentTokens | Combines the tokens for an XMLComment. (E) |
| EndTokens | Sets the tokenIndex to the end of the tokens array. (E) |
| GetNextToken | Gets the next token after the specified token index. (E) |
| GetToken | Gets the token at the specified token index. (E) |
| HasBeginDelimiter | Check if the text has the begin delimiter. (E) |
| HasBothDelimiters | Check if the text is a Full summary comment. (E) |
| HasEndDelimiter | Check if the text has the end delimiter. (E) |
| InitializeKeywords | Initializes the Keywords. (R) |
| IsCodeXmlComment | Check if a XML comment. (E) |
| IsComment | Check if a code comment. (E) |
| IsDataType | Check if the text is a DataType. (E) |
| IsDataValue | Check if the text is a Data value. (E) |
| IsDelimiters | Check if the text contains a common delimiter. (E) |
| IsKeyword | Check if the text is a Keyword. (E) |
| IsLibType | Check if the text is a LibType. (E) |
| IsModifier | Check if the text is a Modifier. (E) |
| IsParam | Check if the text is a param comment. (E) |
| IsRefType | Check if the text is a RefType. (E) |
| SetKeywords | Sets the Keywords from the previously initialized CodeTokens. (R) |
| SetTokens | Sets the Tokens value, split on blanks. (E) |
| StripQualifier | Strips the leading qualifiers and from next qualifier to end of string. (E) |
| CommonDataTypes | The most common Data Types. |
| CommonKeywords | The most common Keywords. |
| CommonModifiers | The most common Modifiers. |
| DataTypes | The additional Data Types. |
| Keywords | The additional Keywords. |
| LibTypes | The Library Types. |
| Modifiers | The additional Modifiers. |
| RefTypes | The Reference types. |
| Tokens | Gets or sets the Token values. |