/ Assembly List / LJCNetCommon / CodeTokenizer

Namespace - LJCNetCommon


Syntax

C#
public class CodeTokenizer

A C# Code Tokenizer class. (RE)

Public Methods
#ctor Initializes an object instance.
ClearRemainingTokens Clears all the remaining tokens; starting with the specified token index. (E)
CombineXmlCommentTokens Combines the tokens for an XMLComment. (E)
EndTokens Sets the tokenIndex to the end of the tokens array. (E)
GetNextToken Gets the next token after the specified token index. (E)
GetToken Gets the token at the specified token index. (E)
HasBeginDelimiter Check if the text has the begin delimiter. (E)
HasBothDelimiters Check if the text is a Full summary comment. (E)
HasEndDelimiter Check if the text has the end delimiter. (E)
InitializeKeywords Initializes the Keywords. (R)
IsCodeXmlComment Check if a XML comment. (E)
IsComment Check if a code comment. (E)
IsDataType Check if the text is a DataType. (E)
IsDataValue Check if the text is a Data value. (E)
IsDelimiters Check if the text contains a common delimiter. (E)
IsKeyword Check if the text is a Keyword. (E)
IsLibType Check if the text is a LibType. (E)
IsModifier Check if the text is a Modifier. (E)
IsParam Check if the text is a param comment. (E)
IsRefType Check if the text is a RefType. (E)
SetKeywords Sets the Keywords from the previously initialized CodeTokens. (R)
SetTokens Sets the Tokens value, split on blanks. (E)
StripQualifier Strips the leading qualifiers and from next qualifier to end of string. (E)
23 Methods

Properties
CommonDataTypes The most common Data Types.
CommonKeywords The most common Keywords.
CommonModifiers The most common Modifiers.
DataTypes The additional Data Types.
Keywords The additional Keywords.
LibTypes The Library Types.
Modifiers The additional Modifiers.
RefTypes The Reference types.
Tokens Gets or sets the Token values.

Copyright © Lester J. Clark and Contributors.
Licensed under the MIT License.