Click or drag to resize

Token Class

Represents a discreet unit of text parsed from the input stream, along with location and formatting information, and any trailing comments.
Inheritance Hierarchy

Namespace:  Nova.Parsing
Assembly:  Nova.CodeDOM (in Nova.CodeDOM.dll) Version: 7.44.8391.13415
public class Token : ParsedObject

The Token type exposes the following members.

Public methodToken
Create a Token.
Public propertyHasTrailingComments
True if there are any trailing comments.
(Overrides ParsedObjectHasTrailingComments.)
Public propertyInDocComment
True if inside a documentation comment.
(Overrides ParsedObjectInDocComment.)
Public propertyIsComment
True if the Token is a comment.
Public propertyIsCompilerDirective
True if the Token is the start of a compiler directive.
Public propertyIsDocCommentStart
True if the Token is the start of a documentation comment.
Public propertyIsDocCommentString
True if the Token is a documentation comment string.
Public propertyIsDocCommentTag
True if the Token is a documentation comment XML tag name.
Public propertyIsFirstOnLine
True if the Token is the first one on the current line.
Public propertyIsIdentifier
True if the Token is an identifier.
Public propertyIsNumeric
True if the Token is numeric.
Public propertyIsSymbol
True if the Token is a symbol.
Public propertyIsVerbatimString
True if the Token is a verbatim string.
Public propertyNonVerbatimText
Get the token text without any '$' and/or '@' prefix (if any).
Public methodAsToken
Return this Token.
(Overrides ParsedObjectAsToken.)
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Enable this finalizer to trace lost comments
(Overrides ObjectFinalize.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodToString
Get this token as a string.
(Overrides ObjectToString.)
Protected field_inDocComment
True if inside a documentation comment.
Public fieldCodeUnit
The parent CodeUnit (used in Debug mode to track lost comments).
Public fieldColumnNumber
The column number of the Token (1 to N).
Public fieldLeadingWhitespace
Any leading whitespace on the Token. Will be empty if none (not null).
Public fieldLineNumber
The line number of the Token (1 to N).
Public fieldNewLines
The number of new lines preceding the Token.
Public fieldText
The text of the Token.
Public fieldTokenType
The TokenType of the Token.
Public fieldTrailingComments
Any trailing comments on the Token.
Public fieldWasEscaped
True if the Token was escaped.
See Also