Token Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Represent the token produced from the tokenization process containing the token substring, the id associated to the token substring, and the offset mapping to the original string.
public sealed class Tokentype Token = classPublic NotInheritable Class Token- Inheritance
-
Token
Constructors
| Token(Int32, String, ValueTuple<Int32,Int32>) |
Construct a new Token object using the token value, Id, and the offset mapping to the original string. |
Properties
| Id |
Gets or sets the Id value associated to the token. |
| Offset |
Gets or sets the offset mapping to the original string. |
| Value |
Gets or sets the token string value. |