Split Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
This Split contains the underlying split token as well as its offsets
in the original string. These offsets are in the original referential.
It also contains any Token associated to the current split.
public sealed class Split : IEquatable<Microsoft.ML.Tokenizers.Split>type Split = class
interface IEquatable<Split>Public NotInheritable Class Split
Implements IEquatable(Of Split)- Inheritance
-
Split
- Implements
Constructors
| Split(String, ValueTuple<Int32,Int32>) |
create a Split object using the token and the offset |
Properties
| Offset |
Returns the offset mapping to the original string |
| TokenString |
Gets the underlying split token. Each SubString is represented by a token and in the end we might be carrying a lot of SubString representing various parts of the original input string. |
Methods
| Equals(Split) |
Indicates whether the current Split object is equal to another Split object. |