HuggingFacePromptExecutionSettings.MaxNewTokens Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Int (0-250). The amount of new tokens to be generated, this does not include the input length it is a estimate of the size of generated text you want. Each new tokens slows down the request, so look for balance between response times and length of text generated.
[System.Text.Json.Serialization.JsonPropertyName("max_new_tokens")]
public int? MaxNewTokens { get; set; }[<System.Text.Json.Serialization.JsonPropertyName("max_new_tokens")>]
member this.MaxNewTokens : Nullable<int> with get, setPublic Property MaxNewTokens As Nullable(Of Integer)Property Value
- Attributes