Partager via

ChatCompletionsOptions.NucleusSamplingFactor Property

  • Reference

Definition

Namespace:
Azure.AI.Inference
Assembly:
Azure.AI.Inference.dll
Package:
Azure.AI.Inference v1.0.0-beta.2
Source:
ChatCompletionsOptions.cs

An alternative to sampling with temperature called nucleus sampling. This value causes the model to consider the results of tokens with the provided probability mass. As an example, a value of 0.15 will cause only the tokens comprising the top 15% of probability mass to be considered. It is not recommended to modify temperature and top_p for the same completions request as the interaction of these two settings is difficult to predict. Supported range is [0, 1].

public float? NucleusSamplingFactor { get; set; }
member this.NucleusSamplingFactor : Nullable<single> with get, set
Public Property NucleusSamplingFactor As Nullable(Of Single)

Property Value

Nullable<Single>

Applies to