HuggingFacePromptExecutionSettings.MaxTime Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
(Default: None). Float (0-120.0). The amount of time in seconds that the query should take maximum. Network can cause some overhead so it will be a soft limit. Use that in combination with max_new_tokens for best results.
[System.Text.Json.Serialization.JsonPropertyName("max_time")]
public float? MaxTime { get; set; }
[<System.Text.Json.Serialization.JsonPropertyName("max_time")>]
member this.MaxTime : Nullable<single> with get, set
Public Property MaxTime As Nullable(Of Single)
Property Value
- Attributes
Remarks
This may not be supported by all models/inference API.