Share via


HuggingFacePromptExecutionSettings.MaxTime Property

Definition

(Default: None). Float (0-120.0). The amount of time in seconds that the query should take maximum. Network can cause some overhead so it will be a soft limit. Use that in combination with max_new_tokens for best results.

[System.Text.Json.Serialization.JsonPropertyName("max_time")]
public float? MaxTime { get; set; }
[<System.Text.Json.Serialization.JsonPropertyName("max_time")>]
member this.MaxTime : Nullable<single> with get, set
Public Property MaxTime As Nullable(Of Single)

Property Value

Attributes

Remarks

This may not be supported by all models/inference API.

Applies to