ModelCapacityCalculatorWorkloadRequestParam interface
Dictionary, Model Capacity Calculator Workload Parameters.
Properties
| avg |
Average generated tokens. |
| avg |
Average prompt tokens. |
Property Details
avgGeneratedTokens
Average generated tokens.
avgGeneratedTokens?: numberProperty Value
number
avgPromptTokens
Average prompt tokens.
avgPromptTokens?: numberProperty Value
number