Share via

Iterations - Get Performance

  • Reference
Service:
Azure AI Services
API Version:
3.3

Get detailed performance information about an iteration.

GET {Endpoint}/customvision/v3.3/training/projects/{projectId}/iterations/{iterationId}/performance
With optional parameters: 
GET {Endpoint}/customvision/v3.3/training/projects/{projectId}/iterations/{iterationId}/performance?threshold={threshold}&overlapThreshold={overlapThreshold}

URI Parameters

Name In Required Type Description
Endpoint
 path True

string

Supported Cognitive Services endpoints.
iterationId
 path True

string

uuid

The id of the iteration to get.
projectId
 path True

string

uuid

The id of the project the iteration belongs to.
overlapThreshold
 query

number

float

If applicable, the bounding box overlap threshold used to determine true predictions.
threshold
 query

number

float

The threshold used to determine true predictions.

Request Header

Name Required Type Description
Training-Key True

string

Responses

Name Type Description
200 OK

IterationPerformance

OK

Media Types: "application/json", "application/xml", "text/xml"
Other Status Codes

CustomVisionError

Error response

Media Types: "application/json", "application/xml", "text/xml"

Security

Training-Key

Type: apiKey
In: header

Examples

Successful GetIterationPerformance request

Sample request

GET https://westus.api.cognitive.microsoft.com/customvision/v3.3/training/projects/bc3f7dad-5544-468c-8573-3ef04d55463e/iterations/fe1e83c4-6f50-4899-9544-6bb08cf0e15a/performance?threshold=0.9

Sample response

Status code:
200 
{
  "perTagPerformance": [
    {
      "id": "e31ff107-5505-4753-be42-b369b21b026c",
      "name": "Hemlock",
      "precision": 1,
      "precisionStdDeviation": 0,
      "recall": 1,
      "recallStdDeviation": 0
    },
    {
      "id": "349d72ac-0948-4d51-b1e4-c14a1f9b848a",
      "name": "Japanese Cherry",
      "precision": 1,
      "precisionStdDeviation": 0,
      "recall": 1,
      "recallStdDeviation": 0
    }
  ],
  "precision": 1,
  "precisionStdDeviation": 0,
  "recall": 1,
  "recallStdDeviation": 0
}

Definitions

Name Description
CustomVisionError
CustomVisionErrorCodes

The error code.
IterationPerformance

Represents the detailed performance data for a trained iteration.
TagPerformance

Represents performance data for a particular tag in a trained iteration.

CustomVisionError

Name Type Description
code

CustomVisionErrorCodes

The error code.
message

string

A message explaining the error reported by the service.

CustomVisionErrorCodes

The error code.

Name Type Description
BadRequest

string

BadRequestCannotMigrateProjectWithName

string

BadRequestClassificationTrainingValidationFailed

string

BadRequestCustomerManagedKeyRevoked

string

BadRequestDetectionTrainingNotAllowNegativeTag

string

BadRequestDetectionTrainingValidationFailed

string

BadRequestDomainNotSupportedForAdvancedTraining

string

BadRequestExceedIterationPerProjectLimit

string

BadRequestExceedProjectLimit

string

BadRequestExceedTagPerImageLimit

string

BadRequestExceedTagPerProjectLimit

string

BadRequestExceededBatchSize

string

BadRequestExceededQuota

string

BadRequestExportAlreadyInProgress

string

BadRequestExportPlatformNotSupportedForAdvancedTraining

string

BadRequestExportValidationFailed

string

BadRequestExportWhileTraining

string

BadRequestImageBatch

string

BadRequestImageDimensions

string

BadRequestImageExceededCount

string

BadRequestImageFormat

string

BadRequestImageMetadataKey

string

BadRequestImageMetadataValue

string

BadRequestImageRegions

string

BadRequestImageSizeBytes

string

BadRequestImageStream

string

BadRequestImageTags

string

BadRequestImageUrl

string

BadRequestInvalid

string

BadRequestInvalidArtifactUri

string

BadRequestInvalidEmailAddress

string

BadRequestInvalidIds

string

BadRequestInvalidImportToken

string

BadRequestInvalidPublishName

string

BadRequestInvalidPublishTarget

string

BadRequestIterationDescription

string

BadRequestIterationIsNotTrained

string

BadRequestIterationIsPublished

string

BadRequestIterationName

string

BadRequestIterationNameNotUnique

string

BadRequestIterationNotPublished

string

BadRequestIterationValidationFailed

string

BadRequestMultiClassClassificationTrainingValidationFailed

string

BadRequestMultiLabelClassificationTrainingValidationFailed

string

BadRequestMultipleGeneralProductTag

string

BadRequestMultipleNegativeTag

string

BadRequestNegativeAndRegularTagOnSameImage

string

BadRequestNotLimitedTrial

string

BadRequestNotSupported

string

BadRequestOperationNotSupported

string

BadRequestPredictionIdsExceededCount

string

BadRequestPredictionIdsMissing

string

BadRequestPredictionInvalidApplicationName

string

BadRequestPredictionInvalidQueryParameters

string

BadRequestPredictionResultsExceededCount

string

BadRequestPredictionTagsExceededCount

string

BadRequestProjectDescription

string

BadRequestProjectDuplicated

string

BadRequestProjectImagePreprocessingSettings

string

BadRequestProjectName

string

BadRequestProjectNameNotUnique

string

BadRequestProjectUnknownClassification

string

BadRequestProjectUnknownDomain

string

BadRequestProjectUnsupportedDomainTypeChange

string

BadRequestProjectUnsupportedExportPlatform

string

BadRequestRequiredParamIsNull

string

BadRequestReservedBudgetInHoursNotEnoughForAdvancedTraining

string

BadRequestSubscriptionApi

string

BadRequestTagDescription

string

BadRequestTagName

string

BadRequestTagNameNotUnique

string

BadRequestTagType

string

BadRequestTrainingAlreadyInProgress

string

BadRequestTrainingNotNeeded

string

BadRequestTrainingNotNeededButTrainingPipelineUpdated

string

BadRequestTrainingValidationFailed

string

BadRequestUnpublishFailed

string

BadRequestUnsupportedDomain

string

BadRequestWorkspaceCannotBeModified

string

BadRequestWorkspaceNotDeletable

string

Conflict

string

ConflictInvalid

string

ErrorExporterInvalidClassifier

string

ErrorExporterInvalidFeaturizer

string

ErrorExporterInvalidPlatform

string

ErrorFeaturizationAugmentationError

string

ErrorFeaturizationAugmentationUnavailable

string

ErrorFeaturizationInvalidFeaturizer

string

ErrorFeaturizationQueueTimeout

string

ErrorFeaturizationServiceUnavailable

string

ErrorFeaturizationUnrecognizedJob

string

ErrorInvalid

string

ErrorIterationCopyFailed

string

ErrorPrediction

string

ErrorPredictionModelNotCached

string

ErrorPredictionModelNotFound

string

ErrorPredictionServiceUnavailable

string

ErrorPredictionStorage

string

ErrorPreparePerformanceMigrationFailed

string

ErrorProjectExportRequestFailed

string

ErrorProjectImportRequestFailed

string

ErrorProjectInvalidDomain

string

ErrorProjectInvalidPipelineConfiguration

string

ErrorProjectInvalidWorkspace

string

ErrorProjectTrainingRequestFailed

string

ErrorRegionProposal

string

ErrorUnknown

string

ErrorUnknownBaseModel

string

Forbidden

string

ForbiddenDRModeEnabled

string

ForbiddenInvalid

string

ForbiddenUser

string

ForbiddenUserDisabled

string

ForbiddenUserDoesNotExist

string

ForbiddenUserInsufficientCapability

string

ForbiddenUserResource

string

ForbiddenUserSignupAllowanceExceeded

string

ForbiddenUserSignupDisabled

string

NoError

string

NotFound

string

NotFoundApimSubscription

string

NotFoundDomain

string

NotFoundImage

string

NotFoundInvalid

string

NotFoundIteration

string

NotFoundIterationPerformance

string

NotFoundProject

string

NotFoundProjectDefaultIteration

string

NotFoundTag

string

UnsupportedMediaType

string

IterationPerformance

Represents the detailed performance data for a trained iteration.

Name Type Description
averagePrecision

number

Gets the average precision when applicable.
perTagPerformance

TagPerformance[]

Gets the per-tag performance details for this iteration.
precision

number

Gets the precision.
precisionStdDeviation

number

Gets the standard deviation for the precision.
recall

number

Gets the recall.
recallStdDeviation

number

Gets the standard deviation for the recall.

TagPerformance

Represents performance data for a particular tag in a trained iteration.

Name Type Description
averagePrecision

number

Gets the average precision when applicable.
id

string

name

string

precision

number

Gets the precision.
precisionStdDeviation

number

Gets the standard deviation for the precision.
recall

number

Gets the recall.
recallStdDeviation

number

Gets the standard deviation for the recall.