Microsoft.Extensions.AI.Evaluation.Reporting Namespace
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Classes
ReportingConfiguration |
Represents the configuration for a set of ScenarioRuns that defines the set of IEvaluators that should be invoked, the ChatConfiguration that should be used by these IEvaluators, how the resulting ScenarioRunResults should be persisted, and how AI responses should be cached. |
ResponseCachingChatClient |
An IChatClient that wraps another IChatClient and caches all responses generated using the wrapped IChatClient in the supplied IDistributedCache. |
ScenarioRun |
Represents a single execution of a particular iteration of a particular scenario under evaluation. |
ScenarioRunExtensions |
Extension methods for ScenarioRun. |
ScenarioRunResult |
Represents the results of a single execution of a particular iteration of a particular scenario under evaluation. In other words, ScenarioRunResult represents the results of evaluating a ScenarioRun and includes the EvaluationResult that is produced when EvaluateAsync(IEnumerable<ChatMessage>, ChatMessage, IEnumerable<EvaluationContext>, CancellationToken) is invoked. |
ScenarioRunResultExtensions |
Extension methods for ScenarioRunResult. |
Interfaces
IEvaluationReportWriter |
Generates a report containing all the EvaluationMetrics present in the supplied ScenarioRunResults. |
IResponseCacheProvider |
Provides a way to get the IDistributedCache that caches the AI responses associated with a particular ScenarioRun. |
IResultStore |
Represents a store for ScenarioRunResults. |