PerformanceEvaluatorConfigΒΆ
class PerformanceEvaluatorConfig ( BaseEvaluatorConfig )
Configuration for system performance evaluation.
Polymorphic Type:
type: performanceAll
BaseEvaluatorConfigtypes:
performance: PerformanceEvaluatorConfig
accuracy_lmeval: LMEvalAccuracyEvaluatorConfig
Fields:
target_channelslist =['text']List of ChannelModality values to evaluate.
sloslist [ BaseSloConfig ] =[<ConstantSloConfig>]List of SLO definitions to evaluate against request-level metrics.
Available types:
constant: ConstantSloConfig
stream_metricsbool =TrueEnable real-time metric streaming
stream_metrics_intervalfloat =5.0Interval for streaming metrics in seconds
text_channelTextChannelPerformanceConfig = TextChannelPerformanceConfigText channel performance configuration
image_channelImageChannelPerformanceConfig = ImageChannelPerformanceConfigImage channel performance configuration
audio_channelOptional [ AudioChannelPerformanceConfig ] =NoneAudio channel performance configuration
video_channelOptional [ VideoChannelPerformanceConfig ] =NoneVideo channel performance configuration