API Reference

This section contains the API reference for all configuration classes, organized by category.

Root configurations

• BenchmarkConfig - Configuration for veeksha.benchmark runs

• CapacitySearchConfig - Configuration for veeksha.capacity_search runs

Session generators

• Base Session Generator
• Lmeval Session Generator
• Synthetic Session Generator
• Trace Session Generator

Traffic schedulers

• Base Traffic
• Concurrent Traffic
• Rate Traffic
• Sequential Launch Traffic

Clients

• Base Client
• OpenAI Chat Completions Client
• OpenAI Completions Client
• OpenAI Router Client

Servers

• Base Server
• SGLang Server
• Vajra Server
• vLLM Server

Evaluators

• Base Evaluator
• LMEval Accuracy Evaluator
• Performance Evaluator

Channel performance

• Audio Channel Performance
• Image Channel Performance
• Text Channel Performance
• Video Channel Performance

Length generators

• Base Length Generator
• Fixed Length Generator
• Inverse Gaussian Length Generator
• Stair Length Generator
• Uniform Length Generator
• Zipf Length Generator

Interval generators

• Base Interval Generator
• Fixed Interval Generator
• Gamma Interval Generator
• Poisson Interval Generator

Channel generators

• Audio Channel Generator
• Base Channel Generator
• Image Channel Generator
• Text Channel Generator
• Video Channel Generator

Session graph generators

• Base Session Graph Generator
• Branching Session Graph Generator
• Linear Session Graph Generator
• Single Request Session Graph Generator

Trace flavors

• Base Trace Flavor
• RAG Trace Flavor
• Request Log Trace Flavor
• Shared Prefix Trace Flavor
• Timed Synthetic Session Trace Flavor
• Untimed Content Multi Turn Trace Flavor

SLO configs

• Base Slo
• Constant Slo

Other

• Audio Output Spec
• Decode Window
• Image Output Spec
• Output Spec
• Runtime
• Text Output Spec
• Trace Recorder
• Video Output Spec
• Wandb