RuntimeConfig

class RuntimeConfig

Fields:

max_sessionsint = 25

Maximum number of sessions to generate. -1 for unlimited.

benchmark_timeoutint = 300

Benchmark timeout in seconds.

post_timeout_grace_secondsint = -1

Grace period for in-flight requests after timeout. -1 waits for all, 0 exits immediately.

num_dispatcher_threadsint = 2

Number of threads for dispatching requests to workers.

num_completion_threadsint = 8

Number of threads for processing completed requests. Completion workers also run per-request ASR scoring concurrently, so under-provisioning stretches the post-run drain.

num_client_threadsOptional [ int ] = None

Number of async worker threads for making concurrent requests. None provisions one thread per eight target-concurrent sessions, with a minimum of three. Under-provisioning stretches realtime send cadence and invalidates high-concurrency latency metrics.

pregenerate_sessionsbool = False

Pre-generate all sessions before starting benchmark timer. Requires max_sessions > 0.