BaseClientConfig

class BaseClientConfig ( BasePolyConfig )

LLM client configuration (OpenAI-compatible API).

Polymorphic Type:

All BaseClientConfig types:

• openai_chat_completions: OpenAIChatCompletionsClientConfig

• openai_completions: OpenAICompletionsClientConfig

• openai_router: OpenAIRouterClientConfig

Fields:

api_baseOptional [ str ] = None

API base URL. Defaults to OPENAI_API_BASE env var.

api_keyOptional [ str ] = None

API key. Defaults to OPENAI_API_KEY env var.

modelstr = "meta-llama/Meta-Llama-3-8B-Instruct"

The model to use for this load test.

address_append_valuestr = "chat/completions"

The address append value for the LLM API.

request_timeoutint = 300

The timeout for each request to the LLM API (in seconds).

additional_sampling_paramsstr = "{}"

Additional sampling params to send with each request to the LLM API.