EndpointConfig

class EndpointConfig

Client-facing contract for an inference endpoint.

Fields:

engine_typestr = ""

Endpoint engine type: vajra, vllm, or sglang.

modelstr = ""

Model name exposed by the endpoint.

api_basestr = ""

OpenAI-compatible API base URL.

api_keyOptional [ str ] = None

API key for the endpoint.

health_urlOptional [ str ] = None

Health endpoint URL.

hoststr = "localhost"

Host used for local port ownership checks.

portint = 0

Host port owned by the endpoint.