SequentialLaunchTrafficConfig

class SequentialLaunchTrafficConfig ( BaseTrafficConfig )

Launch sessions one at a time: the next session is activated only after the previous session’s request has been dispatched.

Polymorphic Type:

type: sequential_launch

All BaseTrafficConfig types:

• rate: RateTrafficConfig

• concurrent: ConcurrentTrafficConfig

• sequential_launch: SequentialLaunchTrafficConfig

Fields:

cancel_session_on_failurebool = True

Whether to cancel the session on failure of any request.

orderingstr = "dispatch"

When to advance the dispatch ticket and unblock the next request. dispatch: after HTTP 200 (before streaming); prefill: after first content chunk (TTFC); request: after full completion.