Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
veeksha
veeksha

Getting Started

  • Getting Started
    • Why Veeksha?
    • Installation
    • Quick start

User Guide

  • User Guide
    • Configuration System
    • Workload recipes
    • Output Files
    • Capacity Search
    • Configuration Sweeps
    • Server Management
    • Weights & Biases Integration
    • Microbenchmarks

Design

  • Design & Architecture
    • System Architecture
    • Sessions and Graphs
    • Content Generation
    • Traffic Scheduling
    • Evaluation and Metrics

Reference

  • Reference
    • Programmatic usage
    • Configuration Reference
      • API Reference
        • Base Session Generator
        • Lmeval Session Generator
        • Synthetic Session Generator
        • Trace Session Generator
        • Base Traffic
        • Concurrent Traffic
        • Rate Traffic
        • Sequential Launch Traffic
        • Base Client
        • OpenAI Chat Completions Client
        • OpenAI Completions Client
        • OpenAI Router Client
        • Base Server
        • SGLang Server
        • Vajra Server
        • vLLM Server
        • Base Evaluator
        • LMEval Accuracy Evaluator
        • Performance Evaluator
        • Audio Channel Performance
        • Image Channel Performance
        • Text Channel Performance
        • Video Channel Performance
        • Base Length Generator
        • Fixed Length Generator
        • Inverse Gaussian Length Generator
        • Stair Length Generator
        • Uniform Length Generator
        • Zipf Length Generator
        • Base Interval Generator
        • Fixed Interval Generator
        • Gamma Interval Generator
        • Poisson Interval Generator
        • Audio Channel Generator
        • Base Channel Generator
        • Image Channel Generator
        • Text Channel Generator
        • Video Channel Generator
        • Base Session Graph Generator
        • Branching Session Graph Generator
        • Linear Session Graph Generator
        • Single Request Session Graph Generator
        • Base Trace Flavor
        • RAG Trace Flavor
        • Request Log Trace Flavor
        • Shared Prefix Trace Flavor
        • Timed Synthetic Session Trace Flavor
        • Untimed Content Multi Turn Trace Flavor
        • Base Slo
        • Constant Slo
        • Audio Output Spec
        • Decode Window
        • Image Output Spec
        • Output Spec
        • Runtime
        • Text Output Spec
        • Trace Recorder
        • Video Output Spec
        • Wandb
Back to top
View this page

SingleRequestSessionGraphGeneratorConfigΒΆ

class SingleRequestSessionGraphGeneratorConfig ( BaseSessionGraphGeneratorConfig )

Generator of single request graphs (a single request).

Polymorphic Type:

type: single_request

All BaseSessionGraphGeneratorConfig types:

  • linear: LinearSessionGraphGeneratorConfig

  • single_request: SingleRequestSessionGraphGeneratorConfig

  • branching: BranchingSessionGraphGeneratorConfig

Next
BaseTraceFlavorConfig
Previous
LinearSessionGraphGeneratorConfig
Copyright © 2024-onwards Systems for AI Lab, Georgia Institute of Technology
Made with Sphinx and @pradyunsg's Furo