LmevalSessionGeneratorConfig ============================ **class** ``LmevalSessionGeneratorConfig`` **(** :doc:`BaseSessionGeneratorConfig` **)** **Polymorphic Type:** ``type: lmeval`` All ``BaseSessionGeneratorConfig`` types: - ``synthetic``: :doc:`SyntheticSessionGeneratorConfig` - ``lmeval``: :doc:`LmevalSessionGeneratorConfig` - ``trace``: :doc:`TraceSessionGeneratorConfig` **Fields:** ``tasks`` : *list* [ *str* ] = ``['hellaswag']`` The lm-eval tasks to evaluate the model on. ``num_fewshot`` : *int* = ``1`` The number of fewshot examples to use for the tasks.