mellea.stdlib.sampling.budget_forcing

Sampling Strategies for budget forcing generation.

Classes

CLASS BudgetForcingSamplingStrategy

Budget forcing sampling class.

Methods:

FUNC sample

sample(self, action: Component[S], context: Context, backend: Backend, requirements: list[Requirement] | None) -> SamplingResult[S]

This method performs a sampling operation based on the given instruction.

Args:

• action : The action object to be sampled.
• context: The context to be passed to the sampling strategy.
• backend: The backend used for generating samples.
• requirements: List of requirements to test against (merged with global requirements).
• validation_ctx: Optional context to use for validation. If None, validation_ctx = ctx.
• format: output format for structured outputs.
• model_options: model options to pass to the backend during generation / validation.
• tool_calls: True if tool calls should be used during this sampling strategy.
• show_progress: if true, a tqdm progress bar is used. Otherwise, messages will still be sent to flog.

Returns:

• A result object indicating the success or failure of the sampling process.

Raises:

• AssertionError: Asserts that all required components (repair, select_from_failure, validate, and generate) are provided before proceeding with the sampling.