fetch_mistral_batch: Fetch Results for an Mistral Batch
In tidyllm: Tidy Integration of Large Language Models

fetch_mistral_batch

R Documentation

Fetch Results for an Mistral Batch

Description

This function retrieves the results of a completed Mistral batch and updates the provided list of LLMMessage objects with the responses. It aligns each response with the original request using the custom_ids generated in send_mistral_batch().

Usage

fetch_mistral_batch(
  .llms,
  .batch_id = NULL,
  .dry_run = FALSE,
  .max_tries = 3,
  .timeout = 60
)

Arguments

`.llms`	A list of `LLMMessage` objects that were part of the batch.
`.batch_id`	Character; the unique identifier for the batch. By default this is NULL and the function will attempt to use the `batch_id` attribute from `.llms`.
`.dry_run`	Logical; if `TRUE`, returns the constructed request without executing it (default: `FALSE`).
`.max_tries`	Integer; maximum number of retries if the request fails (default: `3`).
`.timeout`	Integer; request timeout in seconds (default: `60`).