batch.sequential_chat: Process a batch of prompts with a sequential chat

In hellmer: Batch Processing for Chat Models

Process a batch of prompts with a sequential chat

Description

Process a batch of prompts with a sequential chat

Usage

batch.sequential_chat(
  chat_env,
  prompts,
  type_spec = NULL,
  judgements = 0,
  state_path = tempfile("chat_", fileext = ".rds"),
  progress = TRUE,
  max_retries = 3L,
  initial_delay = 20,
  max_delay = 80,
  backoff_factor = 2,
  beep = TRUE,
  echo = FALSE,
  ...
)

Arguments

chat_env	The chat environment from chat_sequential
prompts	List of prompts to process
type_spec	Type specification for structured data extraction
judgements	Number of judgements (1 = initial extract + 1 judgement, 2 = initial extract + 2 judgements, etc.)
state_path	Path to save state file
progress	Whether to show progress bars
max_retries	Maximum number of retry attempts for failed requests
initial_delay	Initial delay before first retry in seconds
max_delay	Maximum delay between retries in seconds
backoff_factor	Factor to multiply delay by after each retry
beep	Whether to play a sound on completion
echo	Whether to display chat outputs (when progress is FALSE)
...	Additional arguments passed to the chat method

Value

A batch object with the processed results

hellmer documentation built on June 8, 2025, 11:09 a.m.