llm_custom: Send a custom prompt to the LLM

In mall: Run Multiple Large Language Model Predictions Against a Table, or Vectors

Send a custom prompt to the LLM

Description

Use a Large Language Model (LLM) to process the provided text using the instructions from prompt

Usage

llm_custom(.data, col, prompt = "", pred_name = ".pred", valid_resps = "")

llm_vec_custom(x, prompt = "", valid_resps = NULL)

Arguments

.data	A data.frame or tbl object that contains the text to be analyzed
col	The name of the field to analyze, supports tidy-eval
prompt	The prompt to append to each record sent to the LLM
pred_name	A character vector with the name of the new column where the prediction will be placed
valid_resps	If the response from the LLM is not open, but deterministic, provide the options in a vector. This function will set to NA any response not in the options
x	A vector that contains the text to be analyzed

Value

llm_custom returns a data.frame or tbl object. llm_vec_custom returns a vector that is the same length as x.

Examples

library(mall)

data("reviews")

llm_use("ollama", "llama3.2", seed = 100, .silent = TRUE)

my_prompt <- paste(
  "Answer a question.",
  "Return only the answer, no explanation",
  "Acceptable answers are 'yes', 'no'",
  "Answer this about the following text, is this a happy customer?:"
)

reviews |>
  llm_custom(review, my_prompt)

mall documentation built on Oct. 24, 2024, 5:09 p.m.