| dragon_export_gguf | R Documentation |
Converts a merged model directory to GGUF for use with llama.cpp, Ollama,
and similar runtimes. Requires a llama.cpp checkout; point the
LLAMA_CPP_DIR environment variable at it.
dragon_export_gguf(
merged_dir,
out_file = NULL,
quant = "q8_0",
llama_cpp_dir = Sys.getenv("LLAMA_CPP_DIR", unset = "")
)
merged_dir |
A merged model directory from |
out_file |
Output path. Defaults to |
quant |
Output type passed to the converter, such as |
llama_cpp_dir |
Path to a llama.cpp checkout containing |
The output path, invisibly.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.