| dragon_hardware | R Documentation |
Hardware settings
dragon_hardware(
device = c("auto", "cuda", "mps", "cpu"),
dtype = c("auto", "bfloat16", "float16", "float32"),
load_in_4bit = FALSE
)
device |
|
dtype |
|
load_in_4bit |
Load the base model in 4-bit through bitsandbytes. Only available on Linux with CUDA. |
A dragon_hardware object.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.