| estimate_runtime | R Documentation |
Rough back-of-the-envelope estimator to tell a user "this is going
to take about X hours" before they hit Run. The estimate scales
n_records * n_models * n_replicates by a per-call cost that
depends on model size, and adds a small fixed overhead per model
for weight loading.
estimate_runtime(
n_records,
ensemble,
seconds_per_call = NULL,
gpu = NULL,
throttled = FALSE
)
n_records |
Number of records in the corpus. |
ensemble |
A |
seconds_per_call |
Optional override for the per-call cost.
When |
gpu |
Whether to assume GPU inference. |
throttled |
If |
The estimate is intentionally coarse. Real wall-clock depends on hardware (GPU vs CPU), Ollama's model-swapping behaviour, prompt length, and other user-load on the machine. Treat the number as an order-of-magnitude estimate only.
A screenllm_estimate object: a list with n_calls,
seconds_per_call, seconds_total, human_readable, gpu,
hardware (a string describing the assumed hardware profile),
and a caveats character vector.
ens <- default_ensemble(backend = backend_mock())
estimate_runtime(n_records = 500, ensemble = ens, gpu = FALSE)
estimate_runtime(n_records = 500, ensemble = ens, gpu = TRUE)
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.