| ggml_backend_multi_buffer_alloc_buffer | R Documentation |
Creates a buffer that combines multiple backend buffers into one. Useful for managing memory across different backends.
ggml_backend_multi_buffer_alloc_buffer(buffers)
buffers |
List of backend buffer external pointers |
External pointer to multi-buffer
Other backend:
ggml_backend_buffer_clear(),
ggml_backend_buffer_get_usage(),
ggml_backend_buffer_is_host(),
ggml_backend_buffer_is_multi_buffer(),
ggml_backend_buffer_reset(),
ggml_backend_buffer_set_usage(),
ggml_backend_buffer_usage_any(),
ggml_backend_buffer_usage_compute(),
ggml_backend_buffer_usage_weights(),
ggml_backend_dev_by_name(),
ggml_backend_dev_by_type(),
ggml_backend_dev_count(),
ggml_backend_dev_description(),
ggml_backend_dev_get(),
ggml_backend_dev_get_props(),
ggml_backend_dev_init(),
ggml_backend_dev_memory(),
ggml_backend_dev_name(),
ggml_backend_dev_offload_op(),
ggml_backend_dev_supports_buft(),
ggml_backend_dev_supports_op(),
ggml_backend_dev_type(),
ggml_backend_device_register(),
ggml_backend_device_type_accel(),
ggml_backend_device_type_cpu(),
ggml_backend_device_type_gpu(),
ggml_backend_device_type_igpu(),
ggml_backend_event_free(),
ggml_backend_event_new(),
ggml_backend_event_record(),
ggml_backend_event_synchronize(),
ggml_backend_event_wait(),
ggml_backend_get_device(),
ggml_backend_graph_compute_async(),
ggml_backend_graph_plan_compute(),
ggml_backend_graph_plan_create(),
ggml_backend_graph_plan_free(),
ggml_backend_init_best(),
ggml_backend_init_by_name(),
ggml_backend_init_by_type(),
ggml_backend_load(),
ggml_backend_load_all(),
ggml_backend_meta_device(),
ggml_backend_multi_buffer_set_usage(),
ggml_backend_reg_by_name(),
ggml_backend_reg_count(),
ggml_backend_reg_dev_count(),
ggml_backend_reg_dev_get(),
ggml_backend_reg_get(),
ggml_backend_reg_name(),
ggml_backend_register(),
ggml_backend_synchronize(),
ggml_backend_tensor_copy_async(),
ggml_backend_tensor_get_async(),
ggml_backend_tensor_set_async(),
ggml_backend_unload()
cpu <- ggml_backend_cpu_init()
ctx1 <- ggml_init(1024, no_alloc = TRUE)
ctx2 <- ggml_init(2048, no_alloc = TRUE)
a <- ggml_new_tensor_1d(ctx1, GGML_TYPE_F32, 10)
b <- ggml_new_tensor_1d(ctx2, GGML_TYPE_F32, 20)
buf1 <- ggml_backend_alloc_ctx_tensors(ctx1, cpu)
buf2 <- ggml_backend_alloc_ctx_tensors(ctx2, cpu)
multi <- ggml_backend_multi_buffer_alloc_buffer(list(buf1, buf2))
ggml_backend_buffer_free(multi)
ggml_backend_free(cpu)
ggml_free(ctx1)
ggml_free(ctx2)
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.