| quantize_row_q2_K_ref | R Documentation |
Basic row-level K-quant quantization without importance matrix.
quantize_row_q2_K_ref(src_data, n_elements)
quantize_row_q3_K_ref(src_data, n_elements)
quantize_row_q4_K_ref(src_data, n_elements)
quantize_row_q5_K_ref(src_data, n_elements)
quantize_row_q6_K_ref(src_data, n_elements)
quantize_row_q8_K_ref(src_data, n_elements)
src_data |
Numeric vector of float values to quantize |
n_elements |
Number of elements to quantize |
Raw vector of quantized data
Other quantization:
dequantize_row_iq2_xxs(),
dequantize_row_mxfp4(),
dequantize_row_nvfp4(),
dequantize_row_q1_0(),
dequantize_row_q2_K(),
dequantize_row_q4_0(),
dequantize_row_tq1_0(),
ggml_quant_block_info(),
iq2xs_free_impl(),
iq2xs_init_impl(),
iq3xs_free_impl(),
iq3xs_init_impl(),
quantize_iq2_xxs(),
quantize_mxfp4(),
quantize_nvfp4(),
quantize_q1_0(),
quantize_q2_K(),
quantize_q4_0(),
quantize_row_iq3_xxs_ref(),
quantize_row_mxfp4_ref(),
quantize_row_q4_0_ref(),
quantize_row_tq1_0_ref(),
quantize_tq1_0()
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.