GGML_TYPE_F32: GGML Data Types

GGML_TYPE_F32R Documentation

GGML Data Types

Description

Constants representing different data types supported by GGML.

Usage

GGML_TYPE_F32

GGML_TYPE_F16

GGML_TYPE_Q4_0

GGML_TYPE_Q4_1

GGML_TYPE_Q8_0

GGML_TYPE_Q2_K

GGML_TYPE_Q3_K

GGML_TYPE_Q4_K

GGML_TYPE_Q5_K

GGML_TYPE_Q6_K

GGML_TYPE_I32

GGML_TYPE_BF16

Format

Integer constants

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

Details

  • GGML_TYPE_F32: 32-bit floating point (default)

  • GGML_TYPE_F16: 16-bit floating point (half precision)

  • GGML_TYPE_Q4_0: 4-bit quantization type 0

  • GGML_TYPE_Q4_1: 4-bit quantization type 1

  • GGML_TYPE_Q8_0: 8-bit quantization type 0

  • GGML_TYPE_I32: 32-bit integer

  • GGML_TYPE_BF16: 16-bit brain float (bfloat16)

Value

An integer constant representing a GGML data type

Examples


GGML_TYPE_F32
GGML_TYPE_F16
GGML_TYPE_I32


ggmlR documentation built on July 14, 2026, 1:08 a.m.