Quantization

Also called: quantized, quantize, quantised, 4-bit, 8-bit, GGUF

Shrinking a model by storing its weights with fewer digits of precision. The model gets smaller and faster, usually with a small loss in quality, which helps run it on laptops and phones.

For example: A model too large for a laptop runs comfortably after it is quantized to 4-bit weights.