Build GuidesQ4_K_M vs Q6_K vs FP8: the quality you lose and what fits your GPU
BF16, FP8, MXFP8, NVFP4, INT4 and a dozen GGUF flavours, compared. What published benchmarks say about quality loss, and how to pick the file for your GPU or Mac.
October 23, 20268 min readDerrick K.
