Unsloth MiniMax M2.7 quants just finished uploading to HF

Posted by Zyj@reddit | LocalLLaMA | View on Reddit | 94 comments

They range from Q1 to BF16.

Grab them while they're still hot over at

https://huggingface.co/unsloth/MiniMax-M2.7-GGUF

Thanks to u/danielhanchen!

Here's a list:

Quantisation (Label) GB (1024\^3 Bytes)
UD-IQ1_M 56,53 GB
UD-IQ2_XXS 60,89 GB
UD-IQ2_M 65,32 GB
UD-Q2_K_XL 70,11 GB
UD-IQ3_XXS 74,60 GB
UD-IQ3_S 77,87 GB
UD-Q3_K_S 87,21 GB
UD-Q3_K_M 94,29 GB
UD-Q3_K_XL 94,94 GB
UD-IQ4_XS 100,97 GB
UD-IQ4_NL 103,15 GB
UD-Q4_K_S 121,67 GB
MXFP4_MOE 126,67 GB
UD-Q4_K_M 130,40 GB
UD-Q4_K_XL 130,96 GB
UD-Q5_K_S 147,97 GB
UD-Q5_K_M 157,23 GB
UD-Q5_K_XL 157,81 GB
UD-Q6_K 175,15 GB
UD-Q6_K_XL 193,20 GB
Q8_0 226,44 GB
UD-Q8_K_XL 229,64 GB
BF16 426,07 GB