Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16 5ee9445 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 8c21d0b verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 9f10d3e verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_S 5f8e853 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_1 18d5826 verified jartine commited on Apr 1
Add mixtral-8x7b-instruct-v0.1.Q8_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 437f800 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 40eb574 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a cec6a20 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q5_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a f7552a9 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 7638a3a jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q4_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a efb2ef6 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 36dcd62 jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 09c84bb jartine commited on Dec 29, 2023
Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a 2524b82 jartine commited on Dec 29, 2023
jartine
commited on
