New discussion

Fp16 -> GGUF 8B script?

1
#40 opened 7 days ago by vdruts

Not able to download it

1
#38 opened about 1 month ago by iffishells

Create config.json

#34 opened 2 months ago by Jash-RA

video

#33 opened 2 months ago by goodasdgood

run

1
#32 opened 2 months ago by goodasdgood

Is it using ggml to compute?

1
#30 opened 3 months ago by CHNtentes

FLUX GGUF conversion

1
#29 opened 3 months ago by bsingh1324

cant see the Q5_K_M gguf quant

2
#28 opened 3 months ago by Ai11Ali

Q8 vs Q4_1 vs FP8 on a 1070ti

#23 opened 3 months ago by gfl1973

Changelog

#22 opened 3 months ago by Shehab007

Which one is the best?

12
#21 opened 3 months ago by akiokawahito

Can you add Q4K_m please ?

1
#19 opened 3 months ago by mirek190

Can it use LoRAs?

2
#13 opened 3 months ago by zdeto

My experience

9
#9 opened 3 months ago by SaisExperiments

k-quants possible?

5
#2 opened 3 months ago by CHNtentes