New discussion

Fails with transformers==4.38.1

#30 opened 7 months ago by rohithkrn

AUTOGPTQ Error in Google Colab

6
#25 opened 11 months ago by echogit

Does the model response correctly

1
#24 opened 12 months ago by mnwato

The response is not formatted

#18 opened about 1 year ago by Octavian81

for faster GPU inference

2
#15 opened about 1 year ago by harithushan

Update for Transformers GPTQ support

#13 opened about 1 year ago by TheBloke

LORA fine tuning error

#12 opened about 1 year ago by tongwuhugging

TGI error

#5 opened about 1 year ago by aiamateur101