Hugging Face's logo
Sipho's picture
7

Sipho

DQ83
·

AI & ML interests

None yet

Organizations

None yet

DQ83's activity

New activity in TheBloke/CodeFuse-CodeLlama-34B-GPTQ about 1 year ago

How to Instruct Template in TGI?

1
#1 opened about 1 year ago by Anphex
New activity in TheBloke/WizardCoder-15B-1.0-GPTQ about 1 year ago

Exllama not working

3
#16 opened about 1 year ago by DQ83

8bit GPTQ model

5
#3 opened over 1 year ago by 0dd1er
New activity in TheBloke/CodeLlama-34B-GPTQ over 1 year ago

Strange output in oobabooga

3
#2 opened over 1 year ago by JimClow
New activity in TheBloke/CodeLlama-13B-Instruct-GPTQ over 1 year ago

thanks for all the nice models. unfortunately all CodeLlamas throw "KeyError: ‘pad_token_id’"

6
#2 opened over 1 year ago by DQ83
New activity in TheBloke/LosslessMegaCoder-Llama2-13B-Mini-GGML over 1 year ago

how to get it working with Exlama ?

1
#1 opened over 1 year ago by DQ83
New activity in ToolBench/ToolLLaMA-2-7b-v1 over 1 year ago

what about an quantized version so we can load in Exlama with large context size?
#1 opened over 1 year ago by DQ83