s3nh

s3nh

AI & ML interests

Quantization, LLMs, Deep Learning for good. Follow me if you like my work. Patreon.com/s3nh

Organizations

s3nh's activity

New activity in s3nh/Chinese-LLaVA-Baichuan-GGML 7 months ago
New activity in s3nh/Mistral_Sonyichi-7B-slerp 7 months ago
New activity in s3nh/Severusectum-7B-DPO 7 months ago
New activity in s3nh/Noromaid-Aeryth-7B 7 months ago
New activity in s3nh/SeverusWestLake-7B-DPO 7 months ago
New activity in s3nh/OEvortex-HelpingAI-GGUF 8 months ago

Hello bro

12
#1 opened 9 months ago by Abhaykoul
New activity in s3nh/SnowLotus-v2-10.7B-GGUF 8 months ago

Problem with Quants

5
#2 opened 8 months ago by Clevyby
New activity in s3nh/Blurred-Beagle-7b-slerp-GGUF 8 months ago

ty<3

1
#1 opened 8 months ago by gate369
New activity in s3nh/SnowLotus-v2-10.7B-GGUF 8 months ago

Thanks :)

1
#1 opened 8 months ago by BlueNipples
New activity in social-post-explorers/README 8 months ago
New activity in s3nh/Noromaid-Aeryth-7B-GGUF 8 months ago

Deleted GGUF?

6
#1 opened 8 months ago by EloyOn
New activity in social-post-explorers/README 8 months ago

429 error

#18 opened 8 months ago by s3nh
New activity in s3nh/GOAT-Adapt-MoE-4x7B 8 months ago

Citation of AdaptLLM paper

3
#1 opened 8 months ago by AdaptLLM
New activity in s3nh/Mistral_Sonyichi-7B-slerp 8 months ago

Quants?

4
#1 opened 8 months ago by EloyOn
New activity in s3nh/s3nh-nsfw-noromaid-zephyr-GGUF 8 months ago

Producing garbage output

2
#1 opened 8 months ago by WeiCon
New activity in s3nh/Masterjp123-NeuralMaid-7b-GGUF 9 months ago
New activity in s3nh/Mistral-7B-Evol-Instruct-Chinese 9 months ago

Can make it to GGUF?

5
#1 opened 9 months ago by zhangtao103239
New activity in s3nh/AdaptLLM-medicine-LLM-13B-GGUF 9 months ago

GGUF version request

2
#1 opened 9 months ago by HR1777
New activity in s3nh/OEvortex-HelpingAI-GGUF 9 months ago

Request

5
#2 opened 9 months ago by HR1777
New activity in s3nh/Undi95-Unholy-v2-13B-GGUF 9 months ago

Where are the GGUF files?

3
#1 opened 9 months ago by HR1777
New activity in s3nh/ToolBench-ToolLLaMA-2-7b-v1-GGUF 9 months ago

New ToolLLaMa Version

2
#1 opened 9 months ago by Firejowl
New activity in openchat/openchat_3.5 10 months ago

Model Not Loading

4
#16 opened 10 months ago by aslawliet
New activity in s3nh/azale-ai-Starstreak-7b-alpha-GGUF 11 months ago

Convert model to GPTQ

1
#1 opened 11 months ago by hafidhsoekma
New activity in s3nh/DialoGPT-medium-4000steps-polish about 1 year ago
New activity in s3nh/gpt2-open-instruct-v1-polish about 1 year ago
New activity in s3nh/Photolens-llama-2-13b-langchain-chat-GGUF about 1 year ago
New activity in s3nh/totally-not-an-llm-AlpacaCielo2-7b-8k-GPTQ about 1 year ago

Have you got it to work?

3
#1 opened about 1 year ago by totally-not-an-llm
New activity in s3nh/StableBeluga-7B-GGML about 1 year ago

How to convert that to ggml?

5
#1 opened about 1 year ago by RoversX
New activity in s3nh/chinese-alpaca-2-7b-GGML about 1 year ago

选择模板后报错!

2
#1 opened about 1 year ago by aldennX
New activity in s3nh/gywy-llama2-13b-chinese-v1-GGML about 1 year ago

Thank you for the work!

1
#1 opened about 1 year ago by WoolCool
New activity in s3nh/LLaMA-2-7B-32K-GGML about 1 year ago

Not compatible with llama.cpp

8
#2 opened about 1 year ago by AmazingTurtle

model outputs with ctransformers

8
#1 opened about 1 year ago by pszemraj
New activity in s3nh/LLaMA-2-7B-32K-GGML about 1 year ago
New activity in togethercomputer/LLaMA-2-7B-32K about 1 year ago

GGML Version

8
#4 opened about 1 year ago by s3nh
New activity in s3nh/StableBeluga-7B-GPTQ about 1 year ago

Wrong modell?

2
#1 opened about 1 year ago by Tibbnak
New activity in s3nh/mamba-gpt-3b-v3-GGML about 1 year ago

Question

2
#1 opened about 1 year ago by Aryanne
New activity in stabilityai/StableBeluga-13B about 1 year ago

GGML format

#1 opened about 1 year ago by s3nh
New activity in CobraMamba/mamba-gpt-3b-v3 about 1 year ago

GGML Version

#1 opened about 1 year ago by s3nh
New activity in stabilityai/StableBeluga-7B about 1 year ago

GGML format

#1 opened about 1 year ago by s3nh
New activity in s3nh/Baichuan-13B-Instruction-GPTQ about 1 year ago

exllama can't load.

3
#1 opened about 1 year ago by peterzhu
New activity in s3nh/Baichuan-13B-Instruction-GGML about 1 year ago

生成似乎是乱码

4
#1 opened about 1 year ago by WoolCool
New activity in AlpachinoNLP/Baichuan-13B-Instruction about 1 year ago

GGML version

#1 opened about 1 year ago by s3nh
New activity in s3nh/DialoGPT-small-5000steps-polish about 1 year ago
New activity in CobraMamba/mamba-gpt-3b-v2 about 1 year ago

GGML version

1
#1 opened about 1 year ago by s3nh
New activity in s3nh/mamba-gpt-3b-GGML about 1 year ago

Quantizations

3
#1 opened about 1 year ago by Aryanne