Hugging Face's logo

shenzhi-wang
/
Llama3-70B-Chinese-Chat

Text Generation
Transformers
Safetensors
English
Chinese
llama
llama-factory
orpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
12
New discussion

[AUTOMATED] Model Memory Requirements
#12 opened 4 months ago by model-sizer-bot

ValueError: Trying to set a tensor of shape torch.Size([1024, 8192]) in "weight" (which has shape torch.Size([8192, 8192])), this look incorrect.

1
#11 opened 5 months ago by Dongsz

请问加载这个模型要多少GPU？我24000+的提示out of memory

1
#10 opened 5 months ago by zyc1128

Request: DOI

4
#9 opened 6 months ago by luxen1234

没有在线体验的demo吗?

4
#8 opened 6 months ago by jansen-liu

请问能否提供EXL2量化版本?

1
#7 opened 6 months ago by Orion-zhen

能不能提供awq或gptq量化模型

5
#6 opened 6 months ago by bujido

请问能提供GPTQ-Int8版本吗？

4
#5 opened 6 months ago by worldggg

Can you provide the Q5_k_s.gguf model? Thank you.
#4 opened 6 months ago by juexing2024

perfect!!!

2
#3 opened 6 months ago by bluestarry