jack seaver's picture

7

jack seaver

tutu329

AI & ML interests

None yet

Organizations

None yet

tutu329's activity

New activity in Shakker-Labs/AWPortrait-FL 3 months ago

why comfyui report: ERROR: Could not detect model type of: D:\ComfyUI\models\checkpoints\AWPortrait-FL-fp8.safetensors

#7 opened 3 months ago by

New activity in bosonai/Higgs-Llama-3-70B 6 months ago

it is a 70B model. why using almost 280GB disk？

#7 opened 6 months ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit 7 months ago

KeyError: 'model.layers.45.block_sparse_moe.gate.g_idx'

#2 opened 7 months ago by

New activity in Dogge/llama-3-70B-instruct-uncensored 7 months ago

will there be a gptq int4 version?

#1 opened 7 months ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit 7 months ago

no special_tokens_map.json tokenizer_config.json and tokenizer.json

#1 opened 7 months ago by

New activity in MaziyarPanahi/miqu-1-70b-sf-GPTQ 10 months ago

vllm can not inter this model (other 70b gptq model are ok)

#1 opened 10 months ago by

New activity in TheBloke/Qwen-14B-Chat-AWQ 12 months ago

hope there is a qwen-72b-chat-awq（can be inferenced by vllm）

#3 opened 12 months ago by