hugging-quants
/

Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Update tokenizer_config.json

#8

by ykhwang - opened Jul 30

base: refs/heads/main

←

from: refs/pr/8

Discussion Files changed

Update tokenizer_config.jsondc284a3d

ykhwang

Jul 30

Reference: https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct/commit/f9801cba95a53242b3cc928a4a418d12571d1c5f

ykhwang

Jul 30

Closing this PR since there are additional changes in eos_token settings, so I'll create a new PR addresses all the diffs

ykhwang changed pull request status to closed Jul 30

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment