cszhzleo
/

Llama-2-7b-chat-hf-nc2-bs1-token1024-neuron-218

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-2-7b-chat-hf-nc2-bs1-token1024-neuron-218 / README.md

cszhzleo's picture

Create README.md

44224c9 verified 7 months ago

|

324 Bytes

metadata

pipeline_tag: text-generation
tags:
  - Neuron
  - Optimum-Neuron
  - AWS

Compiled Llama-2-7b-chat-hf using optimum-neuron

optimum-cli export neuron  --model NousResearch/Llama-2-7b-chat-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/NousResearch/Llama-2-7b-chat-hf