File size: 600 Bytes
a2b6f57
 
 
 
 
 
 
 
 
 
 
 
2c4a79c
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb
language:
- aa
metrics:
- code_eval
library_name: adapter-transformers
tags:
- finance
---
## Inference 
``` python
from transformers import AutoModel, AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel

model = "meta-llama/Llama-2-7b-chat-hf"

tokenizer = AutoTokenizer.from_pretrained(model, trust_remote_code=True)

model = AutoModelForCausalLM.from_pretrained(model, trust_remote_code=True, device_map = 'cuda')
model = PeftModel.from_pretrained(model, "FinGPT/fingpt-forecaster_sz50_llama2-7B_lora")

model = model.eval()
```