NYC models
Collection
Finetuning models on posts and responses on the /r/AskNYC subreddit
•
5 items
•
Updated
•
2
Adapter model / weights only for https://huggingface.co/monsoon-nlp/nyc-savvy-llama2-7b
from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer
# this model
model = AutoPeftModelForCausalLM.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b-lora-adapter").to("cuda")
# base model for the tokenizer
tokenizer = AutoTokenizer.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b")