model usage

README.md

@@ -112,15 +112,14 @@ This model was trained using [OpenLM](https://github.com/mlfoundations/open_lm/)
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
 tokenizer = AutoTokenizer.from_pretrained("tri-ml/mamba-7b-rw")
-model = AutoModelForCausalLM.from_pretrained("tri-ml/mamba-7b-rw").cuda()
+model = AutoModelForCausalLM.from_pretrained("tri-ml/mamba-7b-rw")
 
-inputs = tokenizer(["A beautiful flower"], return_tensors="pt")
-gen_kwargs = {"max_length": 128, "top_p": 0.8, "temperature": 0.8, "do_sample": True, "repetition_penalty": 1.1}
+inputs = tokenizer(["The Toyota Supra"], return_tensors="pt")
+gen_kwargs = {"max_new_tokens": 50, "top_p": 0.8, "temperature": 0.8, "do_sample": True, "repetition_penalty": 1.1}
 output = model.generate(inputs['input_ids'], **gen_kwargs)
 output = tokenizer.decode(output[0].tolist(), skip_special_tokens=True)
 print(output)
-# <s> A beautiful flower box made of white rose wood. It is a perfect gift for weddings, birthdays and anniversaries.
-# All the roses are from our farm Roses Flanders. Therefor you know that these flowers last much longer than those in store or online!</s>
+# The Toyota Supra is a sports car that has been in production since 1978. The car was discontinued in 2002, but it has recently been revived and will be available again in 2020. The Supra has always been known for its powerful engines and agile handling. 
 ```