Update README.md

README.md

@@ -1,6 +1,38 @@
 ---
 library_name: peft
 ---
+
+## Inference
+
+```plain
+from transformers import AutoTokenizer
+import transformers
+import torch
+
+model = "qanastek/LLaMa-2-FrenchMedMCQA"
+
+tokenizer = AutoTokenizer.from_pretrained(model)
+pipeline = transformers.pipeline(
+    "text-generation",
+    model=model,
+    torch_dtype=torch.float16,
+    device_map="auto",
+)
+
+prompt = "Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. ### Instruction: We are giving you a scientific question (easy level) and five answers options (associated to « A », « B », « C », « D », « E »). Your task is to find the correct(s) answer(s) based on scientific facts, knowledge and reasoning. Don't generate anything other than one of the following characters : 'A B C D E'. ### Input: Parmi les propositions suivantes, quelle est celle qui est exacte? Lorsqu'on ajoute un acide fort à une solution tampon: (A) Le pH reste constant (B) Le pH diminue légèrement (C) Le constituant basique du tampon reste constant (D) Le constituant acide du tampon réagit (E) Le rapport acide/base reste inchangé ### Response: "
+
+seq = pipeline(
+    prompt,
+    do_sample=True,
+    top_k=10,
+    num_return_sequences=1,
+    eos_token_id=tokenizer.eos_token_id,
+    max_length=200,
+)[0]
+
+print(seq['generated_text'][len(prompt):])
+```
+
 ## Training procedure