abcdabcd987 commited on
Commit
ee253a2
1 Parent(s): 8f2fba8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -3
README.md CHANGED
@@ -13,12 +13,20 @@ tags:
13
  - generated_from_trainer
14
  ---
15
 
16
- * Base Model: [Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf)
17
- * LoRA target: `q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj`
18
- * LoRA rank: 16
 
 
 
19
 
20
  See <https://github.com/punica-ai/punica/tree/master/examples/finetune>
21
 
 
 
 
 
 
22
 
23
  ### Training hyperparameters
24
 
 
13
  - generated_from_trainer
14
  ---
15
 
16
+
17
+ ## Punica
18
+
19
+ Punica: Serving multiple LoRA finetuned LLMs at the cost of one
20
+
21
+ Paper: <https://arxiv.org/abs/2310.18547>
22
 
23
  See <https://github.com/punica-ai/punica/tree/master/examples/finetune>
24
 
25
+ ## Model
26
+
27
+ * Base Model: [Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf)
28
+ * LoRA target: `q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj`
29
+ * LoRA rank: 16
30
 
31
  ### Training hyperparameters
32