legolasyiu commited on
Commit
5ec2510
1 Parent(s): 12acb18

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -0
README.md CHANGED
@@ -24,6 +24,67 @@ This llama model was trained 2x faster with [Unsloth](https://github.com/unsloth
24
  Fireball-Llama-3.1-V1
25
 
26
  <img src="https://huggingface.co/EpistemeAI/Fireball-Llama-3.1-8B-v1dpo/resolve/main/fireball-llama.JPG" width="200"/>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
  ## Responsibility & Safety
29
  As part of our Responsible release approach, we followed a three-pronged strategy to managing trust & safety risks:
 
24
  Fireball-Llama-3.1-V1
25
 
26
  <img src="https://huggingface.co/EpistemeAI/Fireball-Llama-3.1-8B-v1dpo/resolve/main/fireball-llama.JPG" width="200"/>
27
+ ## For transfomer:
28
+
29
+
30
+
31
+ ## For ollama, please use the following
32
+
33
+ ```py
34
+ TEMPLATE """ {{ if .Messages }}
35
+ {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|>
36
+ {{- if .System }}
37
+
38
+ {{ .System }}
39
+ {{- end }}
40
+ {{- if .Tools }}
41
+
42
+ You are a helpful assistant with tool calling capabilities. When you receive a tool call response, use the output to format an answer to the orginal use question.
43
+ {{- end }}
44
+ {{- end }}<|eot_id|>
45
+ {{- range $i, $_ := .Messages }}
46
+ {{- $last := eq (len (slice $.Messages $i)) 1 }}
47
+ {{- if eq .Role "user" }}<|start_header_id|>user<|end_header_id|>
48
+ {{- if and $.Tools $last }}
49
+
50
+ Given the following functions, please respond with a JSON for a function call with its proper arguments that best answers the given prompt.
51
+
52
+ Respond in the format {"name": function name, "parameters": dictionary of argument name and its value}. Do not use variables.
53
+
54
+ {{ $.Tools }}
55
+ {{- end }}
56
+
57
+ {{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>
58
+
59
+ {{ end }}
60
+ {{- else if eq .Role "assistant" }}<|start_header_id|>assistant<|end_header_id|>
61
+ {{- if .ToolCalls }}
62
+
63
+ {{- range .ToolCalls }}{"name": "{{ .Function.Name }}", "parameters": {{ .Function.Arguments }}}{{ end }}
64
+ {{- else }}
65
+
66
+ {{ .Content }}{{ if not $last }}<|eot_id|>{{ end }}
67
+ {{- end }}
68
+ {{- else if eq .Role "tool" }}<|start_header_id|>ipython<|end_header_id|>
69
+
70
+ {{ .Content }}<|eot_id|>{{ if $last }}<|start_header_id|>assistant<|end_header_id|>
71
+
72
+ {{ end }}
73
+ {{- end }}
74
+ {{- end }}
75
+ {{- else }}
76
+ {{- if .System }}<|start_header_id|>system<|end_header_id|>
77
+
78
+ {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
79
+
80
+ {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
81
+
82
+ {{ end }}{{ .Response }}{{ if .Response }}<|eot_id|>{{ end }}
83
+ """
84
+
85
+ SYSTEM You are helpful assistant with IQ of 140.
86
+ ```
87
+
88
 
89
  ## Responsibility & Safety
90
  As part of our Responsible release approach, we followed a three-pronged strategy to managing trust & safety risks: