Update README.md

README.md

@@ -1,6 +1,7 @@
 ---
 license: apache-2.0
 tags:
+- text-generation
 - moe
 - frankenmoe
 - merge
@@ -103,8 +104,194 @@ base_model:
 - Felladrin/Smol-Llama-101M-Chat-v1
 - Felladrin/Smol-Llama-101M-Chat-v1
 - Felladrin/Smol-Llama-101M-Chat-v1
+datasets:
+- Open-Orca/SlimOrca-Dedup
+- VMware/open-instruct
+- LDJnr/Capybara
+- cognitivecomputations/ultrachat-uncensored
+- starfishmedical/webGPT_x_dolly
+- THUDM/webglm-qa
+widget:
+  - messages:
+      - role: system
+        content: You are a helpful assistant who gives creative responses.
+      - role: user
+        content: Write the background story of a game about wizards and llamas in a sci-fi world.
+  - messages:
+      - role: system
+        content: A friendly chat between a user and an assistant.
+      - role: user
+        content: Got a question for you!
+      - role: assistant
+        content: "Sure! What's it?"
+      - role: user
+        content: I need to build a simple website. Where should I start learning about web development?
+  - messages:
+      - role: system
+        content: "You are a helpful assistant who provides concise answers to the user's questions."
+      - role: user
+        content: How to become more healthy?
+  - messages:
+      - role: system
+        content: You are a helpful assistant, who always answers with empathy.
+      - role: user
+        content: List the pros and cons of social media.
+  - messages:
+      - role: system
+        content: You are a helpful assistant, who always answers with empathy.
+      - role: user
+        content: Hello!
+      - role: assistant
+        content: Hi! How can I help you today?
+      - role: user
+        content: 'Take a look at the info below.
+
+          - The tape inside the VHS cassettes is very delicate and can be easily ruined,
+          making them unplayable and unrepairable. The reason the tape deteriorates is that
+          the magnetic charge needed for them to work is not permanent, and the magnetic
+          particles end up losing their charge in a process known as remanence decay. These
+          particles could also become demagnetised via being stored too close to a magnetic
+          source.
+      
+          - One of the most significant issues with VHS tapes is that they have moving parts,
+          meaning that there are more occasions when something can go wrong, damaging your
+          footage or preventing it from playing back. The tape itself is a prominent cause
+          of this, and tape slippage can occur. Tapes slippage can be caused when the tape
+          loses its tension, or it has become warped. These problems can occur in storage
+          due to high temperatures or frequent changes in humidity.
+      
+          - VHS tapes deteriorate over time from infrequent or overuse. Neglect means mold
+          and dirt, while overuse can lead to scratches and technical difficulties. This
+          is why old VHS tapes inevitably experience malfunctions after a long period of
+          time. Usually anywhere between 10 to 25+ years.
+      
+          - Some VHS tapes like newer mini DVs and Digital 8 tapes can suffer from digital
+          corruption, meaning that the footage becomes lost and cannot be recovered. These
+          tapes were the steppingstone from VHS to the digital age when capturing footage
+          straight to digital became the norm. Unfortunately,they are susceptible to digital
+          corruption, which causes video pixilation and/or loss of audio.'
+      - role: assistant
+        content: Alright!
+      - role: user
+        content: 'Now I''m going to write my question, and if the info above is useful, you can use them in your response.
+      
+          Ready?'
+      - role: assistant
+        content: Ready for your question!
+      - role: user
+        content: Why do VHS tapes deteriorate over time?
+inference:
+  parameters:
+    max_new_tokens: 250
+    penalty_alpha: 0.5
+    top_k: 4
+    repetition_penalty: 1.105
+model-index:
+- name: Smol-Llama-101M-Chat-v1
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: AI2 Reasoning Challenge (25-Shot)
+      type: ai2_arc
+      config: ARC-Challenge
+      split: test
+      args:
+        num_few_shot: 25
+    metrics:
+    - type: acc_norm
+      value: 22.87
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: HellaSwag (10-Shot)
+      type: hellaswag
+      split: validation
+      args:
+        num_few_shot: 10
+    metrics:
+    - type: acc_norm
+      value: 28.69
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MMLU (5-Shot)
+      type: cais/mmlu
+      config: all
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 24.93
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: TruthfulQA (0-shot)
+      type: truthful_qa
+      config: multiple_choice
+      split: validation
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: mc2
+      value: 45.76
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: Winogrande (5-shot)
+      type: winogrande
+      config: winogrande_xl
+      split: validation
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 50.04
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: GSM8k (5-shot)
+      type: gsm8k
+      config: main
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 0.08
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Felladrin/Smol-Llama-101M-Chat-v1
+      name: Open LLM Leaderboard
 ---
 
+
 # SmalJ.O.S.I.E.-48x101M-Chat
 
 SmalJ.O.S.I.E.-48x101M-Chat is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):