Update README.md

README.md

@@ -1,137 +1,74 @@
 ---
 license: cc-by-nc-4.0
-base_model: NeverSleep/Noromaid-7B-0.4
-tags:
-- generated_from_trainer
-model-index:
-- name: out-dpo
-  results: []
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
-<details><summary>See axolotl config</summary>
-
-axolotl version: `0.3.0`
-```yaml
-base_model: NeverSleep/Noromaid-7B-0.4
-model_type: MistralForCausalLM
-tokenizer_type: LlamaTokenizer
-is_mistral_derived_model: true
-
-load_in_8bit: false
-load_in_4bit: false
-strict: false
-
-rl: true
-datasets:
-  - path: Intel/orca_dpo_pairs
-    split: train
-    type: intel_apply_chatml
-  - path: NobodyExistsOnTheInternet/ToxicDPOqa
-    split: train
-    type: intel_apply_chatml
-  - path: Undi95/toxic-dpo-v0.1-NoWarning
-    split: train
-    type: intel_apply_chatml
-
-dataset_prepared_path: last_run_prepared
-val_set_size: 0.0
-output_dir: ./out-dpo
-save_total_limit: 3
-
-sequence_len: 2048
-sample_packing: false
-pad_to_sequence_len: false
-
-
-wandb_project: Noromaid-Chatml-dpo
-wandb_entity:
-wandb_watch:
-wandb_run_id:
-wandb_log_model:
-
-gradient_accumulation_steps: 16
-micro_batch_size: 2
-num_epochs: 1
-optimizer: paged_adamw_8bit
-lr_scheduler: cosine
-learning_rate: 2e-8
-
-train_on_inputs: false
-group_by_length: false
-bf16: true
-fp16: false
-tf32: false
-
-gradient_checkpointing: true
-early_stopping_patience:
-resume_from_checkpoint:
-local_rank:
-logging_steps: 1
-xformers_attention:
-flash_attention: true
-
-warmup_steps: 10
-eval_steps:
-eval_table_size:
-eval_table_max_new_tokens: 128
-debug:
-deepspeed:
-weight_decay: 0.1
-fsdp:
-fsdp_config:
-special_tokens:
-  eos_token: "<|im_end|>"
-tokens:
-  - "<|im_start|>"
-save_safetensors: true
-saves_per_epoch: 2
-```
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/VKX2Z2yjZX5J8kXzgeCYO.png)
+
+
+---
+
+
+# This model is a collab between [IkariDev](https://huggingface.co/IkariDev) and [Undi](https://huggingface.co/Undi95)!
+
+<!-- description start -->
+## Description
 
-</details><br>
+<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->
 
-# out-dpo
+This repo contains fp16 files of Noromaid-7b-v0.4-DPO.
 
-This model is a fine-tuned version of [NeverSleep/Noromaid-7B-0.4](https://huggingface.co/NeverSleep/Noromaid-7B-0.4) on the None dataset.
+[FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO)
 
-## Model description
+<!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->
 
-More information needed
+<!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
 
-## Intended uses & limitations
+<!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
 
-More information needed
+<!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->
 
-## Training and evaluation data
+<!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->
 
-More information needed
+[GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO-GGUF)
+<!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
 
-## Training procedure
+## Ratings:
 
-### Training hyperparameters
+Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
+
+No ratings yet!
+
+If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
+
+<!-- description end -->
+<!-- prompt-template start -->
+
+## Prompt format: Chatml
+```
+<|im_start|>system
+{sysprompt}<|im_end|>
+<|im_start|>user
+{input}<|im_end|>
+<|im_start|>assistant
+{output}<|im_end|>
+```
 
-The following hyperparameters were used during training:
-- learning_rate: 2e-08
-- train_batch_size: 2
-- eval_batch_size: 8
-- seed: 42
-- gradient_accumulation_steps: 16
-- total_train_batch_size: 32
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 10
-- training_steps: 626
+## Training data used:
+- [no_robots dataset](https://huggingface.co/Undi95/Llama2-13B-no_robots-alpaca-lora) let the model have more human behavior, enhances the output.
+- [Aesir Private RP dataset] New data from a new and never used before dataset, add fresh data, no LimaRP spam, this is 100% new. Thanks to the [MinvervaAI Team](https://huggingface.co/MinervaAI) and, in particular, [Gryphe](https://huggingface.co/Gryphe) for letting us use it!
+- [Another private Aesir dataset]
+- [Another private Aesir dataset]
+- [limarp](https://huggingface.co/datasets/lemonilia/LimaRP)
 
-### Training results
+## DPO training data used:
+- [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
+- [NobodyExistsOnTheInternet/ToxicDPOqa](https://huggingface.co/datasets/NobodyExistsOnTheInternet/ToxicDPOqa)
+- [Undi95/toxic-dpo-v0.1-NoWarning](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-NoWarning)
 
+This is a full finetune.
 
+## Others
 
-### Framework versions
+Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).
 
-- Transformers 4.37.0.dev0
-- Pytorch 2.0.1+cu118
-- Datasets 2.16.1
-- Tokenizers 0.15.0
+IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek