update readme

.ipynb_checkpoints/README-checkpoint.md

@@ -0,0 +1,81 @@
+---
+tags:
+- stable-diffusion
+- stable-diffusion-xl
+---
+
+# Nekoray-XL-V0.7
+
+
+## Model Card
+
+
+NekoRay v0.7 is a SDXL checkpoint finetuned on SDXL 1.0, using 1.5m quality-tagged images from a selection of image sites. It aims to be the next Waifu-diffusion, creating generation freedom for the SD community.
+
+The project is a WIP, and further checkpoints with enhanced augmentations & more images is currently being developed.
+
+
+Two models trained on the same dataset/hardware/hyperparameters are currently available:
+
+- **[fp16mixed](https://huggingface.co/trojblue/nekoray-xl-fulldan-bench-1.5m/blob/main/nekoray-xl-1.5m-fp16mixed_e02.safetensors)**: 2epoch, half-precision
+
+- **[32full](https://huggingface.co/trojblue/nekoray-xl-fulldan-bench-1.5m/blob/main/nekoray-xl-1.5m-pdg32_e02.safetensors)**: 1.7epoch (still training), full-precision
+
+
+## Usage:
+
+It's recommended to use the *exact* same resolution as specified below, since the original SDXL doesn't perform well out of these resolutions. For prompt danbooru-styled caption is preferred.
+
+
+
+we use the same aspect ratio as the original SDXL:
+
+| Height | Width | Aspect Ratio |
+| ------ | ----- | ------------ |
+| 512    | 2048  | 0.25         |
+| 512    | 1984  | 0.26         |
+| 512    | 1920  | 0.27         |
+| 512    | 1856  | 0.28         |
+| 576    | 1792  | 0.32         |
+| 576    | 1728  | 0.33         |
+| 576    | 1664  | 0.35         |
+| 640    | 1600  | 0.4          |
+| 640    | 1536  | 0.42         |
+| 704    | 1472  | 0.48         |
+| 704    | 1408  | 0.5          |
+| 704    | 1344  | 0.52         |
+| 768    | 1344  | 0.57         |
+| 768    | 1280  | 0.6          |
+| 832    | 1216  | 0.68         |
+| 832    | 1152  | 0.72         |
+| 896    | 1152  | 0.78         |
+| 896    | 1088  | 0.82         |
+| 960    | 1088  | 0.88         |
+| 960    | 1024  | 0.94         |
+| 1024   | 1024  | 1.0          |
+| 1024   | 960   | ...          |
+
+
+for prompts the following keywords are appended for better separation of genres:
+
+```
+'sensitive-rated', 'questionable-rated', 'explicit-rated'
+```
+
+The models are intended to be used as a pretrained checkpoint, and further finetuning is **strongly recommended** for downstream use. For more info 'Finetuning' part below:
+
+## Finetuning
+
+finetuning on SDXL inherently provides better clarity and reduced 'noisinesss' on higher resolutions compared to sd1.4. We've got some good results for further finetuning on various anime-related subject matters, including but not limited to:
+
+- style finetunes (tested on nijijourney images & pvc/figure datasets)
+
+- character finetunes (tested on 8 Blue Archive characters)
+
+- concept finetunes (tested on nsfw gestures)
+
+Actual samples of downstream finetunes will be posted once we get the finetuners' conscents.
+
+## License
+
+The model (which is still very WIP) is intended to be used as a foundation for various downstream finetunes. The license is under discussion but it would be generally follow Openrail-M agreements.

README.md

@@ -10,7 +10,6 @@ tags:
 ## Model Card
 
 
-
 NekoRay v0.7 is a SDXL checkpoint finetuned on SDXL 1.0, using 1.5m quality-tagged images from a selection of image sites. It aims to be the next Waifu-diffusion, creating generation freedom for the SD community.
 
 The project is a WIP, and further checkpoints with enhanced augmentations & more images is currently being developed.
@@ -53,12 +52,30 @@ we use the same aspect ratio as the original SDXL:
 | 896    | 1088  | 0.82         |
 | 960    | 1088  | 0.88         |
 | 960    | 1024  | 0.94         |
-| 1024   | 1024  | 1.0/         |
-
+| 1024   | 1024  | 1.0          |
+| 1024   | 960   | ...          |
 
 
 for prompts the following keywords are appended for better separation of genres:
 
 ```
 'sensitive-rated', 'questionable-rated', 'explicit-rated'
-```
+```
+
+The models are intended to be used as a pretrained checkpoint, and further finetuning is **strongly recommended** for downstream use. For more info 'Finetuning' part below:
+
+## Finetuning
+
+finetuning on SDXL inherently provides better clarity and reduced 'noisinesss' on higher resolutions compared to sd1.4. We've got some good results for further finetuning on various anime-related subject matters, including but not limited to:
+
+- style finetunes (tested on nijijourney images & pvc/figure datasets)
+
+- character finetunes (tested on 8 Blue Archive characters)
+
+- concept finetunes (tested on nsfw gestures)
+
+Actual samples of downstream finetunes will be posted once we get the finetuners' conscents.
+
+## License
+
+The model (which is still very WIP) is intended to be used as a foundation for various downstream finetunes. The license is under discussion but it would be generally follow Openrail-M agreements.