Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,259 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: faipl-1.0-sd
|
4 |
+
license_link: https://freedevproject.org/faipl-1.0-sd/
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
tags:
|
8 |
+
- text-to-image
|
9 |
+
- stable-diffusion
|
10 |
+
- safetensors
|
11 |
+
- stable-diffusion-xl
|
12 |
+
base_model: cagliostrolab/animagine-xl-3.1
|
13 |
+
---
|
14 |
+
<style>
|
15 |
+
.title-container {
|
16 |
+
display: flex;
|
17 |
+
justify-content: center;
|
18 |
+
align-items: center;
|
19 |
+
height: 100vh; /* Adjust this value to position the title vertically */
|
20 |
+
}
|
21 |
+
|
22 |
+
.title {
|
23 |
+
font-size: 2.5em;
|
24 |
+
text-align: center;
|
25 |
+
color: #333;
|
26 |
+
font-family: 'Helvetica Neue', sans-serif;
|
27 |
+
text-transform: uppercase;
|
28 |
+
letter-spacing: 0.1em;
|
29 |
+
padding: 0.5em 0;
|
30 |
+
background: transparent;
|
31 |
+
}
|
32 |
+
|
33 |
+
.title span {
|
34 |
+
background: -webkit-linear-gradient(45deg, #ADD899, #83B4FF);
|
35 |
+
-webkit-background-clip: text;
|
36 |
+
-webkit-text-fill-color: transparent;
|
37 |
+
}
|
38 |
+
|
39 |
+
.custom-table {
|
40 |
+
table-layout: fixed;
|
41 |
+
width: 100%;
|
42 |
+
border-collapse: collapse;
|
43 |
+
margin-top: 2em;
|
44 |
+
}
|
45 |
+
|
46 |
+
.custom-table td {
|
47 |
+
width: 50%;
|
48 |
+
vertical-align: top;
|
49 |
+
padding: 10px;
|
50 |
+
box-shadow: 0px 0px 0px 0px rgba(0, 0, 0, 0.15);
|
51 |
+
}
|
52 |
+
|
53 |
+
.custom-image-container {
|
54 |
+
position: relative;
|
55 |
+
width: 100%;
|
56 |
+
margin-bottom: 0em;
|
57 |
+
overflow: hidden;
|
58 |
+
border-radius: 10px;
|
59 |
+
transition: transform .7s;
|
60 |
+
}
|
61 |
+
|
62 |
+
.custom-image-container:hover {
|
63 |
+
transform: scale(1.05);
|
64 |
+
}
|
65 |
+
|
66 |
+
.custom-image {
|
67 |
+
width: 100%;
|
68 |
+
height: auto;
|
69 |
+
object-fit: cover;
|
70 |
+
border-radius: 10px;
|
71 |
+
transition: transform .7s;
|
72 |
+
margin-bottom: 0em;
|
73 |
+
}
|
74 |
+
|
75 |
+
.nsfw-filter {
|
76 |
+
filter: blur(8px);
|
77 |
+
transition: filter 0.3s ease;
|
78 |
+
}
|
79 |
+
|
80 |
+
.custom-image-container:hover .nsfw-filter {
|
81 |
+
filter: none;
|
82 |
+
}
|
83 |
+
|
84 |
+
.overlay {
|
85 |
+
position: absolute;
|
86 |
+
bottom: 0;
|
87 |
+
left: 0;
|
88 |
+
right: 0;
|
89 |
+
color: white;
|
90 |
+
width: 100%;
|
91 |
+
height: 40%;
|
92 |
+
display: flex;
|
93 |
+
flex-direction: column;
|
94 |
+
justify-content: center;
|
95 |
+
align-items: center;
|
96 |
+
font-size: 1vw;
|
97 |
+
font-style: bold;
|
98 |
+
text-align: center;
|
99 |
+
opacity: 0;
|
100 |
+
background: linear-gradient(0deg, rgba(0, 0, 0, 0.8) 60%, rgba(0, 0, 0, 0) 100%);
|
101 |
+
transition: opacity .5s;
|
102 |
+
}
|
103 |
+
|
104 |
+
.custom-image-container:hover .overlay {
|
105 |
+
opacity: 1;
|
106 |
+
}
|
107 |
+
|
108 |
+
.overlay-text {
|
109 |
+
background: linear-gradient(45deg, #7ed56f, #28b485);
|
110 |
+
-webkit-background-clip: text;
|
111 |
+
color: transparent;
|
112 |
+
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.7);
|
113 |
+
}
|
114 |
+
|
115 |
+
.overlay-subtext {
|
116 |
+
font-size: 0.75em;
|
117 |
+
margin-top: 0.5em;
|
118 |
+
font-style: italic;
|
119 |
+
}
|
120 |
+
|
121 |
+
.overlay,
|
122 |
+
.overlay-subtext {
|
123 |
+
text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.5);
|
124 |
+
}
|
125 |
+
</style>
|
126 |
+
|
127 |
+
<h1 class="title">
|
128 |
+
<span>Rae Diffusion XL</span>
|
129 |
+
</h1>
|
130 |
+
|
131 |
+
<table class="custom-table">
|
132 |
+
<tr>
|
133 |
+
<td>
|
134 |
+
<div class="custom-image-container">
|
135 |
+
<img class="custom-image" src="" alt="Sample Image 1">
|
136 |
+
<div class="overlay">
|
137 |
+
<div class="overlay-text">Sample Image 1</div>
|
138 |
+
</div>
|
139 |
+
</div>
|
140 |
+
</td>
|
141 |
+
<td>
|
142 |
+
<div class="custom-image-container">
|
143 |
+
<img class="custom-image" src="" alt="Sample Image 2">
|
144 |
+
<div class="overlay">
|
145 |
+
<div class="overlay-text">Sample Image 2</div>
|
146 |
+
</div>
|
147 |
+
</div>
|
148 |
+
</td>
|
149 |
+
<td>
|
150 |
+
<div class="custom-image-container">
|
151 |
+
<img class="custom-image" src="" alt="Sample Image 3">
|
152 |
+
<div class="overlay">
|
153 |
+
<div class="overlay-text">Sample Image 3</div>
|
154 |
+
</div>
|
155 |
+
</div>
|
156 |
+
</td>
|
157 |
+
</tr>
|
158 |
+
<tr>
|
159 |
+
<td>
|
160 |
+
<div class="custom-image-container">
|
161 |
+
<img class="custom-image" src="" alt="Sample Image 4">
|
162 |
+
<div class="overlay">
|
163 |
+
<div class="overlay-text">Sample Image 4</div>
|
164 |
+
</div>
|
165 |
+
</div>
|
166 |
+
</td>
|
167 |
+
<td>
|
168 |
+
<div class="custom-image-container">
|
169 |
+
<img class="custom-image" src="" alt="Sample Image 5">
|
170 |
+
<div class="overlay">
|
171 |
+
<div class="overlay-text">Sample Image 5</div>
|
172 |
+
</div>
|
173 |
+
</div>
|
174 |
+
</td>
|
175 |
+
<td>
|
176 |
+
<div class="custom-image-container">
|
177 |
+
<img class="custom-image" src="" alt="Sample Image 6">
|
178 |
+
<div class="overlay">
|
179 |
+
<div class="overlay-text">Sample Image 6</div>
|
180 |
+
</div>
|
181 |
+
</div>
|
182 |
+
</td>
|
183 |
+
</tr>
|
184 |
+
</table>
|
185 |
+
|
186 |
+
## Overview
|
187 |
+
Introducing the enhanced **Rae Diffusion XL** , an advanced iteration of the Animagine XL 3.1 model, specifically fine-tuned for generating stunning anime-style artwork. Building on the robust foundation of the SDXL model, Rae Diffusion XL is meticulously optimized to excel in depicting anime characters, pushing the boundaries of creativity and technical capability.
|
188 |
+
|
189 |
+
## Model Details
|
190 |
+
- **Developed by**: [Raelina](https://civitai.com/user/Raelina)
|
191 |
+
- **Model type**: Diffusion-based text-to-image generative model
|
192 |
+
- **Model Description**: Generate high-quality anime images from textual prompts
|
193 |
+
- **License**: [Fair AI Public License 1.0-SD](https://freedevproject.org/faipl-1.0-sd/)
|
194 |
+
- **Finetuned from**: [Animagine XL 3.1](https://huggingface.co/cagliostrolab/animagine-xl-3.1)
|
195 |
+
|
196 |
+
|
197 |
+
### Usage Guidelines
|
198 |
+
## Tag Ordering
|
199 |
+
For optimal results, it's recommended to follow the structured prompt template because we train the model like this:
|
200 |
+
```
|
201 |
+
1girl/1boy, character name, from which series, everything else in any order.
|
202 |
+
```
|
203 |
+
|
204 |
+
## Special Tag
|
205 |
+
Rae Diffusion XL inherits special tags from Animagine XL 3.1 to enhance image generation by steering results toward quality, rating, creation date, and aesthetic. While the model can generate images without these tags, using them helps achieve better results.
|
206 |
+
- **Quality tags:** masterpiece, best quality, great quality, good quality, normal quality, low quality, worst quality
|
207 |
+
- **Rating tags:** safe, sensitive, nsfw, explicit
|
208 |
+
- **Year tags:** newest, recent, mid, early, oldest
|
209 |
+
- **Aesthetic tags:** very aesthetic, aesthetic, displeasing, very displeasing
|
210 |
+
|
211 |
+
|
212 |
+
## Recommended settings
|
213 |
+
|
214 |
+
- **Negative prompts:**
|
215 |
+
```
|
216 |
+
(worst quality, low quality, very displeasing), (interlocked fingers, badly drawn hands and fingers, anatomically incorrect hands), signature, watermark, artist name,
|
217 |
+
```
|
218 |
+
|
219 |
+
- **Positive prompts:**
|
220 |
+
|
221 |
+
```
|
222 |
+
masterpiece, best quality, very aesthetic, intricate details,
|
223 |
+
```
|
224 |
+
- **CFG:** 7
|
225 |
+
- **Sampling steps:** 25 to 30
|
226 |
+
- **Sampler:** Euler a
|
227 |
+
- **Supported Resolution:**
|
228 |
+
```
|
229 |
+
1024 x 1024, 1152 x 896, 896 x 1152, 1216 x 832, 832 x 1216, 1344 x 768, 768 x 1344, 1536 x 640, 640 x 1536
|
230 |
+
```
|
231 |
+
|
232 |
+
## Hires.fix Setting
|
233 |
+
- **Upscaler:** [4x_NMKD-YandereNeoXL](https://nmkd.de/?esrgan)
|
234 |
+
- **Hires step:** 10-15
|
235 |
+
- **Denoising:** 0.1-0.3 or 0.55 for latent upscaler
|
236 |
+
|
237 |
+
## Training parameters
|
238 |
+
- Hardware: 1x RTX 3090 24gb
|
239 |
+
- Batch size: 12
|
240 |
+
- Gradient Accumulation: 3
|
241 |
+
- Epochs: 10
|
242 |
+
- Unet LR: 3e-04
|
243 |
+
- Text Encoder LR: 1e-04
|
244 |
+
- Optimizer: AdamW8bit
|
245 |
+
- Optimizer Args: Weight Decay: 0.1, Betas: (0.9, 0.99)
|
246 |
+
- LR Scheduler: Cousine
|
247 |
+
- Min SNR Gamma: 5
|
248 |
+
- Algorithm: LoKr
|
249 |
+
- Total Training Time: 46 hours
|
250 |
+
|
251 |
+
## License
|
252 |
+
|
253 |
+
Rae Diffusion XL now uses the [Fair AI Public License 1.0-SD](https://freedevproject.org/faipl-1.0-sd/) inherited from Animagine XL 3.1, compatible with Stable Diffusion models. Key points:
|
254 |
+
1. **Modification Sharing:** If you modify Rae Diffusion XL, you must share both your changes and the original license.
|
255 |
+
2. **Source Code Accessibility:** If your modified version is network-accessible, provide a way (like a download link) for others to get the source code. This applies to derived models too.
|
256 |
+
3. **Distribution Terms:** Any distribution must be under this license or another with similar rules.
|
257 |
+
4. **Compliance:** Non-compliance must be fixed within 30 days to avoid license termination, emphasizing transparency and adherence to open-source values.
|
258 |
+
|
259 |
+
The choice of this license aims to keep Raemu XL open and modifiable, aligning with open source community spirit. It protects contributors and users, encouraging a collaborative, ethical open-source community. This ensures the model not only benefits from communal input but also respects open-source development freedoms.
|