patrickvonplaten's picture
Add diffusers example
cf96b87
|
raw
history blame
2.6 kB
---
license: creativeml-openrail-m
---
**Elden Ring Diffusion**
This is the fine-tuned Stable Diffusion model trained on the game art from Elden Ring.
Use the tokens **_elden ring style_** in your prompts for the effect.
If you enjoy this model, please check out my other models on [Huggingface](https://huggingface.co/nitrosocke)
### 🧨 Diffusers
This model can be used just like any other Stable Diffusion model. For more information,
please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
### 🧨 Diffusers
This model can be used just like any other Stable Diffusion model. For more information,
please have a look at the [Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion).
You can also export the model to [ONNX](https://huggingface.co/docs/diffusers/optimization/onnx), [MPS](https://huggingface.co/docs/diffusers/optimization/mps) and/or [FLAX/JAX]().
```python
#!pip install diffusers transformers scipy torch
from diffusers import StableDiffusionPipeline
import torch
model_id = "nitrosocke/elden-ring-diffusion"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")
prompt = "a magical princess with golden hair, elden ring style"
image = pipe(prompt).images[0]
image.save("./magical_princess.png")
```
**Portraits rendered with the model:**
![Portrait Samples](https://huggingface.co/nitrosocke/elden-ring-diffusion/resolve/main/eldenring-portraits-small.jpg)
**Landscape Shots rendered with the model:**
![Landscape Samples](https://huggingface.co/nitrosocke/elden-ring-diffusion/resolve/main/eldenring-landscapes-small.jpg)
**Sample images used for training:**
![Training Samples](https://huggingface.co/nitrosocke/elden-ring-diffusion/resolve/main/eldenring-samples-small.jpg)
This model was trained using the diffusers based dreambooth training and prior-preservation loss in 3.000 steps.
#### Prompt and settings for portraits:
**elden ring style portrait of a beautiful woman highly detailed 8k elden ring style**
_Steps: 35, Sampler: DDIM, CFG scale: 7, Seed: 3289503259, Size: 512x704_
#### Prompt and settings for landscapes:
**elden ring style dark blue night (castle) on a cliff dark night (giant birds) elden ring style Negative prompt: bright day**
_Steps: 30, Sampler: DDIM, CFG scale: 7, Seed: 350813576, Size: 1024x576_