Boris Dayma
commited on
Commit
•
b0b9920
1
Parent(s):
68b5b51
Create README.md
Browse files
README.md
CHANGED
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
## DALL-E Mini - Generate image from text
|
2 |
+
|
3 |
+
## TODO
|
4 |
+
|
5 |
+
* experiment with flax/jax and setup of the TPU instance that we should get shortly
|
6 |
+
* work on dataset loading - [see suggested datasets](https://discuss.huggingface.co/t/dall-e-mini-version/7324/4)
|
7 |
+
* Optionally create the OpenAI YFCC100M subset (see [this post](https://discuss.huggingface.co/t/dall-e-mini-version/7324/30?u=boris))
|
8 |
+
* work on text/image encoding
|
9 |
+
* concatenate inputs (not sure if we need fixed length for text or use a special token separating text & image)
|
10 |
+
* adapt training script
|
11 |
+
* create inference function
|
12 |
+
* integrate CLIP for better results (only if we have the time)
|
13 |
+
* work on a demo (streamlit or colab or maybe just HF widget)
|
14 |
+
* document (set up repo on model hub per instructions, start on README writeup…)
|
15 |
+
* help with coordinating activities & progress
|