Jonny00
/

cerebras-256m-biome-definition

@@ -1,202 +1,83 @@
----
-library_name: peft
-base_model: cerebras/Cerebras-GPT-256M
----
 # Model Card for Model ID
-<!-- Provide a quick summary of what the model is/does. -->
-## Model Details
-### Model Description
-<!-- Provide a longer summary of what this model is. -->
-- **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
-### Model Sources [optional]
-<!-- Provide the basic links for the model. -->
-- **Repository:** [More Information Needed]
-- **Paper [optional]:** [More Information Needed]
-- **Demo [optional]:** [More Information Needed]
 ## Uses
 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
-### Direct Use
-<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
-[More Information Needed]
-### Downstream Use [optional]
-<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
-[More Information Needed]
-### Out-of-Scope Use
-<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
-[More Information Needed]
 ## Bias, Risks, and Limitations
-<!-- This section is meant to convey both technical and sociotechnical limitations. -->
-[More Information Needed]
-### Recommendations
-<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
-Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
-## How to Get Started with the Model
-Use the code below to get started with the model.
-[More Information Needed]
-## Training Details
-### Training Data
-<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
-[More Information Needed]
-### Training Procedure
-<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
-#### Preprocessing [optional]
-[More Information Needed]
-#### Training Hyperparameters
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-#### Speeds, Sizes, Times [optional]
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
-[More Information Needed]
-## Evaluation
-<!-- This section describes the evaluation protocols and provides the results. -->
-### Testing Data, Factors & Metrics
-#### Testing Data
-<!-- This should link to a Dataset Card if possible. -->
-[More Information Needed]
-#### Factors
-<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
-[More Information Needed]
-#### Metrics
-<!-- These are the evaluation metrics being used, ideally with a description of why. -->
-[More Information Needed]
-### Results
-[More Information Needed]
-#### Summary
-## Model Examination [optional]
-<!-- Relevant interpretability work for the model goes here -->
-[More Information Needed]
-## Environmental Impact
-<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
-Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
-- **Hardware Type:** [More Information Needed]
-- **Hours used:** [More Information Needed]
-- **Cloud Provider:** [More Information Needed]
-- **Compute Region:** [More Information Needed]
-- **Carbon Emitted:** [More Information Needed]
-## Technical Specifications [optional]
-### Model Architecture and Objective
-[More Information Needed]
-### Compute Infrastructure
-[More Information Needed]
-#### Hardware
-[More Information Needed]
-#### Software
-[More Information Needed]
-## Citation [optional]
-<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
-**BibTeX:**
-[More Information Needed]
-**APA:**
-[More Information Needed]
-## Glossary [optional]
-<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
-[More Information Needed]
-## More Information [optional]
-[More Information Needed]
-## Model Card Authors [optional]
-[More Information Needed]
-## Model Card Contact
-[More Information Needed]
 ### Framework versions
 - PEFT 0.11.0

+---
+library_name: peft
+base_model: cerebras/Cerebras-GPT-256M
+license: apache-2.0
+language:
+- en
+---
 # Model Card for Model ID
+Part of bachelor thesis focusing on generating 3d terrain from text.<br>
+Biome Definition is a json formatted string detailing the biomes and their features. <br>
+Together with SD Heightmap Generation v3.0, 3d terrain can be procedurally generated.
+<!-- Provide a quick summary of what the model is/does. -->
 ## Uses
+Example Inference:<br>
+\<prompt\> Alpine mountains and a forest adorned with red flowers.
+Result:<br>
+\<prompt\> Alpine mountains and a forest adorned with red flowers.<br>
+\<biomes\> [{'Entities': {'Boulders': [], 'BouldersSpawnrate': 0.0, 'Grass': [{'BaseTint': '#ff0000', 'Id': 'flowers'}], 'GrassSpawnrate': 0.8, 'Trees': [], 'TreesSpawnrate': 0.0}, 'Name':'Alpine Mountains', 'SpawnCondition': {'HeightRange': [0.0, 0.5], 'SlopeRange': [0.0, 0.3]}, 'Texturing': {'GroundTexture': 'grass', 'GroundTextureTint': '#7cfc00', 'SlopeTexture': 'grass', 'SlopeTextureTint': '#7cfc00'}}, {'Entities': {'Boulders': [], 'BouldersSpawnrate': 0.0, 'Grass': [], 'GrassSpawnrate': 0.0, 'Trees': [{'BaseTint': '#8b4513', 'Id': 'tree_large'}], 'TreesSpawnrate': 0.8}, 'Name':'Redwood Forest', 'SpawnCondition': {'HeightRange': [0.0, 0.5], 'SlopeRange': [0.0, 0.3]}, 'Texturing': {'GroundTexture': 'dirt', 'GroundTextureTint': '#7cfc00', 'SlopeTexture':'stone', 'SlopeTextureTint': '#c2c2c2'}}]
 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+Requires ~3GB VRAM
+Training Loss: 4%
+Validation Loss: 6%
 ## Bias, Risks, and Limitations
+Model is biased to certain ids like:
+* textures: grass, dirt, mud, mud_dry, stone, stone_smooth
+* boulders: boulder_small, boulder_medium, boulder_large
+* trees: tree_small, tree_medium, tree_large, tree_conifer_small, ...
+* grass: grass_small, grass_medium, grass_large, grass_dry, flowers
+Model also has trouble overadjusting tints, leading to oversaturated colorations.
+Model sometimes continues output. Just end prompt at "}}]".
+Model sometimes creates incomplete biome definitions or places entities on wrong biome.
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+## Model Details
+Finetuned on custom dataset of size 538 json formatted biome definitions consisting of:
+* Name
+* SpawnCondition
+  * HeightRange
+  * SlopeRange
+* Entities
+  * Trees
+    * Id
+    * BaseTint
+  * Boulders
+    * Id
+    * BaseTint
+  * Grass
+    * Id
+    * BaseTint
+  * TreesSpawnrate
+  * BouldersSpawnrate
+  * GrassSpawnrate
+* Texturing
+  * GroundTexture
+  * GroundTextureTint
+  * SlopeTexture
+  * SlopeTextureTint
+### Model Description
+<!-- Provide a longer summary of what this model is. -->
+- **Model type:** [PEFT Adapter]
+- **Language(s) (NLP):** [English]
+- **License:** [Apache 2.0]
+### Model Sources [optional]
+<!-- Provide the basic links for the model. -->
+- **Paper [optional]:** [tba]
 ### Framework versions
 - PEFT 0.11.0