Text Generation
GGUF
Inference Endpoints
csabakecskemeti's picture
Update README.md
3f15cc9 verified
---
license: llama3
datasets:
- DevQuasar/brainstorm_vicuna_10k
pipeline_tag: text-generation
---
# Brainstorm Plus GGUF
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/DFdDTwGI1f95AWyZ7uwpF.png)
Quantized GGUF model files for [DevQuasar/llama3_8b_chat_brainstorm_plus](https://huggingface.co/DevQuasar/llama3_8b_chat_brainstorm_plus)
Brainstorm facilitates idea exploration through interaction with a Language Model (LLM). Rather than providing direct answers, the model engages in a dialogue with users, offering probing questions aimed at fostering deeper contemplation and consideration of various facets of their ideas.
## Usage
### LMStudio
With https://lmstudio.ai/ use the `brainstorm.preset.json` preset
### llama.cpp
`./main -m llama3_8b_chat_brainstorm_plus.Q2_K.gguf -p "### HUMAN: I'd like to build an online marketplace\n ### ASSISTANT:" -n 400 -e -ins -r "### HUMAN:\n" -r "### ASSISTANT: "`