README.md

---
language:
- sq
license: creativeml-openrail-m
---

```markdown
# Bleta-8B Model

**License:** [CreativeML OpenRAIL-M](https://huggingface.co/spaces/CompVis/stable-diffusion-license)

## Overview

Bleta-8B is a state-of-the-art language model designed to generate coherent and contextually relevant text for a variety of applications, including dialogue generation, content creation, and more.

## Model Details

- **Model Name:** Bleta-8B
- **Model Size:** 8 Billion parameters
- **Format:** GGUF
- **License:** CreativeML OpenRAIL-M

## Files and Versions

- `adapter_config.json`: Configuration file for the model adapter.
- `adapter_model.safetensors`: The model weights in safetensors format.
- `config.json`: Basic configuration file.
- `special_tokens_map.json`: Mapping of special tokens.
- `tokenizer.json`: Tokenizer configuration.
- `tokenizer_config.json`: Detailed tokenizer settings.
- `Q8_0.gguf`: The model file in GGUF format.

## Getting Started

### Prerequisites

- Ensure you have the necessary dependencies installed, such as `cmake`, `make`, and a C++ compiler like `g++`.
- Clone and build the `llama.cpp` repository:

  ```bash
  git clone https://github.com/ggerganov/llama.cpp
  cd llama.cpp
  mkdir build
  cd build
  cmake ..
  make
  ```

### Download the Model

Download the model file from the repository:

```bash
wget https://huggingface.co/klei1/bleta-8b/resolve/main/unsloth.Q8_0.gguf
```

### Running the Model

Use the `llama.cpp` executable to run the model with your desired prompt:

```bash
./main -m unsloth.Q8_0.gguf -p "Your prompt here"
```

Replace `"Your prompt here"` with the text you want to process with the model.

#### Example Command

```bash
./main -m unsloth.Q8_0.gguf -p "Hello, world!"
```

## License

This model is licensed under the CreativeML OpenRAIL-M.