---
language:
- code
license: other
model_name: llm-compiler-13b
base_model: facebook/llm-compiler-13b
inference: false
model_creator: facebook
quantized_by: Second State Inc.
---

![](https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee)

# llm-compiler-13b-GGUF

## Original Model

[facebook/llm-compiler-13b](https://huggingface.co/facebook/llm-compiler-13b)

**License** A custom commercial license is available at: [https://ai.meta.com/resources/models-and-libraries/llama-downloads/](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)

## Run with Gaianet

(coming soon)

<!-- **Prompt template:**

prompt template: `gemma-instruct`

**Context size:**

chat_ctx_size: `8192` -->

**Run with GaiaNet:**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b3259*