File size: 1,742 Bytes
a4f4784 2d42641 a4f4784 ee77f8f 43697e3 ea8add9 2d42641 ea8add9 2d42641 ea8add9 e7c400a 2d42641 e7c400a ee77f8f a4f4784 1b011b0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 |
---
license: apache-2.0
datasets:
- smcleod/golang-coder
- smcleod/golang-programming-style-best-practices
- ExAi/Code-Golang-QA-2k
- google/code_x_glue_ct_code_to_text
- semeru/code-text-go
language:
- en
tags:
- golang
- code
- go
- programming
- llama
- text-generation-inference
---
# Llama 3.1 8b Golang Coder v3
This model has been trained on Golang style guides, best practices and code examples.
This should (hopefully) make it quite capable with Golang coding tasks.
## LoRA
- [FP16](https://huggingface.co/smcleod/llama-3-1-8b-smcleod-golang-coder-v3/tree/main/llama-3-1-8b-smcleod-golang-coder-v2-lora-fp16)
- [BF16](https://huggingface.co/smcleod/llama-3-1-8b-smcleod-golang-coder-v3/tree/main/llama-3-1-8b-smcleod-golang-coder-v2-lora-bf16)
## GGUF
- Q8_0 (with f16 embeddings): https://huggingface.co/smcleod/llama-3-1-8b-smcleod-golang-coder-v3/blob/main/llama-3-1-8b-smcleod-golang-coder-v2.etf16-Q8_0.gguf
## Ollama
- https://ollama.com/sammcj/llama-3-1-8b-smcleod-golang-coder-v3
## Training
I trained this model (based on Llama 3.1 8b) on a merged dataset I created consisting of 50,627 rows, 13.3M input tokens and 2.2M output tokens.
The total training consisted of 1,020,719 input tokens and 445,810 output tokens from 45,565 items in the dataset.
The dataset I created for this consists of multiple golang/programming focused datasets cleaned and merged and my own synthetically generated dataset based on several open source golang coding guides.
- https://huggingface.co/datasets/smcleod/golang-coder
- https://huggingface.co/datasets/smcleod/golang-programming-style-best-practices
|