|
--- |
|
language: en |
|
license: mit |
|
tags: |
|
- text-generation-inference |
|
- transformers |
|
- Phi3 |
|
- kubernetes |
|
base_model: unsloth/Phi-3-mini-4k-instruct |
|
datasets: |
|
- andyburgin/kubefix |
|
--- |
|
|
|
# Phi-3-mini-4k-instruct-kubefix-v0.1-gguf: Fine-Tuned Phi3 for Kubernetes fault resolution |
|
|
|
The purpose of this model is for use with [K8sGPT](https://k8sgpt.ai/) for fault analysis and resolution. Ultimately the resulting LLM is intended to be self-hosted in a GPU free environment running under [local-ai](https://localai.io/basics/kubernetes/) in Kubernetes. |
|
|
|
The model was finetuned on [andyburgin/kubefix](https://huggingface.co/datasets/andyburgin/kubefix) which contains a series of Question and Answer pairs generated from a subset of the Kubernetes documentation from the [English markdown files](https://github.com/kubernetes/website/tree/main/content/en/docs). The Q&A pairs have been generated from the documents using an opensource model (to avoid licencing issues for some free models or SaasS services) - after much trial and error the [openchat-3.5-0106](https://huggingface.co/TheBloke/openchat-3.5-0106-GGUF) model was found to be the least problematic. |
|
|
|
For a detailed description of the method used to generate the [andyburgin/kubefix](https://huggingface.co/datasets/andyburgin/kubefix) dataset and this model please see the [kubefix-llm repo](https://github.com/andyburgin/kubefix-llm). |
|
|
|
**Model & Development** |
|
|
|
- **Developed by:** andyburgin |
|
- **License:** mit |
|
- **Finetuned from model:** unsloth/Phi-3-mini-4k-instruct |
|
|
|
**Key Features** |
|
|
|
- **Kubernetes Focus:** Optimised for fault analysis for Kubernetes clusters with [K8sGPT](https://k8sgpt.ai/). |
|
- **Knowledge Base:** Trained on a genrateed dataset from a subset of the Kubernetes documentation. |
|
- **Text Generation:** Generates informative and potentially helpful responses. |
|
|
|
**Important Note** |
|
|
|
This model and dataset are under development and v0.1 is the very first release and is likely to need much optimisation and development. |
|
|
|
**License** |
|
|
|
This model is distributed under the MIT License |
|
|
|
**Contributing** |
|
|
|
Contributions are welcome to this repository! If you have improvements or suggestions, feel free to create a pull request. |
|
|
|
**Disclaimer** |
|
|
|
Please note - the dataset and resultant model should be considered highly experimental and used with caution, use at your own risk. |
|
``` |
