|
--- |
|
library_name: transformers |
|
tags: |
|
- trl |
|
- sft |
|
--- |
|
|
|
# FineTune_Llama_3_01 |
|
|
|
This is a fine-tuned Llama 3 model for causal language modeling. |
|
|
|
## Model Description |
|
|
|
This model is fine-tuned on a custom dataset for generating text based on input prompts. |
|
|
|
## Usage |
|
|
|
### Inference API |
|
|
|
You can use the Hugging Face Inference API to perform inference on this model. |
|
|
|
**Example:** |
|
|
|
```python |
|
import requests |
|
|
|
API_URL = "https://api-inference.huggingface.co/models/Ansh007/FineTune_Llama_3_01" |
|
headers = {"Authorization": "Bearer YOUR_HUGGING_FACE_API_TOKEN"} |
|
|
|
def query(payload): |
|
response = requests.post(API_URL, headers=headers, json=payload) |
|
return response.json() |
|
|
|
data = query({ |
|
"inputs": "Your test sentence here", |
|
}) |
|
|
|
print(data) |
|
|
|
|
|
|
