aashish1904 commited on
Commit
6b74dea
1 Parent(s): 6d6a9c4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ license: creativeml-openrail-m
5
+ datasets:
6
+ - HuggingFaceTB/smoltalk
7
+ language:
8
+ - en
9
+ base_model:
10
+ - meta-llama/Llama-3.2-1B-Instruct
11
+ pipeline_tag: text-generation
12
+ library_name: transformers
13
+ tags:
14
+ - Llama
15
+ - Llama-CPP
16
+ - SmolTalk
17
+ - ollama
18
+ - bin
19
+
20
+ ---
21
+
22
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
23
+
24
+
25
+ # QuantFactory/Llama-SmolTalk-3.2-1B-Instruct-GGUF
26
+ This is quantized version of [prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct](https://huggingface.co/prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct) created using llama.cpp
27
+
28
+ # Original Model Card
29
+
30
+ ## Updated Files for Model Uploads 🤗
31
+
32
+ | File Name [ Updated Files ] | Size | Description | Upload Status |
33
+ |----------------------------|-----------|--------------------------------------------|----------------|
34
+ | `.gitattributes` | 1.57 kB | Git attributes configuration file | Uploaded |
35
+ | `README.md` | 42 Bytes | Initial README | Uploaded |
36
+ | `config.json` | 1.03 kB | Configuration file | Uploaded |
37
+ | `generation_config.json` | 248 Bytes | Configuration for text generation | Uploaded |
38
+ | `pytorch_model.bin` | 2.47 GB | PyTorch model weights | Uploaded (LFS) |
39
+ | `special_tokens_map.json` | 477 Bytes | Special token mappings | Uploaded |
40
+ | `tokenizer.json` | 17.2 MB | Tokenizer configuration | Uploaded (LFS) |
41
+ | `tokenizer_config.json` | 57.4 kB | Additional tokenizer settings | Uploaded |
42
+
43
+ | Model Type | Size | Context Length | Link |
44
+ |------------|------|----------------|------|
45
+ | GGUF | 1B | - | [🤗 Llama-SmolTalk-3.2-1B-Instruct-GGUF](https://huggingface.co/prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct-GGUF) |
46
+
47
+ The **Llama-SmolTalk-3.2-1B-Instruct** model is a lightweight, instruction-tuned model designed for efficient text generation and conversational AI tasks. With a 1B parameter architecture, this model strikes a balance between performance and resource efficiency, making it ideal for applications requiring concise, contextually relevant outputs. The model has been fine-tuned to deliver robust instruction-following capabilities, catering to both structured and open-ended queries.
48
+
49
+ ### Key Features:
50
+ 1. **Instruction-Tuned Performance**: Optimized to understand and execute user-provided instructions across diverse domains.
51
+ 2. **Lightweight Architecture**: With just 1 billion parameters, the model provides efficient computation and storage without compromising output quality.
52
+ 3. **Versatile Use Cases**: Suitable for tasks like content generation, conversational interfaces, and basic problem-solving.
53
+
54
+ ### Intended Applications:
55
+ - **Conversational AI**: Engage users with dynamic and contextually aware dialogue.
56
+ - **Content Generation**: Produce summaries, explanations, or other creative text outputs efficiently.
57
+ - **Instruction Execution**: Follow user commands to generate precise and relevant responses.
58
+
59
+ ### Technical Details:
60
+ The model leverages PyTorch for training and inference, with a tokenizer optimized for seamless text input processing. It comes with essential configuration files, including `config.json`, `generation_config.json`, and tokenization files (`tokenizer.json` and `special_tokens_map.json`). The primary weights are stored in a PyTorch binary format (`pytorch_model.bin`), ensuring easy integration with existing workflows.
61
+
62
+ **Model Type**: GGUF
63
+ **Size**: 1B Parameters
64
+
65
+ The **Llama-SmolTalk-3.2-1B-Instruct** model is an excellent choice for lightweight text generation tasks, offering a blend of efficiency and effectiveness for a wide range of applications.