Upload folder using huggingface_hub (#3)

- 31cc4675c08c900e1bb9ff2151417482cde6eff08b26f5cc084d862dfb49a4d9 (e7936bf4befcdc0c5ce957708f65f0a3e36e58f2)
- 0bb0675add4ce1243dae5b7b3a273af87ec36152dd02924bd05eb6f54557162c (6bca7949ba8f27d8cd2ead8c3b733ef99d90f372)
- f8eab21e2df251b8247f681164bc634a13efda82e49249ecb277f5fc3d6a7634 (368d5939c1d43dccd1735a657f78b5d625f2ef9d)
- 3a54c5c2d7984fa01230c5a1d34041ef80451cfb1cf82eee643473fc94859921 (0fa8e128d9ae8d19d93fcdecffdbd784ea5c074d)
- e4fe238c0e21ccd4a6cbceea72c10396765c0064a286ac9b9bc5e446afb627cb (373a0d7b174a2307fc3ffb859d7ce3157ccf675c)
- 4898d4a505d1789166bcb7d416bf5fc500256c4111795ccb80344ea3aa1bb0f6 (25cfa616079a3ef6595151938f3db6f2ef266f36)
- 7681cf2fd49025d4830a3d07f52d85f7e44df117b3edab98236e605f9693310f (22b8a8daec21b5c8ab157e007841d48d2b06840a)
- ca5df7f4d8167123acb968630161645da601dde8483e4c311f783f309735be83 (9188057d1a580eba4a51043cee72b30b908b9eba)
- 9fdbe3c973f53dc4916f910d902d3e05246dd3de3edb04bedbcf3d2d1bb470d4 (c1992345b3dbaba981f6e892f7d64e182603a828)
- 1b4738f557fa65fd82152076a04f85764df95d94b2d65554af810dc4b24527d6 (75ad06308d2757c424e28ab1fdaa4d9293b9013f)
- b37f70bfa1337faff87af8eb80241964fafee2a2ace1ef3af2cf7a4bc3776170 (3a7d4ebd9905e38a9a848d6438e9c54a3c1311f6)
- 090ffc5ecc0b958d6d248618e7914ac2f66125943fa366c4a4c4ffa28b9aa366 (648722d3b4310e169f9131c2d4cea38d6ca04d6e)
- e0f8288eae08e5b0763ddb9e3dd2d93ad2411903727e53a15c55437c65b7c41f (83f998ac071d0e27bdce486dddf54d9112599dfd)
- 859c35941f0819357e4a75b34775eef2494d0620dbc527bf8f19393aff5bff25 (f2c53f3ca5b5d11480f6db4016ba0743c8e8f01e)
- 8ebf2244a5d1cdbdf019605f415caebe86d7076aa159231212eca9e720202fdc (c90c9dafb3026252fead561bc5f8f8998da6d7a3)
- 48b88ffd3954ac2d2447b4425c161a20f6326a363fc041f0e2726e8321bd2b78 (0e66994c4bc1ef8e07fc73c95a678b521ed15e5d)

.gitattributes

@@ -43,3 +43,10 @@ calme-2.3-legalkit-8b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 calme-2.3-legalkit-8b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 calme-2.3-legalkit-8b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 calme-2.3-legalkit-8b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
+calme-2.3-legalkit-8b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,46 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+- text-generation
+model_name: calme-2.3-legalkit-8b-GGUF
+base_model: MaziyarPanahi/calme-2.3-legalkit-8b
+inference: false
+model_creator: MaziyarPanahi
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/calme-2.3-legalkit-8b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.3-legalkit-8b-GGUF)
+- Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
+- Original model: [MaziyarPanahi/calme-2.3-legalkit-8b](https://huggingface.co/MaziyarPanahi/calme-2.3-legalkit-8b)
+
+## Description
+[MaziyarPanahi/calme-2.3-legalkit-8b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.3-legalkit-8b-GGUF) contains GGUF format model files for [MaziyarPanahi/calme-2.3-legalkit-8b](https://huggingface.co/MaziyarPanahi/calme-2.3-legalkit-8b).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

calme-2.3-legalkit-8b-GGUF_imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d96164d490b091d1b2f728668e14449235e82b940a221ec9049e37d8400e8b73
+size 4988146

calme-2.3-legalkit-8b.IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9108d05bee35d9483f6958e2c2c065cc15f817775e423cc42d42fb9a9fbcf57e
+size 2019628800

calme-2.3-legalkit-8b.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdab06657e07fb18b6c40854abecd006fab939ca815ce404018605d1ee09c426
+size 5732988672

calme-2.3-legalkit-8b.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdeb244e400593f9991f5de3128c04d18651f49a627e872af59f25c4e24f9770
+size 5599295232

calme-2.3-legalkit-8b.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3bcebeba611003c94274918172c0edef9c0aadfb711ca8c0b360d85b0e7b843
+size 6596007680

calme-2.3-legalkit-8b.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:53079594a9bfd2ec21015ad5c8dafb7fd9ed6cce73c77e7752f078a0422ed428
+size 8540772096

calme-2.3-legalkit-8b.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:abb03a7a48e00c2551a87348036270f58cf86002c047143234ecfa43b752e6f8
+size 16068892192