Upload folder using huggingface_hub (#1)

- 462c300be5155500297f54f01e7ecbfe636b4ee83a9ddd34108f1418f00180ee (f57874c0e686b30b4ac27ad67cee8900b03fffdf)
- 751492eb99bc9c61ea997face6d1bade373ea6b720f97846d3d2a77ad6a95a27 (7057aeb790cc8b9a74869a81f88fe0d8b82c0839)
- 01064a30d95337bf945a3d5dea50171b73f016f98d7ae9b85c13a454aab09fa1 (ca70aab3cc1b4bda3951bde10bc0caa7453016e7)
- 1f2dc6e46de0f4b6e4562e386345cece6a12edf8749e7321efc09a26d434ad75 (ff97760ea8578e7d767ee7a5b1d109c2fa6bce51)
- 91a54d980d3d67502b88883441160ac441106494309f20581294790cec6ec59e (6dec3bba4a01b7e791041db1fc03aa6d12eca9d4)
- 1e944b2161a11e17a9a9fdc10f8c47724bed548e561d56fed0ceaa1b62c825f2 (5a6a9d5b81463d3f6558886d62e59f21261e6cfb)

.gitattributes

@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+s1.1-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+s1.1-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+s1.1-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+s1.1-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+s1.1-7B.fp16.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,46 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+- text-generation
+model_name: s1.1-7B-GGUF
+base_model: simplescaling/s1.1-7B
+inference: false
+model_creator: simplescaling
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/s1.1-7B-GGUF](https://huggingface.co/MaziyarPanahi/s1.1-7B-GGUF)
+- Model creator: [simplescaling](https://huggingface.co/simplescaling)
+- Original model: [simplescaling/s1.1-7B](https://huggingface.co/simplescaling/s1.1-7B)
+
+## Description
+[MaziyarPanahi/s1.1-7B-GGUF](https://huggingface.co/MaziyarPanahi/s1.1-7B-GGUF) contains GGUF format model files for [simplescaling/s1.1-7B](https://huggingface.co/simplescaling/s1.1-7B).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

s1.1-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ecaf7bac78df4f81c324665af00bfd105a0be654acd1851082cf1978410f57e
+size 5445440224

s1.1-7B.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19b10c34c6c31ac4bcab053085f06b029522c967f414441c69685e25f35bbc6b
+size 5315785440

s1.1-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf90ad0075d4a910d899a79a65aa6d28d9ae58edf3799830871a6750417c8690
+size 6254807776

s1.1-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca706923a8ad60541675b213decc21a04229c018a7b6c54ff0c84687e860b7e3
+size 8099134176

s1.1-7B.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76ce150bbe14f13a3353440a482165f3515860b419030a0290ac16fb9cb12daa
+size 15238462144