| base_model: HuggingFaceTB/SmolLM-360M-Instruct | |
|  | |
| # QuantFactory/Biggie-SmoLlm-0.4B-GGUF | |
| This is quantized version of [nisten/Biggie-SmoLlm-0.4B](https://huggingface.co/nisten/Biggie-SmoLlm-0.4B) created using llama.cpp | |
| # Original Model Card | |
| ###Coherent Frankenstein of smolLm-0.36b upped to 0.4b | |
| This took about 5 hours of semi-automated continuous merging to figure out the recipe. | |
| Model is smarter, and UNTRAINED. Uploaded it for training. Yet it performs well as is even quantized to 8bit. | |
| 8bit gguf included for testing. | |
| ```bash | |
| wget https://huggingface.co/nisten/Biggie-SmoLlm-0.4B/resolve/main/Biggie_SmolLM_400M_q8_0.gguf | |
| ``` | |
| ```verilog | |
| ./llama-cli -ngl 99 -co --temp 0 -p "How to build a city on Mars via calculating Aldrin-Cycler orbits?" -m Biggie_SmolLM_400M_q8_0.gguf -cnv -fa --keep -1 | |
| ``` | |
|  | |