--- license: other language: - en pipeline_tag: text-generation inference: false tags: - transformers - gguf - imatrix - Hamanasu-15B-Instruct --- Quantizations of https://huggingface.co/Delta-Vector/Hamanasu-15B-Instruct ### Open source inference clients/UIs * [llama.cpp](https://github.com/ggerganov/llama.cpp) * [KoboldCPP](https://github.com/LostRuins/koboldcpp) * [ollama](https://github.com/ollama/ollama) * [text-generation-webui](https://github.com/oobabooga/text-generation-webui) * [jan](https://github.com/janhq/jan) * [GPT4All](https://github.com/nomic-ai/gpt4all) ### Closed source inference clients/UIs * [LM Studio](https://lmstudio.ai/) * [Backyard AI](https://backyard.ai/) * More will be added... --- # From original readme After multiple days of training, I'm proud to showcase my very own Phi-4 Finetune, Pretrained on almost a billion tokens worth of Books from - `NewEden/Orion-LIT` - `NewEden/Orion-Asstr-Stories-16K` - `Mielikki/Erebus-87k` Then instruct tuned. This model shows great promise for roleplaying while keeping things fresh and new. (And most of, Unsloppy!)
## 💰 Prompting A known quirk of the model is overly verbose responses when generation length is uncapped, Please cap your maximum output tokens to 100~ tokens above what you prefer This model uses ChatML formatting ```python <|im_start|>system You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|> <|im_start|>User request Take off your helmet.<|im_end|> <|im_start|>No i shall not. This is the way. ```