KoboldAI

community

AI & ML interests

Fiction Models made by the KoboldAI community. All uploaded models are either uploaded by their original finetune authors or with the finetune authors permission. Visit our Discord at https://koboldai.org/discord

Recent Activity

Henk717 updated a Space 9 days ago

KoboldAI/Koboldcpp-Tiefighter

Henk717 updated a Space about 1 month ago

KoboldAI/Koboldcpp-Tiefighter

Henk717 updated a model 3 months ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

View all activity

KoboldAI's activity

Henk717

updated a Space 9 days ago

Koboldcpp Tiefighter

🦎

KoboldCpp is a textgen, image gen and more all in one

Henk717

updated a model 3 months ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

Updated Feb 7 • 11

concedo

updated a model 3 months ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated Jan 27 • 52.3k • 101

concedo

updated a Space 4 months ago

Koboldcpp Tiefighter

🦎

KoboldCpp is a textgen, image gen and more all in one

Henk717

updated 2 models 4 months ago

KoboldAI/Llama-3.1-8B-BookAdventures-GGUF

Updated Jan 4 • 1.13k • 3

KoboldAI/Llama-3.1-8B-BookAdventures

Updated Jan 4 • 58 • 6

elinas

posted an update 8 months ago

Post

2559

We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B