Interesting Project
Hi,
I'm jason from the trillionlabs team, you are officially the first one to have done something like this on huggingface using our model.
I'd love to know more about the project you're working on, is it an English-based project ?
Thank you,
Jason
@junep89 It is currently an english based project, but I hope to expand to more languages once I can translate my datasets. This project aims to create efficient LLMs to assist psychological clinicians in diagnosing, treating, and helping their patients. It also aims to be used to create new treatments. Right now I'm 15, and operating on a zero dollar budget (which is why there currently isn't a demo). I love what you guys have created, and the Trillion model series is insane performance for their size class. I'm hoping to take advantage of that for finetuning. Right now your tokenizer is only supported via PEFT, but I hope Axolotl will come to support it soon!
Cheers,
Alex Scott