Aira is a series of chatbots developed as an experimentation playground for value alignment.
Nicholas Kluge Corrêa PRO
nicholasKluge
AI & ML interests
AI Ethics and AI Safety
Recent Activity
new activity
1 day ago
AiresPucrs/bert-base-wikitext:Adding `safetensors` variant of this model
reacted
to
samuellimabraz's
post
with 👍
2 days ago
I wrote a article on Parameter-Efficient Fine-Tuning (PEFT), exploring techniques for efficient fine-tuning in LLMs, their implementations, and variations.
The study is based on the article "Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning" and the PEFT library integrated with Hugging Face's Transformers.
Article: https://huggingface.co/blog/samuellimabraz/peft-methods
Notebook: https://colab.research.google.com/drive/1B9RsKLMa8SwTxLsxRT8g9OedK10zfBEP?usp=sharing
Collection: https://huggingface.co/collections/samuellimabraz/service-summary-6793ccfe774073328ea9f8df
Analyzed methods:
- Adapters: Soft Prompts (Prompt Tuning, Prefix Tuning, P-tuning), IA³.
- Reparameterization: LoRA, QLoRA, LoHa, LoKr, X-LoRA, Intrinsic SAID, and variations of initializations (PiSSA, OLoRA, rsLoRA, DoRA).
- Selective Tuning: BitFit, DiffPruning, FAR, FishMask.
I'm starting out in generative AI, I have more experience with computer vision and robotics. Just sharing here 🤗
updated
a Space
15 days ago
TucanoBR/README
Organizations
spaces
4
models
33
nicholasKluge/Aira-OPT-125M
Text Generation
•
Updated
•
152
nicholasKluge/Aira-OPT-350M
Text Generation
•
Updated
•
182
nicholasKluge/Aira-2-portuguese-124M
Text Generation
•
Updated
•
535
•
2
nicholasKluge/Aira-2-portuguese-560M
Text Generation
•
Updated
•
387
•
2
nicholasKluge/Aira-2-124M
Text Generation
•
Updated
•
1.13k
•
1
nicholasKluge/Aira-2-124M-DPO
Text Generation
•
Updated
•
151
•
1
nicholasKluge/Aira-2-355M
Text Generation
•
Updated
•
1.01k
•
2
nicholasKluge/Aira-2-774M
Text Generation
•
Updated
•
1.02k
•
3
nicholasKluge/Aira-2-1B1
Text Generation
•
Updated
•
1.01k
•
2
nicholasKluge/Aira-OPT-1B3
Text Generation
•
Updated
•
29
datasets
12
nicholasKluge/Pt-Corpus-Instruct-tokenized-large
Viewer
•
Updated
•
3.06M
•
109
nicholasKluge/Pt-Corpus-Instruct-tokenized-small
Updated
•
130
nicholasKluge/Pt-Corpus-Instruct
Viewer
•
Updated
•
10.6M
•
122
•
2
nicholasKluge/Pt-Corpus-tokenized
Viewer
•
Updated
•
2.02M
•
74
nicholasKluge/Pt-Corpus
Viewer
•
Updated
•
5.77M
•
41
•
3
nicholasKluge/toxic-text
Viewer
•
Updated
•
69.9k
•
59
nicholasKluge/toxic-aira-dataset
Viewer
•
Updated
•
16.6k
•
73
•
4
nicholasKluge/reward-aira-dataset
Viewer
•
Updated
•
70k
•
87
•
3
nicholasKluge/instruct-aira-dataset
Viewer
•
Updated
•
124k
•
165
•
7
nicholasKluge/instruct-aira-dataset-v2
Viewer
•
Updated
•
163k
•
72
•
4