axolotl-quants/Llama-4-Scout-17B-16E-Linearized
Updated
•
1.15k
Axolotl AI Quants
company
AI & ML interests
None defined yet.
Recent Activity
axolotl-quants's activity
fix: update pad token in tokenizer following upstream
#2 opened 6 days ago
by
Nanobit
fix: update pad token in special tokens following upstream
#1 opened 6 days ago
by
Nanobit
fix: update pad token in special tokens following upstream
#3 opened 6 days ago
by
Nanobit
fix: update pad token in special tokens following upstream
#2 opened 6 days ago
by
Nanobit
fix: update rope config following upstream
#1 opened 6 days ago
by
Nanobit
fix: update pad token in special tokens following upstream
#3 opened 6 days ago
by
Nanobit
fix: update rope configs following upstream
#1 opened 6 days ago
by
Nanobit
fix: update old pad token following upstream
#2 opened 6 days ago
by
Nanobit
winglian
updated
a
model
22 days ago
winglian
updated
a
model
27 days ago
winglian
published
a
model
27 days ago
winglian
published
2
models
28 days ago
winglian
updated
3
models
8 months ago
Post
Full fine-tuning of Microsoft's Phi2 on a single 4090 is now supported in axolotl. Thanks to
@abacaj
and
@vikhyatk
for their help with gradient checkpointing and flash attention fixes.
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
alpaca finetune: openaccess-ai-collective/phi2-alpaca
wandb: https://wandb.ai/oaaic/phi2/runs/00pc4ugb?workspace=user-wing-lian
merged PR: https://github.com/OpenAccess-AI-Collective/axolotl/pull/1058
-
- 8 replies