base_model: unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
license: apache-2.0
language:
- en
- tl
datasets:
- Linggowiktiks/AnoNa
🦙 Liyama-3B
Liyama-3B is a fine-tuned version of Meta’s LLaMA-3B (3.2) model, built to understand and respond fluently in Tagalog. It was trained on the AnoNa dataset over 3 epochs, aiming for natural, context-aware instruction-following in Filipino.
🔤 Origin of the Name
The name Liyama is a Tagalified version of llama, reflecting both its LLaMA base and its Tagalog-focused language capabilities. It mirrors how Filipino often adapts foreign terms into familiar, phonetic forms—like camera → kamera, lion → leon, and now, llama → liyama.
🧠 Training Data: The AnoNa Dataset
Liyama-3B was trained solely on response completions from the AnoNa dataset — a self-instruct corpus generated using Gemini 1.5 and 2.0.
Inspired by SimpleQnA, the dataset contains short, helpful instruction-response pairs. But AnoNa introduces several improvements:
- ✅ Less English, More Tagalog prompts
- ✅ Less IFEVAL-style formatting
- ✅ No overuse of modifiers in instructions
- ✅ Balanced task types to avoid dominant categories
- ✅ Complex tasks favored (65% complex / 35% simple)
- ✅ Reduced sycophancy and generic praise
- ✅ Improved follow-up handling
- ✅ AI self-intro appears only when relevant
- ✅ Implicit chain-of-thought reasoning, not labeled
- ✅ Extra task types added to increase variety
This focus creates a model that's practical, straightforward, and tuned for realistic conversational use in Filipino, without excessive formatting or irrelevant disclaimers.
🗣️ Use Case
Liyama-3B is ideal for:
- Answering questions in Tagalog
- Writing essays, reflections, and letters in Filipino
- Following natural instructions, even when mixed with English
- Chat-based tasks where fluency and tone matter
- Educational or community apps centered around local language use
📦 Model Details
| Feature | Value |
|---|---|
| Base Model | LLaMA-3B v3.2 |
| Fine-tuned Dataset | AnoNa |
| Epochs | 3 |
| Language Focus | Tagalog (with some English) |
| Prompt Format | Responses only |
Liyama-3B is part of a broader effort to create open, practical Filipino-language models for real use—not just benchmarks. Expect follow-ups tuned for multi-turn chat, reasoning, and creative tasks.