aloobun

aloobun

·

https://tinyurl.com/aloobun

AI & ML interests

tiny models and datasets, discord: aloobun

Recent Activity

liked a model about 3 hours ago

XHToken/Spark-X2.5-4B

liked a model 28 days ago

NemoStation/Marlin-2B

liked a dataset 2 months ago

View all activity

Organizations

upvoted a paper 2 months ago

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning

Paper • 2602.21103 • Published Jun 2 • 10

upvoted a paper 6 months ago

Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interaction

Paper • 2406.19108 • Published Jun 27, 2024 • 1

upvoted 2 papers 9 months ago

Reasoning Under 1 Billion: Memory-Augmented Reinforcement Learning for Large Language Models

Paper • 2504.02273 • Published Apr 3, 2025 • 7

ROOT: Robust Orthogonalized Optimizer for Neural Network Training

Paper • 2511.20626 • Published Nov 25, 2025 • 45

upvoted a paper 10 months ago

Kimi Linear: An Expressive, Efficient Attention Architecture

Paper • 2510.26692 • Published Oct 30, 2025 • 138

upvoted a paper 11 months ago

Sparse Query Attention (SQA): A Computationally Efficient Attention Mechanism with Query Heads Reduction

Paper • 2510.01817 • Published Oct 2, 2025 • 16

upvoted a paper about 1 year ago

UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning

Paper • 2508.18756 • Published Aug 26, 2025 • 36

upvoted a collection about 1 year ago

Gemma 3n

4 items • Updated Jul 21 • 274

upvoted 2 papers over 1 year ago

QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learning

Paper • 2505.17667 • Published May 23, 2025 • 89

Achieving Tokenizer Flexibility in Language Models through Heuristic Adaptation and Supertoken Learning

Paper • 2505.09738 • Published May 14, 2025 • 10

upvoted 2 collections over 1 year ago

Cogito v1 Preview

5 items • Updated Apr 8, 2025 • 118

IndicTTS Datasets

Datasets derived from the Indic TTS Database, a special corpus of Indian languages developed by the Speech Technology Consortium at IIT Madras. • 13 items • Updated Mar 6, 2025 • 15

upvoted 2 papers over 1 year ago

Adapting Multilingual LLMs to Low-Resource Languages using Continued Pre-training and Synthetic Corpus

Paper • 2410.14815 • Published Oct 18, 2024 • 1

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published Dec 18, 2024 • 169

upvoted 3 collections over 1 year ago

ModernBERT

Bringing BERT into modernity via both architecture changes and scaling • 3 items • Updated Dec 19, 2024 • 161

Falcon3

Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters. • 40 items • Updated 23 days ago • 94

MiniPLM

Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models • 5 items • Updated Oct 21, 2024 • 2

upvoted 2 papers over 1 year ago

MiniPLM: Knowledge Distillation for Pre-Training Language Models

Paper • 2410.17215 • Published Oct 22, 2024 • 16

Structured 3D Latents for Scalable and Versatile 3D Generation

Paper • 2412.01506 • Published Dec 2, 2024 • 92

upvoted a collection over 1 year ago

InternVL2.5

Better than InternVL 2.0 • 17 items • Updated Mar 2 • 93