File size: 633 Bytes
f3a9bd6
67669b2
f3a9bd6
 
 
 
 
 
 
 
 
 
 
1e5a21a
f3a9bd6
1e5a21a
 
 
 
 
 
 
 
 
 
 
f3a9bd6
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
---
base_model: Qwen/Qwen2.5-0.5B-Instruct
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
license: apache-2.0
language:
- en
---


# General:

The model was trained to improve the output of the Qwen2.5-0.5B

SmallAgent is a compact transformer-based language model, fine-tuned from Qwen2.5-0.5B, aiming to enhance output quality for small-scale, edge-computing scenarios. It is optimized for running efficiently on devices with limited memory and compute capabilities.

# Eval:
*in process*

# Method:
Fine-tuned to improve coherence, reasoning, and factuality of the base Qwen2.5-0.5B model.

Dataset: *update*