Base Model for TransMLA
mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
liked
a dataset
about 1 month ago
nvidia/Llama-Nemotron-VLM-Dataset-v1
authored
a paper
about 1 month ago
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated
Prefill \& Decode Inference
commented on
a paper
about 1 month ago
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated
Prefill \& Decode Inference
Organizations
None yet
models
58
fxmeng/TransMLA-llama-2-7b-r64-n512-norm
Text Generation
•
6B
•
Updated
•
5
fxmeng/OpenR1-Distill-7B
Updated
fxmeng/TransMLA-rmsnorm-llama-2-q512-kv896
Updated
fxmeng/PiSSA-llama-7b-commonsense-148k
7B
•
Updated
•
2
fxmeng/PiSSA-Llama-3-8b-commonsense-148k
8B
•
Updated
•
5
fxmeng/PiSSA-Llama-2-7b-commonsense-148k
7B
•
Updated
•
3
fxmeng/PiSSA-llama-13b-commonsense-148k
13B
•
Updated
•
4
fxmeng/CLOVER-llama-3-8b-commonsense-148k
8B
•
Updated
•
3
fxmeng/CLOVER-llama-2-7b-commonsense-148k
7B
•
Updated
•
3
fxmeng/CLOVER-llama-13b-commonsense-148k
13B
•
Updated
•
4
datasets
12
fxmeng/transmla_pretrain_100m_tokens
Viewer
•
Updated
•
100k
•
10
fxmeng/transmla_pretrain_1B_tokens
Viewer
•
Updated
•
1.14M
•
74
fxmeng/transmla_pretrain_6B_tokens
Viewer
•
Updated
•
5.94M
•
179
fxmeng/pissa-dataset
Viewer
•
Updated
•
844k
•
405
•
3
fxmeng/big-bench-hard-continue-finetuning
Viewer
•
Updated
•
10.3k
•
138
fxmeng/commonsense_filtered
Viewer
•
Updated
•
170k
•
76
•
1
fxmeng/MetaMath-GSM240K
Viewer
•
Updated
•
240k
•
56
•
1
fxmeng/MetaMath-MATH155K
Viewer
•
Updated
•
155k
•
19
fxmeng/CodeFeedback-Python105K
Viewer
•
Updated
•
105k
•
23
•
6
fxmeng/llava_finetune_336x336
Preview
•
Updated
•
17