Base Model for TransMLA
mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
liked
a dataset
13 days ago
nvidia/Llama-Nemotron-VLM-Dataset-v1
authored
a paper
13 days ago
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated
Prefill \& Decode Inference
commented on
a paper
14 days ago
TPLA: Tensor Parallel Latent Attention for Efficient Disaggregated
Prefill \& Decode Inference
Organizations
None yet
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1
Base Model for TransMLA
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1