PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Paper
•
2406.06282
•
Published
•
37
•
5
Yixin Song
yixinsong
AI & ML interests
None yet
Recent Activity
updated
a model
2 days ago
PowerInfer/SmallThinker-3B-Preview
new activity
2 days ago
PowerInfer/SmallThinker-3B-Preview:Eval script
liked
a dataset
10 days ago
IntelligentEstate/The_Key
Organizations
yixinsong's activity
Eval script
4
#9 opened 2 days ago
by
rawsh
About the training details
5
#5 opened 14 days ago
by
hiyouga
How to Pair with Larger Models
3
#7 opened 14 days ago
by
windkkk
Prompt/token adjust to stop "Overthinking" in unnescissary cases
2
#6 opened 14 days ago
by
fuzzy-mittenz
example use colab?
8
#3 opened 15 days ago
by
NickyNicky
Update README.md
#4 opened 15 days ago
by
AISafety
Training: Second Phase
6
#2 opened 18 days ago
by
tugstugi
[bot] Conversion to Parquet
#1 opened about 1 month ago
by
parquet-converter
[bot] Conversion to Parquet
#1 opened 18 days ago
by
parquet-converter
Librarian Bot: Add language metadata for dataset
#2 opened 17 days ago
by
librarian-bot
Evaluation
6
#1 opened 19 days ago
by
tugstugi
problems about sample strategies
1
#1 opened 4 months ago
by
thuzhizhi
[bot] Conversion to Parquet
#1 opened 5 months ago
by
parquet-converter
0729聊天数据集有计划开源吗？
2
#16 opened 5 months ago
by
yixinsong
MMLU doesn't match on lm-evaluation-harness
2
#2 opened 6 months ago
by
yixinsong
Inference API not working properly. Lack of proper modeling file?
2
#1 opened 7 months ago
by
xunkai55
Difference between SparseLLM/relu and SparseLLM/reglu - lack of modeling file?
1
#1 opened 7 months ago
by
xunkai55
commented
3
papers
7 months ago