NanoFlow: Towards Optimal Large Language Model Serving Throughput
Paper
•
2408.12757
•
Published
•
18
•
2
Michael Gu
yilegu
AI & ML interests
Systems for ML, Systems Reliability
Recent Activity
upvoted
a
paper
2 days ago
ConsumerBench: Benchmarking Generative AI Applications on End-User
Devices
upvoted
a
paper
8 months ago
SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a
Training-Free Memory Tree
upvoted
a
paper
10 months ago
NanoFlow: Towards Optimal Large Language Model Serving Throughput
Organizations
None yet
commented
a
paper
10 months ago