Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
Paper
•
2504.06261
•
Published
•
97
bloom-testing
bloom-testing
AI & ML interests
Running CI tests for globally distributed BLOOM
Recent Activity
upvoted
a
paper
6 days ago
Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
upvoted
a
paper
6 days ago
Accelerate Parallelizable Reasoning via Parallel Decoding within One
Sequence
updated
a model
almost 2 years ago
bloom-testing/test-bloomd-560m-37ba0c084a0d6bf37b9b592932523768eb3ad4307f57cb200b6c5f9ca3c7ac56
Organizations
None yet