yifanyu/I-DLM-8B
Text Generation • 8B • Updated • 654 • 7
Carlo Moro
cnmoro
AI & ML interests
None yet
Recent Activity
liked a model 1 day ago
yifanyu/I-DLM-8B liked a model 2 days ago
sparse-encoder-testing/inference-free-splade-bert-tiny-nq liked a model 2 days ago
Luyu/co-condenser-marcoOrganizations
liked a
model 1 day ago
liked 2
models 2 days ago
updated 2
models 2 days ago
published 2
models 2 days ago
Any plans on releasing flashhead for qwen3.5 models?
reactedto JonnaMat's post with 🚀 4 days ago
Post
1217
⚡ FlashHead: Fast LM Head Inference - Now a Simple vLLM Plugin
flash-head replaces the dense LM head with a two-stage retrieval pipeline - up to 2x inference speedup, training-free. Previously required custom Docker images; now it's just:
✨ The plugin activates automatically via vLLM's
🧩 Supported models (full collection):
Qwen Qwen3, 
meta-llama Llama3, 
google Gemma3, 
nvidia Cosmos-Reason2 - BF16 and W4A16 variants.
https://huggingface.co/collections/embedl/flashhead
📊 embedl/Edge-Inference-Benchmarks
🔧 Benchmark it yourself:
FlashHead shines at low batch sizes; the typical real-time / on-device use case. 🚀
flash-head replaces the dense LM head with a two-stage retrieval pipeline - up to 2x inference speedup, training-free. Previously required custom Docker images; now it's just:
pip install flash-head
vllm serve embedl/Qwen3-1.7B-FlashHead-W4A16✨ The plugin activates automatically via vLLM's
vllm.general_plugins entry point. No source patches, no custom imports.🧩 Supported models (full collection):
https://huggingface.co/collections/embedl/flashhead
📊 embedl/Edge-Inference-Benchmarks
🔧 Benchmark it yourself:
vllm bench latency --model embedl/Qwen3-1.7B-FlashHead-W4A16 --batch-size 1
# Baseline comparison
FLASHHEAD_ENABLED=0 vllm bench latency --model embedl/Qwen3-1.7B-FlashHead-W4A16 --batch-size 1FlashHead shines at low batch sizes; the typical real-time / on-device use case. 🚀
- 2 replies
liked a
dataset 4 days ago
liked 3
models 5 days ago
reactedto fffiloni's post with 🚀 5 days ago
Post
2915
✨ PASD Magnify is back on Hugging Face Spaces
fffiloni/PASD
PASD isn’t recent, but still delivers strong results — worth restoring rather than replacing.
Getting it to run again wasn’t a simple dependency issue.
It relied on parts of diffusers that no longer exist, while moving to Gradio 6 forced a much newer HF stack — and I couldn’t modify the original source directly.
Recreating the old environment wasn’t practical.
So I patched the downloaded code at runtime before import and made it compatible with today’s stack.
That ended up being the only approach that held without forking or freezing everything to outdated versions.
If you’ve used it before (or are curious), feel free to give it another try.
fffiloni/PASD
PASD isn’t recent, but still delivers strong results — worth restoring rather than replacing.
Getting it to run again wasn’t a simple dependency issue.
It relied on parts of diffusers that no longer exist, while moving to Gradio 6 forced a much newer HF stack — and I couldn’t modify the original source directly.
Recreating the old environment wasn’t practical.
So I patched the downloaded code at runtime before import and made it compatible with today’s stack.
That ended up being the only approach that held without forking or freezing everything to outdated versions.
If you’ve used it before (or are curious), feel free to give it another try.
liked a
model 5 days ago
liked 2
models 6 days ago
updated a
model 7 days ago
liked a
model 12 days ago
