Hugging Face's logo
Marc Sun's picture
37 48 72

Marc Sun

marcsun13
NaiveAttention's profile picture rwightman's profile picture abhiramvad's profile picture
·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

upvoted an article about 10 hours ago
Memory-efficient Diffusion Transformers with Quanto and Diffusers
reacted to Wauplin's post with 🤗 2 days ago
‼️ huggingface_hub's v0.30.0 is out with our biggest update of the past two years! Full release notes: https://github.com/huggingface/huggingface_hub/releases/tag/v0.30.0. 🚀 Ready. Xet. Go! Xet is a groundbreaking new protocol for storing large objects in Git repositories, designed to replace Git LFS. Unlike LFS, which deduplicates files, Xet operates at the chunk level—making it a game-changer for AI builders collaborating on massive models and datasets. Our Python integration is powered by [xet-core](https://github.com/huggingface/xet-core), a Rust-based package that handles all the low-level details. You can start using Xet today by installing the optional dependency: ```bash pip install -U huggingface_hub[hf_xet] ``` With that, you can seamlessly download files from Xet-enabled repositories! And don’t worry—everything remains fully backward-compatible if you’re not ready to upgrade yet. Blog post: https://huggingface.co/blog/xet-on-the-hub Docs: https://huggingface.co/docs/hub/en/storage-backends#xet ⚡ Inference Providers - We’re thrilled to introduce Cerebras and Cohere as official inference providers! This expansion strengthens the Hub as the go-to entry point for running inference on open-weight models. - Novita is now our 3rd provider to support text-to-video task after Fal.ai and Replicate. - Centralized billing: manage your budget and set team-wide spending limits for Inference Providers! Available to all Enterprise Hub organizations. ```py from huggingface_hub import InferenceClient client = InferenceClient(provider="fal-ai", bill_to="my-cool-company") image = client.text_to_image( "A majestic lion in a fantasy forest", model="black-forest-labs/FLUX.1-schnell", ) image.save("lion.png") ``` - No more timeouts when generating videos, thanks to async calls. Available right now for Fal.ai, expecting more providers to leverage the same structure very soon!
upvoted an article 5 days ago
Welcome Llama 4 Maverick & Scout on Hugging Face!
View all activity

Organizations

Hugging Face's profile picture Hugging Face Internal Testing Organization's profile picture pytorch's profile picture HuggingFaceM4's profile picture Hugging Face OSS Metrics's profile picture accelerate's profile picture Hugging Face Smol Models Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture Hugging Face 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture Hugging Face Party @ PyTorch Conference's profile picture qrias's profile picture wut?'s profile picture DDUF's profile picture gg-hf-g's profile picture Bitsandbytes Community's profile picture

Articles 8

Article
51

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

Article
41

Introducing SynthID Text

View all Articles

datasets

None public yet