Hugging Face's logo
Jared Sulzdorf's picture
9 62 62

Jared Sulzdorf PRO

jsulz
TanvirulBD's profile picture MartaVigara's profile picture AiActivity's profile picture
·
https://www.jsulz.com/

AI & ML interests

Infrastructure, law, policy

Recent Activity

replied to Wauplin's post about 15 hours ago
‼️ huggingface_hub's v0.30.0 is out with our biggest update of the past two years! Full release notes: https://github.com/huggingface/huggingface_hub/releases/tag/v0.30.0. 🚀 Ready. Xet. Go! Xet is a groundbreaking new protocol for storing large objects in Git repositories, designed to replace Git LFS. Unlike LFS, which deduplicates files, Xet operates at the chunk level—making it a game-changer for AI builders collaborating on massive models and datasets. Our Python integration is powered by [xet-core](https://github.com/huggingface/xet-core), a Rust-based package that handles all the low-level details. You can start using Xet today by installing the optional dependency: ```bash pip install -U huggingface_hub[hf_xet] ``` With that, you can seamlessly download files from Xet-enabled repositories! And don’t worry—everything remains fully backward-compatible if you’re not ready to upgrade yet. Blog post: https://huggingface.co/blog/xet-on-the-hub Docs: https://huggingface.co/docs/hub/en/storage-backends#xet ⚡ Inference Providers - We’re thrilled to introduce Cerebras and Cohere as official inference providers! This expansion strengthens the Hub as the go-to entry point for running inference on open-weight models. - Novita is now our 3rd provider to support text-to-video task after Fal.ai and Replicate. - Centralized billing: manage your budget and set team-wide spending limits for Inference Providers! Available to all Enterprise Hub organizations. ```py from huggingface_hub import InferenceClient client = InferenceClient(provider="fal-ai", bill_to="my-cool-company") image = client.text_to_image( "A majestic lion in a fantasy forest", model="black-forest-labs/FLUX.1-schnell", ) image.save("lion.png") ``` - No more timeouts when generating videos, thanks to async calls. Available right now for Fal.ai, expecting more providers to leverage the same structure very soon!
reacted to Wauplin's post with 🔥 about 15 hours ago
‼️ huggingface_hub's v0.30.0 is out with our biggest update of the past two years! Full release notes: https://github.com/huggingface/huggingface_hub/releases/tag/v0.30.0. 🚀 Ready. Xet. Go! Xet is a groundbreaking new protocol for storing large objects in Git repositories, designed to replace Git LFS. Unlike LFS, which deduplicates files, Xet operates at the chunk level—making it a game-changer for AI builders collaborating on massive models and datasets. Our Python integration is powered by [xet-core](https://github.com/huggingface/xet-core), a Rust-based package that handles all the low-level details. You can start using Xet today by installing the optional dependency: ```bash pip install -U huggingface_hub[hf_xet] ``` With that, you can seamlessly download files from Xet-enabled repositories! And don’t worry—everything remains fully backward-compatible if you’re not ready to upgrade yet. Blog post: https://huggingface.co/blog/xet-on-the-hub Docs: https://huggingface.co/docs/hub/en/storage-backends#xet ⚡ Inference Providers - We’re thrilled to introduce Cerebras and Cohere as official inference providers! This expansion strengthens the Hub as the go-to entry point for running inference on open-weight models. - Novita is now our 3rd provider to support text-to-video task after Fal.ai and Replicate. - Centralized billing: manage your budget and set team-wide spending limits for Inference Providers! Available to all Enterprise Hub organizations. ```py from huggingface_hub import InferenceClient client = InferenceClient(provider="fal-ai", bill_to="my-cool-company") image = client.text_to_image( "A majestic lion in a fantasy forest", model="black-forest-labs/FLUX.1-schnell", ) image.save("lion.png") ``` - No more timeouts when generating videos, thanks to async calls. Available right now for Fal.ai, expecting more providers to leverage the same structure very soon!
reacted to Wauplin's post with 🚀 about 15 hours ago
‼️ huggingface_hub's v0.30.0 is out with our biggest update of the past two years! Full release notes: https://github.com/huggingface/huggingface_hub/releases/tag/v0.30.0. 🚀 Ready. Xet. Go! Xet is a groundbreaking new protocol for storing large objects in Git repositories, designed to replace Git LFS. Unlike LFS, which deduplicates files, Xet operates at the chunk level—making it a game-changer for AI builders collaborating on massive models and datasets. Our Python integration is powered by [xet-core](https://github.com/huggingface/xet-core), a Rust-based package that handles all the low-level details. You can start using Xet today by installing the optional dependency: ```bash pip install -U huggingface_hub[hf_xet] ``` With that, you can seamlessly download files from Xet-enabled repositories! And don’t worry—everything remains fully backward-compatible if you’re not ready to upgrade yet. Blog post: https://huggingface.co/blog/xet-on-the-hub Docs: https://huggingface.co/docs/hub/en/storage-backends#xet ⚡ Inference Providers - We’re thrilled to introduce Cerebras and Cohere as official inference providers! This expansion strengthens the Hub as the go-to entry point for running inference on open-weight models. - Novita is now our 3rd provider to support text-to-video task after Fal.ai and Replicate. - Centralized billing: manage your budget and set team-wide spending limits for Inference Providers! Available to all Enterprise Hub organizations. ```py from huggingface_hub import InferenceClient client = InferenceClient(provider="fal-ai", bill_to="my-cool-company") image = client.text_to_image( "A majestic lion in a fantasy forest", model="black-forest-labs/FLUX.1-schnell", ) image.save("lion.png") ``` - No more timeouts when generating videos, thanks to async calls. Available right now for Fal.ai, expecting more providers to leverage the same structure very soon!
View all activity

Organizations

Hugging Face's profile picture Spaces Examples's profile picture Blog-explorers's profile picture Journalists on Hugging Face's profile picture Hugging Face Discord Community's profile picture Xet Team's profile picture open/ acc's profile picture

Posts 10

view post
Post
1837
If you've been following along with the Xet Team's (https://huggingface.co/xet-team) work, you know we've been working to migrate the Hugging Face Hub from Git LFS and to Xet.

Recently, we launched a waitlist to join the movement to Xet (join here! https://huggingface.co/join/xet ) but getting to this point was a journey.

From the initial proof of concept in August, to launching on the Hub internally, to migrating a set of repositories and routing a small chunk of download traffic on the Hub through our infrastructure. Every step of the way has been full of challenges, big and small, and well worth the effort.

Over the past few weeks, with real traffic flowing through our services we’ve tackled some truly gnarly issues (unusual upload/download patterns, memory leaks, load imbalances, and more) and resolved each without major disruptions.

If you're curious about how this sliver of Hub infrastructure looks as we routed traffic through it for the first time (and want a deep dive full of Grafana and Kibana charts 🤓) I have a post for you.

Here's an inside look into the day of our first migrations and the weeks following, where we pieced together solutions in real time.

https://huggingface.co/blog/xet-on-the-hub
View all Posts

Articles 4

Article
38

Xet is on the Hub

View all Articles

Collections 3

AI Engineering
A collection of arXiv papers from Chip Huyen's AI Engineering organized by chapter and ordered by when each appears in the book.
Papers I Have Read
A list of papers that have moved off my reading list