Hugging Face Optimum

non-profit

https://huggingface.co/docs/optimum

Activity Feed

AI & ML interests

Accelerating DL

Recent Activity

badaoui updated a Space 14 days ago

optimum/neuron-export

badaoui new activity 15 days ago

optimum/neuron-export:Using neuron cache instead of creating a pull-request in the target repo

dacorvo new activity 15 days ago

optimum/neuron-export:Using neuron cache instead of creating a pull-request in the target repo

View all activity

optimum's activity

jeffboudier

posted an update 5 days ago

Post

1546

Today we launched Training Cluster as a Service, to make the new DGX Cloud Lepton supercloud easily accessible to AI researchers.

Hugging Face will collaborate with NVIDIA to provision and set up GPU training clusters to make them available for the duration of training runs.

Hugging Face organizations can sign up here: https://huggingface.co/training-cluster

badaoui

updated a Space 14 days ago

Export to AWS Neuron

🏎

Export HF models to AWS Neuron-optimized format for Trn/Inf

badaoui

in optimum/neuron-export 15 days ago

Using neuron cache instead of creating a pull-request in the target repo

❤️ 1

#1 opened 15 days ago by

dacorvo

in optimum/neuron-export 15 days ago

Using neuron cache instead of creating a pull-request in the target repo

❤️ 1

#1 opened 15 days ago by

dacorvo

badaoui

published a Space 15 days ago

Export to AWS Neuron

🏎

Export HF models to AWS Neuron-optimized format for Trn/Inf

badaoui

updated a dataset 19 days ago

optimum/documentation-images

Viewer • Updated 19 days ago • 15 • 8.41k • 2

jeffboudier

posted an update 19 days ago

Post

2445

👏 Congrats @jinanz adding TimesFM times series forecasting to Transformers!

Learn how to use TimesFM in this blog post by the Nutanix team: https://huggingface.co/blog/Nutanix/introducing-timesfm-for-time-series-forcasting

jeffboudier

posted an update 24 days ago

Post

483

Wrapping up a week of shipping and announcements with Dell Enterprise Hub now featuring AI Applications, on-device models for AI PCs, a new CLI and Python SDK... all you need for building AI on premises!

Blog post has all the details: https://huggingface.co/blog/dell-ai-applications

regisss

posted an update about 1 month ago

Post

2366

It will be very interesting to benchmark how energy-efficient the new Falcon-Edge is: https://huggingface.co/blog/tiiuae/falcon-edge

Should be super efficient on CPU according to the numbers published for BitNet: https://github.com/microsoft/BitNet/blob/main/assets/intel_performance.jpg

1 reply

jeffboudier

posted an update about 1 month ago

Post

2582

Transcribing 1 hour of audio for less than $0.01 🤯

@mfuntowicz cooked with 8x faster Whisper speech recognition - whisper-large-v3-turbo transcribes at 100x real time on a $0.80/hr L4 GPU!

How they did it: https://huggingface.co/blog/fast-whisper-endpoints

1-click deploy with HF Inference Endpoints: https://endpoints.huggingface.co/new?repository=openai%2Fwhisper-large-v3-turbo&vendor=aws&region=us-east&accelerator=gpu&instance_id=aws-us-east-1-nvidia-l4-x1&task=automatic-speech-recognition&no_suggested_compute=true

jeffboudier

posted an update about 1 month ago

Post

3016

So many orgs on HF would really benefit from security and governance built into Enterprise Hub - I wrote a guide on why and how upgrade: https://huggingface.co/spaces/jeffboudier/how-to-upgrade-to-enterprise

For instance, did you know about Resource Groups?

pagezyhf

posted an update about 2 months ago

Post

1989

If you haven't had the chance to test the latest open model from Meta, Llama 4 Maverick, go try it on AMD MI 300 on Hugging Face!

amd/llama4-maverick-17b-128e-mi-amd

Jingya

updated a model 2 months ago

optimum/pixart_sigma_pipe_xl_2_512_ms_neuronx

Updated Apr 7

jeffboudier

posted an update 2 months ago

Post

2206

Llama4 is out and Scout is already on the Dell Enterprise Hub to deploy on Dell systems 👉 dell.huggingface.co

jeffboudier

posted an update 3 months ago

Post

1569

Enterprise orgs now enable serverless Inference Providers for all members
- includes $2 free usage per org member (e.g. an Enterprise org with 1,000 members share $2,000 free credit each month)
- admins can set a monthly spend limit for the entire org
- works today with Together, fal, Novita, Cerebras and HF Inference.

Here's the doc to bill Inference Providers usage to your org: https://huggingface.co/docs/inference-providers/pricing#organization-billing

2 replies

regisss

posted an update 4 months ago

Post

1757

Nice paper comparing the fp8 inference efficiency of Nvidia H100 and Intel Gaudi2: An Investigation of FP8 Across Accelerators for LLM Inference (2502.01070)

The conclusion is interesting: "Our findings highlight that the Gaudi 2, by leveraging FP8, achieves higher throughput-to-power efficiency during LLM inference"

One aspect of AI hardware accelerators that is often overlooked is how they consume less energy than GPUs. It's nice to see researchers starting carrying out experiments to measure this!

Gaudi3 results soon...

pagezyhf

posted an update 5 months ago

Post

1757

We published https://huggingface.co/blog/deepseek-r1-aws!

If you are using AWS, give a read. It is a running document to showcase how to deploy and fine-tune DeepSeek R1 models with Hugging Face on AWS.

We're working hard to enable all the scenarios, whether you want to deploy to Inference Endpoints, Sagemaker or EC2; with GPUs or with Trainium & Inferentia.

We have full support for the distilled models, DeepSeek-R1 support is coming soon!! I'll keep you posted.

Cheers

1 reply

pagezyhf

posted an update 5 months ago

Post

462

Learn how to deploy multiple LoRA adapters on Vertex AI with this blogpost, using Hugging Face Deep Learning Containers on GCP.

https://medium.com/google-cloud/open-models-on-vertex-ai-with-hugging-face-serving-multiple-lora-adapters-on-vertex-ai-e3ceae7b717c

jeffboudier

posted an update 5 months ago

Post

752

NVIDIA just announced the Cosmos World Foundation Models, available on the Hub: nvidia/cosmos-6751e884dc10e013a0a0d8e6

Cosmos is a family of pre-trained models purpose-built for generating physics-aware videos and world states to advance physical AI development.
The release includes Tokenizers nvidia/cosmos-tokenizer-672b93023add81b66a8ff8e6

Learn more in this great community article by @mingyuliutw and @PranjaliJoshi https://huggingface.co/blog/mingyuliutw/nvidia-cosmos

1 reply

regisss

posted an update 6 months ago

Post

1034

Nice to see day 1 support of Falcon 3 on Gaudi with Optimum Habana!

👉 https://www.intel.com/content/www/us/en/developer/articles/technical/intel-ai-solutions-support-falcon-3-fdn-models.html

AI & ML interests

Recent Activity

Team members 16

optimum's activity

Export to AWS Neuron

Using neuron cache instead of creating a pull-request in the target repo

Using neuron cache instead of creating a pull-request in the target repo

Export to AWS Neuron