Optimum

Overview

🤗 Optimum Installation Quick tour Notebooks

Conceptual guides

Quantization

Nvidia

AMD

Intel

AWS Trainium/Inferentia

Google TPUs

for Intel Gaudi

🤗 Optimum for Intel Gaudi Installation Quickstart

Tutorials

Overview Single-HPU Training Distributed Training Run Inference Stable Diffusion TGI on Gaudi

How-To Guides

Reference

Furiosa

ONNX Runtime

Exporters

BetterTransformer

Torch FX

LLM quantization

Utilities

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v1.23.3).

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Overview

Welcome to the 🤗 Optimum for Intel Gaudi tutorials! They will help you to get started quickly on the following topics:

How to train a model on a single device
How to train a model on several devices
How to run inference with your model
How to generate images from text with Stable Diffusion
How to run TGI service on Gaudi

< > Update on GitHub

←Quickstart Single-HPU Training→