Optimum documentation
Overview
Overview
Nvidia
Intel
AWS Trainium/Inferentia
Google TPUs
ExecuTorch
ONNX
Furiosa
Exporters
Torch FX
LLM quantization
Utilities
You are viewing main version, which requires installation from source. If you'd like
regular pip install, checkout the latest stable version (v1.27.0).
Overview
🤗 Optimum provides an integration with Torch FX, a library for PyTorch that allows developers to implement custom transformations of their models that can be optimized for performance.
How-to guides
Practical guides to help you achieve a specific goal. Take a look at these guides to learn how to use 🤗 Optimum to solve real-world problems.
Conceptual guides
High-level explanations for building a better understanding about important topics such as quantization and graph optimization.
Reference
Technical descriptions of how the Torch FX classes and methods of 🤗 Optimum work.