Skip to content

Commit fbad3ff

Browse files
JingyaHuangyoung-developer
authored andcommitted
Add Nvidia and Neuron to the installation doc (huggingface#1803)
update doc
1 parent 6c0654b commit fbad3ff

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

docs/source/installation.mdx

+5-3
Original file line numberDiff line numberDiff line change
@@ -20,12 +20,14 @@ python -m pip install optimum
2020

2121
If you'd like to use the accelerator-specific features of 🤗 Optimum, you can install the required dependencies according to the table below:
2222

23-
| Accelerator | Installation |
24-
|:-----------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------|
23+
| Accelerator | Installation |
24+
|:-----------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------|
2525
| [ONNX runtime](https://onnxruntime.ai/docs/) | `pip install --upgrade-strategy eager install optimum[onnxruntime]`|
2626
| [Intel Neural Compressor (INC)](https://www.intel.com/content/www/us/en/developer/tools/oneapi/neural-compressor.html) | `pip install --upgrade-strategy eager optimum[neural-compressor]` |
2727
| [Intel OpenVINO](https://docs.openvino.ai/latest/index.html) | `pip install --upgrade-strategy eager optimum[openvino,nncf]` |
28-
| [AMD Instinct GPUs and Ryzen AI NPU](https://www.amd.com/en/graphics/instinct-server-accelerators) | `pip install --upgrade-strategy eager optimum[amd]` |
28+
| [NVIDIA TensorRT-LLM](https://huggingface.co/docs/optimum/main/en/nvidia_overview) | `docker run -it --gpus all --ipc host huggingface/optimum-nvidia` |
29+
| [AMD Instinct GPUs and Ryzen AI NPU](https://www.amd.com/en/graphics/instinct-server-accelerators) | `pip install --upgrade-strategy eager optimum[amd]` |
30+
| [AWS Trainum & Inferentia](https://huggingface.co/docs/optimum-neuron/index) | `pip install --upgrade-strategy eager optimum[neuronx]` |
2931
| [Habana Gaudi Processor (HPU)](https://habana.ai/training/) | `pip install --upgrade-strategy eager optimum[habana]` |
3032
| [FuriosaAI](https://www.furiosa.ai/) | `pip install --upgrade-strategy eager optimum[furiosa]` |
3133

0 commit comments

Comments
 (0)