Supported AI accelerators
The Nx AI Manager has integrated several runtimes allowing to benefit from hardware acceleration to run the deployed models.
The following table contains a compiled list of supported runtimes:
| AI Accelerator | CPU Architecture | API/driver version |
|---|---|---|
CPU | aarch64, x86_64 | - |
Intel (OpenVINO) | x86_64 | - |
Hailo-8 | x86_64 | 4.17.0, 4.18.0 |
MemryX | x86_64 | 2.2.37 |
Nvidia CUDA | x86_64 | CUDA 11, CUDA 12 |
Nvidia Jetpack | aarch64 | Jetpack 4.6, Jetpack 5.0, Jetpack 6.0 |
Qualcomm (coming soon) | aarch64 | 2.20.x |
Hailo-8L (coming soon) | aarch64 | 4.18.0 |
MemryX (coming soon) | aarch64 | 2.2.37 |
Last updated