Supported AI accelerators
Last updated
Last updated
The Nx AI Manager has integrated several runtimes allowing to benefit from hardware acceleration to run the deployed models.
The following table contains a compiled list of supported runtimes:
| AI Accelerator | CPU Architecture | API/driver version |
|---|---|---|
CPU
aarch64, x86_64
-
Intel (OpenVINO)
x86_64
-
Hailo-8
x86_64
4.17.0, 4.18.0, 4.19.0
Hailo-8L
aarch64
4.18.0, 4.19.0
MemryX
x86_64
2.2.37
Nvidia CUDA
x86_64
CUDA 11, CUDA 12
Nvidia Jetpack
aarch64
Jetpack 4.6, Jetpack 5.x, Jetpack 6.x
Qualcomm (coming soon)
aarch64
2.20.x
MemryX (coming soon)
aarch64
2.2.37