Supported AI accelerators

The Nx AI Manager has integrated several runtimes allowing to benefit from hardware acceleration to run the deployed models.

The following table contains a compiled list of supported runtimes:

AI Accelerator	CPU Architecture	API/driver version
CPU	aarch64, x86_64	-
Intel (OpenVINO)	x86_64	-
Hailo-8	x86_64, aarch64	4.17.0, 4.18.0, 4.19.0, 4.20.0
Hailo-8L	x86_64, aarch64	4.18.0, 4.19.0, 4.20.0
Hailo-15 (coming soon)
MemryX	x86_64	2.2.37
Nvidia CUDA	x86_64	CUDA 11, CUDA 12
Nvidia Jetpack	aarch64	Jetpack 4.6, Jetpack 5.x, Jetpack 6.x
Qualcomm (coming soon)	aarch64	2.20.x
MemryX (coming soon)	aarch64	2.2.37
DeepX (coming soon)	aarch64, x86_64	-