Supported AI accelerators

The AI Manager has integrated several runtimes allowing to benefit from hardware acceleration to run the deployed models across different AI Accelerators.

The following tables contain a compiled list of supported AI Accelerators, their support level and the required software configuration:

Fully supported

Support Level	AI Accelerator	CPU Architecture	API/driver version	Operating System
Full support	CPU	aarch64, x86_64	-	Ubuntu 20+ and Windows
Full support	Intel CPU	x86_64	OpenVino	Ubuntu 22+ and Windows
Full support	NVIDIA dGPU	x86_64	CUDA 11, CUDA 12, CUDA 13	Ubuntu 20+ and Windows
Full support	NVIDIA dGPU	aarch64	CUDA 13	Ubuntu 24.04
Full support	NVIDIA Jetson	aarch64	JetPack 5, JetPack 6, JetPack 7	Ubuntu 20+

Experimental

Support Level	AI Accelerator	CPU Architecture	API/driver version	Operating System
Experimental	Intel GPU/NPU	x86_64	OpenVino	Ubuntu 22+ and Windows
Experimental	DEEPX DX-M1	aarch64, x86_64	DXRT v3.0.0 DXRT v3.1.0	Ubuntu 20+
Experimental	DEEPX DX-H1	aarch64, x86_64	DXRT v3.0.0 DXRT v3.1.0	Ubuntu 20+
Experimental	Hailo-8	x86_64, aarch64	4.18.0, 4.19.0, 4.20.0	Ubuntu 20+
Experimental	Hailo-8L	x86_64, aarch64	4.18.0, 4.19.0, 4.20.0	Ubuntu 20+
Experimental	EdgeCortix SAKURA-II	x86_64	MERA 2.5	Ubuntu 22.04
Experimental	MemryX MX3	x86_64	Driver 2.1.0	Ubuntu 22.04

In the works

Support Level	AI Accelerator	CPU Architecture	API/driver version	Operating System
Coming Soon	Axelera Metis	x86_64	TBD	Ubuntu
Coming Soon	SiMA	x86_64	TBD	Ubuntu