Supported AI accelerators

The Nx AI Manager has integrated several runtimes allowing to benefit from hardware acceleration to run the deployed models across different AI Accelerators.

The following table contains a compiled list of supported AI Accelerators and the required software configuration:

AI Accelerator
Support Level
CPU Architecture
Operating System
API/driver version

CPU

Full support

aarch64, x86_64

Ubuntu 20+ and Windows

-

Intel CPU/GPU/NPU

Full support

x86_64

Ubuntu 20+ and Windows

-

NVIDIA dGPU

Full support

x86_64

Ubuntu 20+ and Windows

CUDA 11, CUDA 12, CUDA 13

NVIDIA Jetson

Full support

aarch64

Ubuntu 20+

JetPack 5, JetPack 6, JetPack 7

DEEPX DX-M1

Full support

aarch64, x86_64

Ubuntu 20+

DXRT v3.0.0

DEEPX DX-H1

Full support

aarch64, x86_64

Ubuntu 20+

DXRT v3.0.0

Hailo-8

Experimental

x86_64, aarch64

Ubuntu 20+

4.18.0, 4.19.0, 4.20.0

Hailo-8L

Experimental

x86_64, aarch64

Ubuntu 20+

4.18.0, 4.19.0, 4.20.0

EdgeCortix SAKURA-II

Coming Soon

x86_64

Ubuntu

TBD

Axelera Metis

Coming Soon

x86_64

Ubuntu

TBD

MemryX MX3

Coming Soon

x86_64

Ubuntu

TBD

Last updated