This documentation is for the upcoming version of the AI Manager
Read the documentation for the current version
Ctrlk
AI ManagerNx Meta
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Runtime selection

Detect and select the AI Manager runtime used for inference on a device.

Detect Available Runtimes

When the plugin first starts, the AI Manager plugin auto-detects the available runtimes for the server.

Plugin settings showing the acceleration library installation progress with a prompt to wait and click Refresh
Detecting the available acceleration libraries

After detection completes, a list of the available runtimes to choose from is usually shown

Plugin settings showing Multiple AI-capable devices detected with Generic CPU and Intel runtime options
Runtime selection - choose the acceleration library for your hardware

The default "Generic CPU" runtime is usually available; depending on the hardware platform or installed AI Accelerators, other options also appear. Currently Intel OpenVino, NVIDIA, Hailo, MemryX and more are available.

PreviousModel pipelines on multiple devicesNextInput masks and ROI

Last updated