For the complete documentation index, see llms.txt. This page is also available as Markdown.

Runtime selection

Detect and select the AI Manager runtime used for inference on a device.

Detect Available Runtimes

When the plugin first starts, the AI Manager plugin auto-detects the available runtimes for the server.

Plugin settings showing the acceleration library installation progress with a prompt to wait and click Refresh
Detecting the available acceleration libraries

After detection completes, a list of the available runtimes to choose from is usually shown

Plugin settings showing Multiple AI-capable devices detected with Generic CPU and Intel runtime options
Runtime selection - choose the acceleration library for your hardware

The default "Generic CPU" runtime is usually available; depending on the hardware platform or installed AI Accelerators, other options also appear. Currently Intel OpenVino, NVIDIA, Hailo, MemryX and more are available.

Last updated