> For the complete documentation index, see [llms.txt](https://nx.docs.scailable.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://nx.docs.scailable.net/ai-manager-v6.1.4/ai-manager-plugin/configure-the-plugin/runtime-selection.md).

# Runtime selection

## Detect Available Runtimes

When the plugin first starts, it auto-detects the available runtimes for the server. This takes a moment; the Integrations tab shows its progress.

<figure><img src="/files/hqw7SdVCMvPGiRUto6a9" alt="AI Manager panel showing the plugin detecting available AI accelerators on the device, with a prompt to wait and click Refresh"><figcaption><p>Detecting the available AI accelerators on the device</p></figcaption></figure>

If an accelerator is found, the plugin then installs the matching acceleration library before it can offer that runtime as an option.

<figure><img src="/files/X0v56fNMxkcIeDLLMa2w" alt="AI Manager panel showing the plugin installing the acceleration library, with a prompt to wait and click Refresh"><figcaption><p>Installing the acceleration library for the detected accelerator</p></figcaption></figure>

Click **Refresh** once these messages have had time to resolve.

## Choose a Runtime

After detection completes, if more than one AI-capable device was found, a list of the available runtimes to choose from is shown:

<figure><img src="/files/oNL538x45G41CN5G4bG6" alt="AI Manager panel prompting to select a runtime, with Generic CPU and Intel buttons after multiple AI-capable devices were detected"><figcaption><p>Runtime selection: choose the acceleration library for your hardware</p></figcaption></figure>

The default "Generic CPU" runtime is usually available; depending on the hardware platform or installed [AI Accelerators](/ai-manager-v6.1.4/ai-accelerators-support/supported-ai-accelerators.md), other options also appear. Currently Intel OpenVino, NVIDIA, Hailo, MemryX and more are available. A runtime that still needs its acceleration library installed shows a tooltip saying so:

<figure><img src="/files/19qY4Z1yZ3a9CpQzIBka" alt="Runtime selection buttons with a tooltip on the Intel button reading Install this acceleration library on your server"><figcaption><p>Selecting a runtime installs its acceleration library if needed</p></figcaption></figure>

## Cloud-Managed Devices: Waiting for Device Parameters

For a device using a pipeline managed via the AI Manager Cloud, the plugin may first need to fetch that device's parameters from the cloud before a runtime can be selected:

<figure><img src="/files/zzTbi7sRESVcuDpL3K26" alt="AI Manager panel waiting for the device&#x27;s parameters from the cloud, with a link to the Intel accelerator support documentation"><figcaption><p>Waiting for the device's parameters from the cloud</p></figcaption></figure>

This panel links to the accelerator-specific setup documentation relevant to the detected hardware (in this example, [Intel Support](/ai-manager-v6.1.4/ai-accelerators-support/intel-support.md)). Click **Refresh** once the device's parameters are available:

<figure><img src="/files/0H4peq4LBYHGe3A5JuZK" alt="AI Manager panel still waiting for device parameters, with the cursor over the Refresh button"><figcaption><p>Click Refresh once the device's parameters have loaded</p></figcaption></figure>

Once a runtime is active, the **Device Overview** reports it directly:

<figure><img src="/files/E0D2vYTXDUh90nBGsSaS" alt="AI Manager panel with Device Active on, AI Pipeline set to Demo Object Detection Model, and Device Overview reporting the active Intel runtime"><figcaption><p>Device Overview reporting the active Intel runtime</p></figcaption></figure>