Model pipeline selection and configuration

Add, chain, and configure model pipelines on a device.

The device detail page is the central place to manage the model pipelines that the device should run. Pipelines are chains of one or more models that can run with the given video input from the device. The plugin usually configures a default pipeline after it is enabled for the device.

Custom pipeline

When using a custom pipeline managed via the AI Manager Cloud, a Manage Device button is shown instead. Clicking it opens the AI Manager device panel to manage the model pipeline.

Manage Device button: available when using a custom cloud pipeline

Add a New Pipeline

Add a new pipeline by clicking the "Add A New Pipeline". When no pipelines are set, the only available option is to add a new pipeline:

A device detail page without any pipelines

Clicking the "Add A New Pipeline" button redirects you to the model catalogue.

Selecting a Model

In the model catalogue, select a model to use in the new (or current) pipeline.

The top of the page will show a message that you are "Assigning a model to...".

If you have uploaded custom models, these will also be available in the catalogue.

The model catalogue - select a model to add to the pipeline

The model visibility is context sensitive. When you are browsing models you can see all models that are available to all organizations that you are a member of. If you are assigning a model to a device, only the models that are available for the organization that the device belongs to are visible.

Selecting a model assigns and downloads it to the server for the current device.

The selected model is being deployed to the server

The device details page reopens, showing the newly assigned model.

The device detail page with a single pipeline containing one model

Add a Chained Model

Chained models are models that use the input of a parent model instead of processing the video from the device directly.

Click Add Chained Model next to the parent model name to add a chained model. The model catalogue opens for selecting the chained model.

Model pipeline - click Add Chained Model to chain a model

The way a chained model will use the input can be chosen by setting a chaining method, currently there are three modes and not all of them may be available at the same time:

• Direct - the chained model gets the output from the parent model as input

• Conditional - the chained model will only run if a field with a given name outputs "true". This is only available if the model itself returns a boolean value.

• Feature extraction - the chained model will get the contents of the bounding boxes that have a certain label. This is only available if the model returns one or more named classes.

A model pipeline with chaining options and feature extraction class selection

Choose the appropriate method. After entering new data, the pipeline form indicates that settings need to be saved.

A model pipeline with changes that need to be saved

Clicking Save Pipelines applies the settings to the device. Unsaved changes linger for an hour unless saved or canceled.

Change a Model in a Pipeline

Click Switch next to the model title to replace a parent or chained model. This opens the normal model selection process for choosing a replacement.

The rest of the settings in the model pipeline are not affected, unless they are directly related to the model.

Remove a Chained Model from a Pipeline

Click Remove next to a chained model to remove it from the pipeline immediately.

This action cannot be undone. To restore the setup, select the same model again and reconfigure the same chaining options and pre- and post-processing.

Remove a Pipeline

Click Remove next to a parent model in a pipeline to remove the full pipeline, including all associated settings and chained models.

This action cannot be undone. To restore the settings, rebuild the same model pipeline completely.