Deployment and device management

How do we use the platform for model deployment.

The Nx AI Cloud platform allows you to (mass) deploy model pipelines to target devices. Effectively, you can "swap" the model pipelines that run on a device (configured using the Nx AI Manager) remotely and change the device configuration. The former you can do at a large scale, you can clone model pipelines to all the devices in a site.

An overview of your sites and devices

The Sites tab on the Nx AI Cloud platform shows all sites available to your cloud account.

If the site is on-line the system shows up with a green icon and the "Devices" button is available.

overview of sites with one on-line system

If the site is off-line you cannot continue until the system comes on-line.

listing of one site that is off-line

Overview of a single site

If you select an on-line site you are directed to the site devices page.

overview of a single on-line system

The page lists all the devices and their groups as well as the currently configured pipelines. A separate page shows all the servers.

The same page when a site is off-line does not show devices, details and servers. You cannot do anything on that site now.

overview of a single off-line system

AI model pipeline deployment and management

You can assign or replace a model pipeline on a single device or you can select a pipeline from a device and clone it to all the selected devices.

Assign or replace a model pipeline on a single device

To assign or replace a model on a single device you need to click on the 'Pipelines' button on the system or devices page. You will be directed to the device page.

Overview of a single device in the system

To assign an additional model pipeline to the device you can press 'Add a new pipeline' or the 'add' button. To replace a model pipeline press the button with the left-right arrow in it.

You will be directed to the 'Models listing'.

On the top you get a new notification bar that shows you are currently in assigning mode. You can use that to go back to the models listing page, back to the device or cancel the whole assignment process.

Once you have found the model you want to assign or replace use the button 'Add to [x] pipeline'.

models listing

Now, the model pipeline will be deployed and if all is well you will see the following notice and after that you are redirected back to the device page.

Clone a model pipeline to all the selected devices

To start you need to be on a devices page, which shows you all devices in the site or all devices connected to a server.

From here you can start by clicking the "Clone this pipeline" button next to the device information for a single device.

Once pressed, a new column with checkboxes will be visible for the available devices and you can use them to select the devices you want to assign a new model pipeline to. Devices that are not available will not get a checkbox to select.

multiple server selection activated

If you select one or more servers the 'Apply this pipeline' button will activate. Pressing this button will start the model assignment just like updating a model for a single device.

Note: assigning a model pipeline to multiple devices will always remove all other pipelines and replace them with the new pipeline you selected.