Deploying a Model as an Edge Service

After the model is prepared, you can deploy it as an edge service. The Service Deployment > Edge Services page lists all edge services. You can enter a service name in the search box in the upper right corner and click image1 to query the service. Edge services depend on Intelligent EdgeFabric (IEF). Before deploying an edge service, create an edge node on IEF.

Prerequisites

  • Data has been prepared. Specifically, you have created a model in the Normal state in ModelArts.

  • An edge node has been created on IEF. If you have not created an edge node, see Creating an Edge Node. If you have not created an edge node, create one by referring to the Edge Platform User Guide..

Background

  • A maximum of 1,000 edge services can be deployed.

Deploying a Model as an Edge Service

  1. Log in to the ModelArts management console. In the left navigation pane, choose Service Deployment > Edge Services. By default, the system switches to the Edge Services page.

  2. In the edge service list, click Deploy in the upper left corner. The Deploy page is displayed.

  3. Set parameters for an edge service.

    1. Set the basic information, including Name and Description. The name is generated by default, for example, service-bc0d. You can specify Name and Description according to actual requirements.

    2. Set other parameters, including the resource pool and model configurations. For details, see Table 1.

      Table 1 Parameters

      Parameter

      Description

      Model and Configuration

      Select the model and version that are in the Normal state.

      Specifications

      Select available specifications based on the list displayed on the console. The specifications in gray cannot be used at the current site.

      Environment Variable

      Set environment variables and inject them to the container instance. To ensure data security, do not enter sensitive information, such as plaintext passwords, in environment variables.

      Deployment Method

      Select Node or Node Group.

      • If you create an edge node on IEF, select Node.

      • If you create a platinum instance and an edge node group on IEF, select a node group. You need to specify the number of platinum resource instances and the number of instances to be deployed.

      Edge Node

      Edge nodes are your edge computing devices used to run edge applications, process your data, and collaborate with cloud applications securely and conveniently.

      Click Add. In the Add Node dialog box that is displayed, select an edge node. Select a created node and click OK.

  4. After setting the parameters, deploy the model as an edge service as prompted. Generally, service deployment jobs run for a period of time, which may be several minutes or tens of minutes depending on the amount of your selected data and resources.

    You can go to the edge service list to view the basic information about the edge service. In the edge service list, after the status of the newly deployed service changes from Deploying to Running, the service is deployed successfully.