ALM-45616 CDL Job Execution Exception

Description

The system checks whether a CDL job is normal every 60 seconds. This alarm is reported when the CDL job is abnormal. This alarm is cleared when the job is restored or stopped.

Attribute

Alarm ID

Alarm Severity

Auto Clear

45616

Major

Yes

Parameters

Name

Meaning

Source

Specifies the cluster for which the alarm is generated.

ServiceName

Specifies the service for which the alarm is generated.

JobName

Specifies the job for which the alarm is generated.

Username

Specifies the username of the job for which the alarm is generated.

Impact on the System

This alarm has no impact on the system.

Possible Causes

The CDL task fails to be executed due to incorrect parameter settings or other reasons. On the Job Management page of the CDL web UI, locate the row where the job is located and click Failed/Abnormal running in the Status column to view the failure cause, or view the failure cause in the logs.

Procedure

  1. Log in to FusionInsight Manager as a user who has the CDL job creation or administrator permission.

  2. Choose O&M. In the navigation pane on the left, choose Alarm > Alarms, click image1 in the row where Alarm ID is 45616, and view the name of the job for which this alarm is generated in Location.

  3. Choose Cluster > Services > CDL and click the link next to CDLService UI to go to the CDL web UI.

  4. Locate the row where the failed job is located based on the job name obtained in 2, and click Abnormal running or Failed in the Status column.

    image2

  5. On the page that is displayed, view the error information and rectify the fault. For example, Figure 1 shows that the task running on Yarn is manually killed. For details, see trace error information, as shown in Figure 2.

    **Figure 1** CDL job exception

    Figure 1 CDL job exception

    **Figure 2** Trace error information

    Figure 2 Trace error information

  6. Rectify the fault based on the error information, execute the task again, and check whether the task can be executed successfully.

    • If yes, no further action is required.

    • If no, go to 7.

Collect the fault information.

  1. On FusionInsight Manager, choose O&M. In the navigation pane on the left, choose Log > Download.

  2. Select CDL in the required cluster for Service.

  3. Click image3 in the upper right corner, and set Start Date and End Date for log collection to 30 minutes ahead of and after the alarm generation time respectively. Then, click Download.

  4. Contact O&M personnel and provide the collected logs.

Alarm Clearing

After the job is successfully restored or stopped, the alarm is cleared if it has been reported.