• MapReduce Service

mrs
  1. Help Center
  2. MapReduce Service
  3. User Guide
  4. MRS Manager Operation Guide
  5. Alarm Reference
  6. ALM-14006 Number of HDFS Files Exceeds the Threshold

ALM-14006 Number of HDFS Files Exceeds the Threshold

Description

The system checks the number of HDFS files every 30 seconds and compares it with the threshold. This alarm is generated when the number of HDFS files exceeds the threshold and is cleared when the number is less than or equal to the threshold.

Attribute

Alarm ID

Alarm Severity

Automatically Cleared

14006

Major

Yes

Parameters

Parameter

Description

ServiceName

Specifies the service for which the alarm is generated.

RoleName

Specifies the role for which the alarm is generated.

HostName

Specifies the host for which the alarm is generated.

NSName

Specifies the NameService service for which the alarm is generated.

Trigger Condition

Generates an alarm when the actual indicator value exceeds the specified threshold.

Impact on the System

Disk storage space is insufficient, which may result in data import failure. The performance of the HDFS system is affected.

Possible Causes

The number of HDFS files exceeds the threshold.

Procedure

  1. Check whether unnecessary files exist in the system.

    1. Use the client on the cluster node and run the hdfs dfs -ls file or directory command to check whether the files in the directory can be deleted.
      • If yes, go to 1.b.
      • If no, go to 2.a.
    2. Run the hdfs dfs -rm -r file or directory command. Delete unnecessary files, wait 5 minutes, and check whether the alarm is cleared.
      • If yes, no further action is required.
      • If no, go to 2.a.

  2. Check the number of files in the system.

    1. On the MRS Manager portal, choose System > Configure Alarm Threshold.
    2. In the navigation tree on the left, choose Service > HDFS > HDFS File > Total Number of Files.
    3. In the right pane, modify the threshold in the rule based on the number of current HDFS files.

      To check the number of HDFS files, choose Service > HDFS, click Customize in the Real-Time Statistics area on the right, and select the HDFS File monitoring item.

    4. Wait 5 minutes and check whether the alarm is cleared.
      • If yes, no further action is required.
      • If no, go to Step 3.

  3. Collect fault information.

    1. On MRS Manager, choose System > Export Log.
    2. Contact technical support engineers for help, detail see technical support.

      Telephone:

      Germany: 0800 330 44 44

      International: +800 44556600

Related Information

N/A