section> Computing
  • Auto Scaling
  • Bare Metal Server
  • Dedicated Host
  • Elastic Cloud Server
  • FunctionGraph
  • Image Management Service
Network
  • Direct Connect
  • Domain Name Service
  • Elastic IP
  • Elastic Load Balancing
  • Enterprise Router
  • NAT Gateway
  • Private Link Access Service
  • Secure Mail Gateway
  • Virtual Private Cloud
  • Virtual Private Network
  • VPC Endpoint
Storage
  • Cloud Backup and Recovery
  • Cloud Server Backup Service
  • Elastic Volume Service
  • Object Storage Service
  • Scalable File Service
  • Storage Disaster Recovery Service
  • Volume Backup Service
Application
  • API Gateway (APIG)
  • Application Operations Management
  • Application Performance Management
  • Distributed Message Service (for Kafka)
  • Simple Message Notification
Data Analysis
  • Cloud Search Service
  • Data Lake Insight
  • Data Warehouse Service
  • DataArts Studio
  • MapReduce Service
  • ModelArts
  • Optical Character Recognition
Container
  • Application Service Mesh
  • Cloud Container Engine
  • Cloud Container Instance
  • Software Repository for Containers
Databases
  • Data Replication Service
  • Distributed Cache Service
  • Distributed Database Middleware
  • Document Database Service
  • GeminiDB
  • Relational Database Service
  • TaurusDB
Management & Deployment
  • Cloud Create
  • Cloud Eye
  • Cloud Trace Service
  • Config
  • Log Tank Service
  • Resource Formation Service
  • Tag Management Service
Security Services
  • Anti-DDoS
  • Cloud Firewall
  • Database Security Service
  • Dedicated Web Application Firewall
  • Host Security Service
  • Identity and Access Management
  • Key Management Service
  • Web Application Firewall
Other
  • Enterprise Dashboard
  • Marketplace
  • Price Calculator
  • Status Dashboard
APIs
  • REST API
  • API Usage Guidelines
  • Endpoints
Development and Automation
  • SDKs
  • Drivers and Tools
  • Terraform
  • Ansible
  • Cloud Create
Architecture Center
  • Best Practices
  • Blueprints
IaaSComputingAuto ScalingBare Metal ServerDedicated HostElastic Cloud ServerFunctionGraphImage Management ServiceNetworkDirect ConnectDomain Name ServiceElastic IPElastic Load BalancingEnterprise RouterNAT GatewayPrivate Link Access ServiceSecure Mail GatewayVirtual Private CloudVirtual Private NetworkVPC EndpointStorageCloud Backup and RecoveryCloud Server Backup ServiceElastic Volume ServiceObject Storage ServiceScalable File ServiceStorage Disaster Recovery ServiceVolume Backup ServicePaaSApplicationAPI Gateway (APIG)Application Operations ManagementApplication Performance ManagementDistributed Message Service (for Kafka)Simple Message NotificationData AnalysisCloud Search ServiceData Lake InsightData Warehouse ServiceDataArts StudioMapReduce ServiceModelArtsOptical Character RecognitionContainerApplication Service MeshCloud Container EngineCloud Container InstanceSoftware Repository for ContainersDatabasesData Replication ServiceDistributed Cache ServiceDistributed Database MiddlewareDocument Database ServiceGeminiDBRelational Database ServiceTaurusDBManagementManagement & DeploymentCloud CreateCloud EyeCloud Trace ServiceConfigLog Tank ServiceResource Formation ServiceTag Management ServiceSecuritySecurity ServicesAnti-DDoSCloud FirewallDatabase Security ServiceDedicated Web Application FirewallHost Security ServiceIdentity and Access ManagementKey Management ServiceWeb Application FirewallOtherOtherEnterprise DashboardMarketplacePrice CalculatorStatus Dashboard

MapReduce Service

  • Using Alluxio
  • Using CarbonData (for Versions Earlier Than MRS 3.x)
  • Using CarbonData (for MRS 3.x or Later)
  • Using ClickHouse
  • Using DBService
  • Using Flink
  • Using Flume
  • Using HBase
  • Using HDFS
    • Configuring Memory Management
    • Creating an HDFS Role
    • Using the HDFS Client
    • Running the DistCp Command
    • Overview of HDFS File System Directories
    • Changing the DataNode Storage Directory
    • Configuring HDFS Directory Permission
    • Configuring NFS
    • Planning HDFS Capacity
    • Configuring ulimit for HBase and HDFS
    • Balancing DataNode Capacity
    • Configuring Replica Replacement Policy for Heterogeneous Capacity Among DataNodes
    • Configuring the Number of Files in a Single HDFS Directory
    • Configuring the Recycle Bin Mechanism
    • Setting Permissions on Files and Directories
    • Setting the Maximum Lifetime and Renewal Interval of a Token
    • Configuring the Damaged Disk Volume
    • Configuring Encrypted Channels
    • Reducing the Probability of Abnormal Client Application Operation When the Network Is Not Stable
    • Configuring the NameNode Blacklist
    • Optimizing HDFS NameNode RPC QoS
    • Optimizing HDFS DataNode RPC QoS
    • Configuring Reserved Percentage of Disk Usage on DataNodes
    • Configuring HDFS NodeLabel
    • Using HDFS AZ Mover
    • Configuring the Observer NameNode to Process Read Requests
    • Performing Concurrent Operations on HDFS Files
    • Introduction to HDFS Logs
    • HDFS Performance Tuning
    • FAQ
      • NameNode Startup Is Slow
      • DataNode Is Normal but Cannot Report Data Blocks
      • HDFS WebUI Cannot Properly Update Information About Damaged Data
      • Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?
      • Why Does DataNode Fail to Start When the Number of Disks Specified by dfs.datanode.data.dir Equals dfs.datanode.failed.volumes.tolerated?
      • Failed to Calculate the Capacity of a DataNode when Multiple data.dir Directories Are Configured in a Disk Partition
      • Standby NameNode Fails to Be Restarted When the System Is Powered off During Metadata (Namespace) Storage
      • Why Data in the Buffer Is Lost If a Power Outage Occurs During Storage of Small Files
      • Why Does Array Border-crossing Occur During FileInputFormat Split?
      • Why Is the Storage Type of File Copies DISK When the Tiered Storage Policy Is LAZY_PERSIST?
      • The HDFS Client Is Unresponsive When the NameNode Is Overloaded for a Long Time
      • Can I Delete or Modify the Data Storage Directory in DataNode?
      • Blocks Miss on the NameNode UI After the Successful Rollback
      • Why Is "java.net.SocketException: No buffer space available" Reported When Data Is Written to HDFS
      • Why are There Two Standby NameNodes After the active NameNode Is Restarted?
      • When Does a Balance Process in HDFS, Shut Down and Fail to be Executed Again?
      • "This page can't be displayed" Is Displayed When Internet Explorer Fails to Access the Native HDFS UI
      • NameNode Fails to Be Restarted Due to EditLog Discontinuity
  • Using Hive
  • Using Hudi
  • Using Hue (Versions Earlier Than MRS 3.x)
  • Using Hue (MRS 3.x or Later)
  • Using Kafka
  • Using KafkaManager
  • Using Loader
  • Using MapReduce
  • Using Oozie
  • Using OpenTSDB
  • Using Presto
  • Using Ranger (MRS 1.9.2)
  • Using Ranger (MRS 3.x)
  • Using Spark
  • Using Spark2x
  • Using Sqoop
  • Using Storm
  • Using Tez
  • Using Yarn
  • Using ZooKeeper
  • Appendix
  • Change History
  • Component Operation Guide
  • Using HDFS
  • FAQ

FAQ¶

  • NameNode Startup Is Slow

  • DataNode Is Normal but Cannot Report Data Blocks

  • HDFS WebUI Cannot Properly Update Information About Damaged Data

  • Why Does the Distcp Command Fail in the Secure Cluster, Causing an Exception?

  • Why Does DataNode Fail to Start When the Number of Disks Specified by dfs.datanode.data.dir Equals dfs.datanode.failed.volumes.tolerated?

  • Failed to Calculate the Capacity of a DataNode when Multiple data.dir Directories Are Configured in a Disk Partition

  • Standby NameNode Fails to Be Restarted When the System Is Powered off During Metadata (Namespace) Storage

  • Why Data in the Buffer Is Lost If a Power Outage Occurs During Storage of Small Files

  • Why Does Array Border-crossing Occur During FileInputFormat Split?

  • Why Is the Storage Type of File Copies DISK When the Tiered Storage Policy Is LAZY_PERSIST?

  • The HDFS Client Is Unresponsive When the NameNode Is Overloaded for a Long Time

  • Can I Delete or Modify the Data Storage Directory in DataNode?

  • Blocks Miss on the NameNode UI After the Successful Rollback

  • Why Is "java.net.SocketException: No buffer space available" Reported When Data Is Written to HDFS

  • Why are There Two Standby NameNodes After the active NameNode Is Restarted?

  • When Does a Balance Process in HDFS, Shut Down and Fail to be Executed Again?

  • "This page can't be displayed" Is Displayed When Internet Explorer Fails to Access the Native HDFS UI

  • NameNode Fails to Be Restarted Due to EditLog Discontinuity

  • Prev
  • Next
last updated: 2025-07-09 15:07 UTC - commit: cb943fa3145d5c3e150bb4fa1a987d24c3077fe9
Edit pageReport Documentation Bug
Page Contents
  • FAQ
© T-Systems International GmbH
  • Contact
  • Data privacy
  • Disclaimer of Liabilities
  • Imprint