Configuring Memory Usage Detection¶
Scenario¶
If memory usage of the submitted application cannot be estimated, you can modify the configuration on the server to determine whether to check the memory usage.
If the memory usage is not checked, the container occupies the memory until the memory overflows. If the memory usage exceeds the configured memory size, the corresponding container is killed.
Configuration Description¶
Go to the All Configurations page of Yarn and enter a parameter name in the search box by referring to Modifying Cluster Service Configuration Parameters.
Parameter | Description | Default Value |
---|---|---|
yarn.nodemanager.vmem-check-enabled | Whether to enable virtual memory usage detection. If the memory used by a task exceeds the allocated memory size, the task is forcibly stopped.
| true |
yarn.nodemanager.pmem-check-enabled | Whether to enable physical memory usage detection. If the memory used by a task exceeds the allocated memory size, the task is forcibly stopped.
| true |