Each node in your Hadoop cluster, running YARN, has 64GB memory and 24 cores. Your yarn.site.xml has the following configuration:
yarn.nodemanager.resource.memory-mb
32768
yarn.nodemanager.resource.cpu-vcores
12
You want YARN to launch no more than 16 containers per node. What should you do?
Modify yarn-site.xml with the following property:
yarn.scheduler.minimum-allocation-mb
2048
Modify yarn-sites.xml with the following property:
4096
yarn.nodemanager.resource.cpu-vccores
No action is needed: YARN’s dynamic resource allocation automatically optimizes the node memory and cores
Submit