Managing Data Operating System
Also available as:
PDF
loading table of contents...

Enable the Capacity Scheduler

You must configure the yarn.resourcemanager.scheduler.class property in yarn-site.xml to enable the Capacity Scheduler.

  • To enable the Capacity Scheduler, set the following property in the /etc/hadoop/conf/yarn-site.xml file on the ResourceManager host:
    <property>
     <name>yarn.resourcemanager.scheduler.class</name>
     <value>
     org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
     </value>
    </property>
  • The settings for the Capacity Scheduler are contained in the /etc/hadoop/conf/capacity-scheduler.xml file on the ResourceManager host. The Capacity Scheduler reads this file when starting, and also when an administrator modifies the capacity- scheduler.xml file and then reloads the settings by running the following command:
    yarn rmadmin -refreshQueues
    This command can only be run by cluster administrators. Administrator privileges are configured with the yarn.admin.acl property on the ResourceManager.