DLM Installation
Also available as:
PDF

Configure DLM Engine on existing Ambari-managed clusters

After the DLM Engine is installed on the Ambari host, you must properly configure it. You can configure the engine on existing clusters or when configuring newly created clusters. If configuring on new clusters, see the instructions for configuring DLM Engine on new clusters.

  • You must have root access to the Ambari Server host node to perform this task.
  • When you install DLM Engine in an existing cluster, a restart is required to get Ambari to create the service users.
  • This task must be completed on all clusters to be used with DLM.
  • “Beacon” is the internal name for the DLM Engine. If you install DLM, you will see the name Beacon in some paths, commands, etc.
  1. Launch Ambari in a browser and log in.
    http://<ambari-server-host>:8080
    Default credentials are:
    • Username: admin
    • Password: admin
  2. Click Admin>Manage Ambari.

  3. Click Versions, and then do the following on the Versions page:
    1. Click the HDP version in the Name column.
    2. Change the Base URL path for the DLM service to point to the local repository, for example:
      http://webserver.com/DLM/centos7/1.1.0.0
    URLs shown are for example purposes only. Actual URLs might be different.
  4. Click the Ambari logo to return to the main Ambari page.
  5. In the Ambari Services navigation pane, click Actions>Add Service.

    The Add Service Wizard displays.
  6. On the Choose Services page of the Wizard, select the DPS service to install in Ambari, and then follow the on-screen instructions.
    Other required services are automatically selected.
  7. When prompted to confirm addition of dependent services, give a positive confirmation to all.
    This adds other required services.
  8. On the Assign Masters page, you can choose the default settings.
  9. On the Customize Services page, fill out all the required username and password fields that are highlighted.
    You can set credentials to whatever you want.
  10. If doing Hive replication with DLM, navigate to Customize Services and enable Hive replication.
    1. Click Hive in the list of services.
    2. On the Settings tab, move the toggle to *off* for "Run as end user instead of Hive user".
    3. Click the Advanced tab and scroll to the Custom hive-site section.
    4. Verify that these properties have the following values, or set the properties as shown:
      hive.metastore.dml.events=true
      hive.metastore.transactional.event.listeners=org.apache.hive.hcatalog. \
      listener.DbNotificationListener
      hive.repl.cm.enabled=true
      hive.repl.cmrootdir=/apps/hive/cmroot
      hive.repl.rootdir=/apps/hive/repl
      
    5. Click HDFS in the list of services.
    6. Scroll to the Custom core-site section and modify the following parameter:
      hadoop.proxyuser.hive.hosts=*
  11. Complete the remaining installation wizard steps and exit the wizard.
  12. Ensure that all components required for the DLM Service have started successfully.
    See the DLM Support Matrix for information about required Apache components.
  13. Repeat this procedure on the Ambari hosts on all remaining clusters on which you install the DLM agent.