DLM Administration
Also available as:
PDF
loading table of contents...

Target cluster setup for Amazon S3

The target cluster for hive cloud replication should be setup on AWS instances with Hive warehouse directory on cloud AWS S3.

The target cluster is data lake cluster with metadata services such as HMS, Ranger, Atlas, and DLM engine. The following configurations are required in this target cluster:

hive.metastore.dml.events=false
hive.repl.cm.enabled=false
hive.warehouse.subdir.inherit.perms=false
hive.repl.replica.functions.root.dir=s3a://<bucket_name>/<replfunctions_path>
hive.metastore.warehouse.dir=s3a://<bucket_name>/<warehouse_path>

The cluster should have additional Amazon S3 credential configurations for access to Amazon S3 storage buckets. For more information, see https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_cloud-data-access/content/authentication-s3.html.