Test access to ADLS Gen1
To test access to ADLS Gen1, SSH to a cluster node and run a few hadoop fs shell commands against your existing storage account.
To test access, SSH to any cluster node and switch to the hdfs user by using
ADLS access path syntax is:
For example, the following Hadoop FileSystem shell commands demonstrate access to a storage account named “myaccount”:
hadoop fs -mkdir adl://myaccount.azuredatalakestore.net/testdir hadoop fs -put testfile adl://myaccount.azuredatalakestore.net/testdir/testfile
To use DistCp against ADLS Gen1, use the following syntax:
hadoop distcp [-D hadoop.security.credential.provider.path=localjceks://file/home/user/adls.jceks] hdfs://namenode_hostname:9001/user/foo/007020615 adl://myaccount.azuredatalakestore.net/testDir/
For more information about configuring the adl connector and working with data stored in ADLS Gen1, refer to Cloud Data Access HDP documentation.