Accessing Cloud Data
Also available as:
PDF
loading table of contents...

Create the S3Guard Table in DynamoDB

Unless the property fs.s3a.bucket.test.s3guard.ddb.table.create is set to enable the table to be automatically created, the table must be created on the command line using the hadoop s3guard init command:

hadoop s3guard init s3a://guarded-table/

2018-05-31 15:25:59,070 [main] INFO  s3guard.DynamoDBMetadataStore (DynamoDBMetadataStore.java:createTable(1025)) -
            Creating non-existent DynamoDB table guarded-table in region eu-west-1
2018-05-31 15:26:11,759 [main] INFO  s3guard.S3GuardTool (S3GuardTool.java:initMetadataStore(270)) -
            Metadata store DynamoDBMetadataStore{region=eu-west-1, tableName=guarded-table} is initialized.
Metadata Store Diagnostics:
ARN=arn:aws:dynamodb:eu-west-1:980678866538:table/guarded-table
description=S3Guard metadata store in DynamoDB
name=guarded-table
read-capacity=500
region=eu-west-1
retryPolicy=ExponentialBackoffRetry(maxRetries=9, sleepTime=100 MILLISECONDS)
size=0
status=ACTIVE
table={AttributeDefinitions: [{AttributeName: child,AttributeType: S}, {AttributeName: parent,AttributeType: S}],
    TableName: guarded-table,
    KeySchema: [{AttributeName: parent,KeyType: HASH}, {AttributeName: child,KeyType: RANGE}],
    TableStatus: ACTIVE,
    CreationDateTime: Thu May 31 15:25:59 BST 2018,
    ProvisionedThroughput: {NumberOfDecreasesToday: 0,ReadCapacityUnits: 500,WriteCapacityUnits: 100},
    TableSizeBytes: 0,
    ItemCount: 0,
    TableArn: arn:aws:dynamodb:eu-west-1:980678866538:table/guarded-table,
    TableId: fb50922a-90bf-4df2-a3c3-9f4aa6914d56,}
write-capacity=100     

Once created, the table may be used immediately.