Cloud Data Access
Also available as:
PDF
loading table of contents...

Additional Configuration Options for GCS

You may optionally set the following properties related to Google Cloud Storage:

Table 6.2. Optional Properties Related to Google Cloud Storage

PropertyDescription
fs.gs.project.id

Allows you to enter Google Cloud’s Project ID with access to configured GCS buckets.

By default, this option is unset.

fs.gs.block.sizeThis does not have any effect on storage but allows you to change the way split sizes are computed. We recommend that you set this to the HDFS block size on the cluster or to 128MB. The value should be in bytes.