2. Set Directories and Permissions

Create directories and configure ownership + permissions on the appropriate hosts as described below.

If any of these directories already exist, we recommend deleting and recreating them. Use the following instructions to set up Pig configuration files :

  1. We strongly suggest that you edit and source the files included in scripts.zip file (downloaded in  Download Companion Files).

    Alternatively, you can also copy the contents to your ~/.bash_profile) to set up these environment variables in your environment.

  2. Execute the following commands on all the hosts where Pig programs will be executed:

    mkdir -p $PIG_LOG_DIR
    chown -R $PIG_USER:$HADOOP_GROUP $PIG_LOG_DIR
    chmod 755 -R $PIG_LOG_DIR

    where:

    • $PIG_LOG_DIR is the directory to store the Pig logs. For example, /var/log/pig.

    • $PIG_USER is the user owning the Pig services. For example, pig.

    • $HADOOP_GROUP is a common group shared by services. For example, hadoop.


loading table of contents...