INDCONN Macro Variable

The INDCONN macro variable is used to provide credentials to connect to the Hadoop HDFS and MapReduce JobTracker. You must assign the INDCONN macro variable before you run the %INDHD_PUBLISH_MODEL and the %INDHD_RUN_MODEL macros.
Note: The INDCONN macro variable can be set once and used for both macros.
  • When you assign the INDCONN macro variable before you run the %INDHD_PUBLISH_MODEL macro, specify the server and port in order to access the machine on which you have installed the Hadoop HDFS. The user ID and password are optional. Here is the syntax.
    HDFS_SERVER=hdfs-server-name HDFS_PORT=hdfs-port-number
    <USER=user> <PASSWORD=password><HADOOP_CFG=configuration-file>
  • When you assign the INDCONN macro variable before you run the %INDHD_RUN_MODEL macro, specify either the Hadoop configuration file or the HDFS and MapReduce server and the HDFS and MapReduce port in order to access the machine on which you have installed the MapReduce JobTracker. The user ID and password are optional. The INDCONN macro variable for the %INDHD_RUN_MODEL macro has one of these formats:
    HDFS_SERVER=hdfs-server-name HDFS_PORT=hdfs-port-number
    MAPRED_SERVER=mapred-server-name MAPRED_PORT=mapred-port-number
    <USER=user > <PASSWORD=password> <HADOOP_CFG=configuration-file>

    HADOOP_CFG=configuration-file <USER=user > <PASSWORD=password>
Arguments

HDFS_SERVER=hdfs-server-name

specifies the HDFS server name or the IP address of the server host.

Restriction This argument is for use with the Cloudera 4.x and Hortonworks 1.3.x distributions. If you have Cloudera 5.x or Hortonworks 2.x, you must use the HADOOP_CFG argument.
Interaction It is recommended that you use the HADOOP_CFG argument instead of the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments. The configuration file that you specify with the HADOOP_CFG argument overrides what you specify in the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments.
See HADOOP_CFG=configuration-file

HDFS_PORT=hdfs-port-number

specifies the HDFS name node process port number.

Restriction This argument is for use with the Cloudera 4.x and Hortonworks 1.3.x distributions. If you have Cloudera 5.x or Hortonworks 2.x, you must use the HADOOP_CFG argument.
Interaction It is recommended that you use the HADOOP_CFG argument instead of the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments. The configuration file that you specify with the HADOOP_CFG argument overrides what you specify in the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments.
See HADOOP_CFG=configuration-file

MAPRED_SERVER=mapred-server-name

specifies the MapReduce JobTracker server name or the IP address of the server.

Restriction This argument is for use with the Cloudera 4.x and Hortonworks 1.3.x distributions. If you have Cloudera 5.x or Hortonworks 2.x, you must use the HADOOP_CFG argument.
Interaction It is recommended that you use the HADOOP_CFG argument instead of the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments. The configuration file that you specify with the HADOOP_CFG argument overrides what you specify in the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments.
Note This argument is required only when you run the %INDHD_RUN_MODEL macro.
See HADOOP_CFG=configuration-file

MAPRED_PORT=mapred-port-number

specifies the MapReduce JobTracker port number.

Restriction This argument is for use with the Cloudera 4.x and Hortonworks 1.3.x distributions. If you have Cloudera 5.x or Hortonworks 2.x, you must use the HADOOP_CFG argument.
Interaction It is recommended that you use the HADOOP_CFG argument instead of the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments. The configuration file that you specify with the HADOOP_CFG argument overrides what you specify in the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments.
Note This argument is required only when you run the %INDHD_RUN_MODEL macro.
See HADOOP_CFG=configuration-file

USER=username

specifies the Hadoop user name (also called the user ID) that is used to connect to the HDFS.

PASSWORD=password

specifies the password that is associated with your Hadoop user ID.

Tip Use only PASSWORD=, PASS=, or PW= for the password argument. PWD= is not supported and causes an error.

HADOOP_CFG=configuration-file

specifies the location of the Hadoop configuration file that is used with the %INDHD_PUBLISH_MODEL and the %INDHD_RUN_MODEL macros.

Restriction If you have Cloudera 5.x or Hortonworks 2.x, you must use the HADOOP_CFG argument. You cannot use the HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments with Cloudera 5.x or Hortonworks 2.x.
Interaction The configuration file that you specify with the HADOOP_CFG= argument overrides what you specify in the INDCONN HDFS_SERVER, HDFS_PORT, MAPRED_SERVER, and MAPRED_PORT arguments.
Note This argument is required only when you run the %INDHD_RUN_MODEL macro on a YARN/MapReduce 2 Hadoop cluster.
See HDFS_SERVER=hdfs-server-name
HDFS_PORT=hdfs-port-number
MAPRED_SERVER=mapred-server-name
MAPRED_PORT=mapred-port-number