Uploaded image for project: 'Apache HAWQ (Retired)'
  1. Apache HAWQ (Retired)
  2. HAWQ-137

Update hdfs-client.xml and yarn-client.xml

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0.0-incubating
    • libhdfs, libyarn
    • None

    Description

      1. On linux. The following parameters should be set both in hdfs-site.xml and hdfs-client.xml.

      <property>
      <name>dfs.client.read.shortcircuit</name>
      <value>true</value>
      <description>
      This configuration parameter turns on short-circuit local reads.
      </description>
      </property>

      <property>
      <name>dfs.domain.socket.path</name>
      <value>/var/lib/hadoop-hdfs/hdfs_domain</value>
      <description>
      Optional. This is a path to a UNIX domain socket that will be used for
      communication between the DataNode and local HDFS clients.
      If the string "_PORT" is present in this path, it will be replaced by the
      TCP port of the DataNode.
      </description>
      </property>

      <property>
      <name>dfs.client.use.legacy.blockreader.local</name>
      <value>false</value>
      <description>
      Legacy short-circuit reader implementation based on HDFS-2246 is used
      if this configuration parameter is true.
      This is for the platforms other than Linux
      where the new implementation based on HDFS-347 is not available.
      </description>
      </property>

      2. Minor changes to yarn-client.xml for default port number.

      Attachments

        Activity

          People

            rlei Radar Da Lei
            rlei Radar Da Lei
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: