Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-13645

HAWQ service requires additional HDFS config properties to be defined

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.1.2
    • Fix Version/s: 2.2.0
    • Component/s: ambari-server
    • Labels:
      None

      Description

      Following are additional properties that need to be added for HAWQ.

      Advanced hdfs-site Properties:
      PROPERTY SETTING
      dfs.allow.truncate true
      dfs.support.append true
      dfs.client.read.shortcircuit true
      dfs.block.local-path-access.user gpadmin
      dfs.datanode.data.dir.perm 750
      dfs.datanode.max.transfer.threads 40960
      dfs.datanode.handler.count 60
      dfs.namenode.accesstime.precision -1

      Advanced core-site Properties:
      PROPERTY SETTING
      ipc.client.connection.maxidletime 3600000
      ipc.client.connect.timeout 300000
      ipc.server.listen.queue.size 3300

      1. AMBARI-13645.addendum.patch
        0.6 kB
        Jayush Luniya
      2. AMBARI-13645.patch
        8 kB
        Jayush Luniya

        Issue Links

          Activity

          Hide
          jluniya Jayush Luniya added a comment -

          Trunk
          commit de05399dfbf93c9cdd3e9fbcbbd826678895db89
          Author: Jayush Luniya <jluniya@hortonworks.com>
          Date: Thu Oct 29 15:22:17 2015 -0700

          AMBARI-13645: HAWQ service requires additional HDFS config properties to be defined (jluniya)

          Show
          jluniya Jayush Luniya added a comment - Trunk commit de05399dfbf93c9cdd3e9fbcbbd826678895db89 Author: Jayush Luniya <jluniya@hortonworks.com> Date: Thu Oct 29 15:22:17 2015 -0700 AMBARI-13645 : HAWQ service requires additional HDFS config properties to be defined (jluniya)
          Hide
          jluniya Jayush Luniya added a comment -

          Branch-2.1
          commit bd82a83f0aac057d6f28b5adda78bdce3f264cd1
          Author: Jayush Luniya <jluniya@hortonworks.com>
          Date: Thu Oct 29 15:22:17 2015 -0700

          AMBARI-13645: HAWQ service requires additional HDFS config properties to be defined (jluniya)

          Show
          jluniya Jayush Luniya added a comment - Branch-2.1 commit bd82a83f0aac057d6f28b5adda78bdce3f264cd1 Author: Jayush Luniya <jluniya@hortonworks.com> Date: Thu Oct 29 15:22:17 2015 -0700 AMBARI-13645 : HAWQ service requires additional HDFS config properties to be defined (jluniya)
          Hide
          jluniya Jayush Luniya added a comment -

          commit 75e2a2653570697f2fc8c1d98ae9382751380a44
          Author: Jayush Luniya <jluniya@hortonworks.com>
          Date: Thu Oct 29 15:22:17 2015 -0700

          AMBARI-13645: HAWQ service requires additional HDFS config properties to be defined (jluniya)

          Show
          jluniya Jayush Luniya added a comment - commit 75e2a2653570697f2fc8c1d98ae9382751380a44 Author: Jayush Luniya <jluniya@hortonworks.com> Date: Thu Oct 29 15:22:17 2015 -0700 AMBARI-13645 : HAWQ service requires additional HDFS config properties to be defined (jluniya)
          Hide
          jluniya Jayush Luniya added a comment -

          Above was for Branch-2.1.2

          Show
          jluniya Jayush Luniya added a comment - Above was for Branch-2.1.2
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Ambari-branch-2.1 #769 (See https://builds.apache.org/job/Ambari-branch-2.1/769/)
          AMBARI-13645: HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=bd82a83f0aac057d6f28b5adda78bdce3f264cd1)

          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml
          • ambari-common/src/main/python/pluggable_stack_definition/GenerateStackDefinition.py
          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/core-site.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Ambari-branch-2.1 #769 (See https://builds.apache.org/job/Ambari-branch-2.1/769/ ) AMBARI-13645 : HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=bd82a83f0aac057d6f28b5adda78bdce3f264cd1 ) ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml ambari-common/src/main/python/pluggable_stack_definition/GenerateStackDefinition.py ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/core-site.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Ambari-trunk-Commit #3738 (See https://builds.apache.org/job/Ambari-trunk-Commit/3738/)
          AMBARI-13645: HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=de05399dfbf93c9cdd3e9fbcbbd826678895db89)

          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml
          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/core-site.xml
          • ambari-common/src/main/python/pluggable_stack_definition/GenerateStackDefinition.py
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Ambari-trunk-Commit #3738 (See https://builds.apache.org/job/Ambari-trunk-Commit/3738/ ) AMBARI-13645 : HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=de05399dfbf93c9cdd3e9fbcbbd826678895db89 ) ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/core-site.xml ambari-common/src/main/python/pluggable_stack_definition/GenerateStackDefinition.py
          Hide
          jluniya Jayush Luniya added a comment -

          Mahadev konar Sumit Mohanty
          Can you review the addendum patch? The change is to remove dfs.datanode.max.transfer.threads override that we had added for PHD.

          Show
          jluniya Jayush Luniya added a comment - Mahadev konar Sumit Mohanty Can you review the addendum patch? The change is to remove dfs.datanode.max.transfer.threads override that we had added for PHD.
          Hide
          sumitmohanty Sumit Mohanty added a comment -

          The additional patch looks good, +1

          Show
          sumitmohanty Sumit Mohanty added a comment - The additional patch looks good, +1
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12771468/AMBARI-13645.addendum.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in ambari-server.

          Test results: https://builds.apache.org/job/Ambari-trunk-test-patch/4234//testReport/
          Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/4234//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12771468/AMBARI-13645.addendum.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in ambari-server. Test results: https://builds.apache.org/job/Ambari-trunk-test-patch/4234//testReport/ Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/4234//console This message is automatically generated.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Ambari-trunk-Commit #3804 (See https://builds.apache.org/job/Ambari-trunk-Commit/3804/)
          AMBARI-13645: HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=7b758e87e13fd62ae5a6579bfbe63835fa70c025)

          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Ambari-trunk-Commit #3804 (See https://builds.apache.org/job/Ambari-trunk-Commit/3804/ ) AMBARI-13645 : HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=7b758e87e13fd62ae5a6579bfbe63835fa70c025 ) ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Ambari-branch-2.1 #833 (See https://builds.apache.org/job/Ambari-branch-2.1/833/)
          AMBARI-13645: HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=3402af6b97d5181574f684b4e4f1c1cc0c9114d8)

          • ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Ambari-branch-2.1 #833 (See https://builds.apache.org/job/Ambari-branch-2.1/833/ ) AMBARI-13645 : HAWQ service requires additional HDFS config properties to (jluniya: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=3402af6b97d5181574f684b4e4f1c1cc0c9114d8 ) ambari-server/src/main/resources/stacks/PHD/3.0/services/HDFS/configuration/hdfs-site.xml

            People

            • Assignee:
              jluniya Jayush Luniya
              Reporter:
              jluniya Jayush Luniya
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development