Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8666

hive.metastore.server.max.threads default is too high

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      hive.metastore.server.max.threads defaults to 100K. Each thread requires a 1024KB stack which is 100GB. We should move the default to something more sensible like 1000.

      1. HIVE-8666.patch
        0.9 kB
        Brock Noland

        Activity

        Hide
        hiveqa Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12678100/HIVE-8666.patch

        ERROR: -1 due to 2 failed/errored test(s), 6590 tests executed
        Failed tests:

        org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
        org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth
        

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1554/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1554/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1554/

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 2 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12678100 - PreCommit-HIVE-TRUNK-Build

        Show
        hiveqa Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12678100/HIVE-8666.patch ERROR: -1 due to 2 failed/errored test(s), 6590 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1554/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1554/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1554/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12678100 - PreCommit-HIVE-TRUNK-Build
        Hide
        szehon Szehon Ho added a comment -

        Sounds reasonable, +1

        Show
        szehon Szehon Ho added a comment - Sounds reasonable, +1
        Hide
        leftylev Lefty Leverenz added a comment -

        Doc note: This changes the default value of hive.metastore.server.max.threads from 100000 to 1000 in HiveConf.java, so the wiki needs to be updated (with version information) by the time Hive 0.15.0 is released.

        Show
        leftylev Lefty Leverenz added a comment - Doc note: This changes the default value of hive.metastore.server.max.threads from 100000 to 1000 in HiveConf.java, so the wiki needs to be updated (with version information) by the time Hive 0.15.0 is released. Configuration Properties – hive.metastore.server.max.threads
        Hide
        abrugh_ey Alex Brugh added a comment -

        Still needs to be updated in the wiki!

        Show
        abrugh_ey Alex Brugh added a comment - Still needs to be updated in the wiki!
        Hide
        leftylev Lefty Leverenz added a comment -

        Thanks for the nudge, Alex Brugh. The wiki is updated now, so I'm removing the TODOC15 label from this issue.

        Show
        leftylev Lefty Leverenz added a comment - Thanks for the nudge, Alex Brugh . The wiki is updated now, so I'm removing the TODOC15 label from this issue.

          People

          • Assignee:
            brocknoland Brock Noland
            Reporter:
            brocknoland Brock Noland
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development