Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13308

HiveOnSpark sumbit query very slow when hundred of beeline exectue at same time

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.2.1
    • None
    • Spark
    • None

    Description

      backgroud: hive on spark , yarn cluster mode
      details:
      when using hundred of beeline submit query at the same time, we found that yarn get application very slow, and hiveserver is blocked at SparkClientFactory.createClient method
      after analysis, we think the synchronize on SparkClientFactory.createClient , can be removed

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HIVE-16854 SparkClientFactory is locked too aggressively

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              wenli wangwenli
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 1h
                  1h
                  Remaining:
                  Remaining Estimate - 1h
                  1h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified