Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21153

task run in parallel cause ArrayIndexOutOfBoundsException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Testing Infrastructure
    • Labels:
      None

      Description

      It happens occasionally when we run sql in parallel and the job is blocked.the reason is HiveConf class is not thread safe, and SessionState.createSessionDirs() is not Synchronized.

      the error message:

      java.lang.ArrayIndexOutOfBoundsException: 22
      at java.util.ArrayList.add(ArrayList.java:459)
      at org.apache.hadoop.hive.conf.HiveConf.setupRestrictList(HiveConf.java:3216)
      at org.apache.hadoop.hive.conf.HiveConf.addToRestrictList(HiveConf.java:3191)
      at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:651)
      at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:547)
      at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:78)

        Attachments

          Activity

            People

            • Assignee:
              Thatboix45 Chris Bogan
              Reporter:
              yx91490 mmuuooaa
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: