Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4706

Query on Table with partition columns fail with AlreadyBeingCreatedException

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: vectorization-branch, 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Table with partition columns fail will AlreadyBeingCreatedException when CombineHiveInputFormat is uses. Below is the exception stack

      2013-06-07 16:38:51,098 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:ssakala cause:org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create file /tmp/hive-ssakala/hive_2013-06-07_16-36-10_579_6803860768897313738/_task_tmp.-ext-10001/_tmp.000000_0 for DFSClient_attempt_201306071336_0016_m_000000_0 on client 127.0.0.1 because current leaseholder is trying to recreate file.
      2013-06-07 16:38:51,098 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020, call create(/tmp/hive-ssakala/hive_2013-06-07_16-36-10_579_6803860768897313738/_task_tmp.-ext-10001/_tmp.000000_0, rwxr-xr-x, DFSClient_attempt_201306071336_0016_m_000000_0, true, true, 1, 67108864) from 127.0.0.1:32905: error: org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create file /tmp/hive-ssakala/hive_2013-06-07_16-36-10_579_6803860768897313738/_task_tmp.-ext-10001/_tmp.000000_0 for DFSClient_attempt_201306071336_0016_m_000000_0 on client 127.0.0.1 because current leaseholder is trying to recreate file.
      org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException: failed to create file /tmp/hive-ssakala/hive_2013-06-07_16-36-10_579_6803860768897313738/_task_tmp.-ext-10001/_tmp.000000_0 for DFSClient_attempt_201306071336_0016_m_000000_0 on client 127.0.0.1 because current leaseholder is trying to recreate file.
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.recoverLeaseInternal(FSNamesystem.java:1386)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:1258)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:1200)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.create(NameNode.java:632)
      at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1393)
      at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1389)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1387)

        Attachments

        1. Hive-4706.0.patch
          16 kB
          Sarvesh Sakalanaga

          Activity

            People

            • Assignee:
              sarvesh.sn Sarvesh Sakalanaga
              Reporter:
              sarvesh.sn Sarvesh Sakalanaga
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: