Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13120

propagate doAs when generating ORC splits

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.1, 2.1.0
    • None
    • None

    Description

      ORC+HS2+doAs+FetchTask conversion = weird permission errors, e.g.

      2016-02-22 17:24:39,005 WARN  [HiveServer2-Handler-Pool: Thread-587]: thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(681)) - Error fetching results:
      org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException: serious problem
              at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:352)
      [snip]
      Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
              at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
              at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1720)
              at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:347)
              ... 24 more
      Caused by: java.lang.RuntimeException: serious problem
              at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1059)
              at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1086)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
              at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
              ... 28 more
      Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.security.AccessControlException: Permission denied: user=[snip], access=READ_EXECUTE, inode=[snip]
      

      Attachments

        1. HIVE-13120.patch
          32 kB
          Sergey Shelukhin
        2. HIVE-13120-branch-1.WIP.patch
          27 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              sershe Sergey Shelukhin
              yeeza Yi Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: