Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4166

closeAllForUGI causes failure in hiveserver2 when fetching large amount of data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 0.10.0, 0.11.0
    • None
    • HiveServer2, Security, Shims
    • None
    • HiveServer2 doAs Shims

    Description

      HiveServer2 configured to use Kerberos authentication with doAs enabled throws an exception when fetching a large amount of data from a query.

      The exception is caused because FileSystem.closeAllForUGI is always called at the end of TUGIAssumingProcessor.process. This affects requests on the ResultSet for data from a SELECT query when the amount of data exceeds a certain size. At that point any subsequent calls to fetch more data throw an exception because the underlying DFSClient has been closed.

      Attachments

        1. HIVE-4166-trunk.patch
          8 kB
          Chris Drome
        2. HIVE-4166-0.10.patch
          7 kB
          Chris Drome

        Activity

          People

            cdrome Chris Drome
            cdrome Chris Drome
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: