Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-12043

UGI instances being used in IO elevator threads are incorrect

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: llap
    • Component/s: None
    • Labels:
      None

      Description

      ... which leads to FileSystem closed exceptions.

      I'm not sure yet if this is a result of the threadpool being used, and UGI not working well with threadpools, or something else.
      The UGI instance which was setup - at what looks to be thread creation time - ends up being used for several different reads, ignoring the actual UGI passed in. At some point this changes to a new incorrect UGI.

      A simple fix is to propagate the correct UGI all the way to the reader, and that fixes the FileSystem Closed exception. Figuring out the precise reason would be good though.

      Related to HIVE-9898.

        Attachments

        1. HIVE-12043.1.txt
          3 kB
          Siddharth Seth
        2. HIVE-12043.2.txt
          3 kB
          Siddharth Seth

          Activity

            People

            • Assignee:
              sseth Siddharth Seth
              Reporter:
              sseth Siddharth Seth
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: