Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7926 long-lived daemons for query fragment execution, I/O and caching
  3. HIVE-10329

Hadoop reflectionutils has issues

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • llap, 1.2.0, 2.0.0
    • None
    • None

    Description

      1) Constructor cache leaks classes and their attendant static overhead forever.
      2) Class cache inside conf used when getting JobConfigurable classes has an epic lock.

      Both bugs are files in Hadoop but will hardly ever be fixed at this rate. This version avoids both problems

      Attachments

        1. HIVE-10329.patch
          30 kB
          Sergey Shelukhin

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HIVE-11408 HiveServer2 is leaking ClassLoaders when add jar / temporary functions are used due to constructor caching in Hadoop ReflectionUtils

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HIVE-10453 HS2 leaking open file descriptors when using UDFs

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sershe Sergey Shelukhin Assign to me
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment