Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17304

ThreadMXBean based memory allocation monitory for hash table loader

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • None
    • None

    Description

      Hash table memory monitoring is based on java data model which can be unreliable because of various reasons (wrong object size estimation, adding new variables to any class without accounting its size for memory monitoring, etc.). We can use allocation size per thread that is provided by ThreadMXBean and fallback to DataModel in case if JDK doesn't support thread based allocations.

      Attachments

        1. HIVE-17304.1.patch
          13 kB
          Prasanth Jayachandran
        2. HIVE-17304.2.patch
          13 kB
          Prasanth Jayachandran

        Issue Links

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: