Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10711

Tez HashTableLoader attempts to allocate more memory than available when HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD exceeds process max mem

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.2.1
    • Tez
    • None

    Description

      Tez HashTableLoader bases its memory allocation on HIVECONVERTJOINNOCONDITIONALTASKTHRESHOLD. If this value is largeer than the process max memory then this can result in the HashTableLoader trying to use more memory than available to the process.

      Attachments

        1. HIVE-10711.4.patch
          1 kB
          Mostafa Mokhtar
        2. HIVE-10711.3.patch
          2 kB
          Mostafa Mokhtar
        3. HIVE-10711.2.patch
          1 kB
          Jason Dere
        4. HIVE-10711.1.patch
          1 kB
          Jason Dere

        Activity

          People

            mmokhtar Mostafa Mokhtar
            jdere Jason Dere
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: