Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5110

Investigate memory consumption during map-side join

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      In map-side join we have this track the JVM memory usage and if it's over a certain limit we fail the task. In HIVE-4838 we discussed removing that and letting the JVM run OOM. However there was a concern that this could cause performance problems for queries that will run out of memory.

      This jira is to decide we can let the JVM run OOM and if so remove that check. If we cannot, can we raise the default limit?

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-4838 Refactor MapJoin HashMap code to improve testability and readability

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              brocknoland Brock Noland
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: