Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-25190

BytesColumnVector fails when the aggregate size is > 1gb

    XMLWordPrintableJSON

Details

    Description

      Currently, BytesColumnVector will allocate a buffer for small values (< 1mb), but fail with:

      new RuntimeException("Overflow of newLength. smallBuffer.length="
                + smallBuffer.length + ", nextElemLength=" + nextElemLength);

      if the aggregate size of the buffer crosses over 1gb.

      Attachments

        Issue Links

          fixes

          Bug - A problem which impairs or prevents the functions of the product. ORC-482 Error writing to OrcNewOutputFormat using MapR MultipleOutputs

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue ORC-867 Upgrade hive-storage-api to 2.8.1

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. ORC-906 Upgrade branch-1.6 to storage-api 2.7.3

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #2408

          Activity

            People

              omalley Owen O'Malley
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 50m
                  2h 50m