Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-13874

Tighten up EOF checking in Fast DeserializeRead classes; display better exception information; add new Unit Tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.1.1, 2.2.0
    • Hive
    • None

    Description

      Tighten up EOF bounds checking in LazyBinaryDeserializeRead so bytes beyond stated row end are never read. Use WritableUtils.decodeVIntSize to check for room ahead like regular LazyBinary code does.

      Display more detailed information when an exception is thrown by DeserializeRead classes.

      Add Unit Tests, including some designed that catch the errors like HIVE-13818.

      Attachments

        1. HIVE-13874.05.patch
          167 kB
          Matt McCline
        2. HIVE-13874.04.patch
          167 kB
          Matt McCline
        3. HIVE-13874.03.patch
          167 kB
          Matt McCline
        4. HIVE-13874.02.patch
          168 kB
          Matt McCline
        5. HIVE-13874.01.patch
          169 kB
          Matt McCline

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13818 Fast Vector MapJoin Long hashtable has to handle all integral types

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link RB #48251

          Activity

            People

              mmccline Matt McCline
              mmccline Matt McCline
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: