Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17593

DataWritableWriter strip spaces for CHAR type before writing, but predicate generator doesn't do same thing.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.3.0, 3.0.0
    • Fix Version/s: None
    • Component/s: None
    • Target Version/s:

      Description

      DataWritableWriter strip spaces for CHAR type before writing. While when generating predicate, it does NOT do same striping which should cause data missing!

      In current version, it doesn't cause data missing since predicate is not well push down to parquet due to HIVE-17261.

      Please see ConvertAstTosearchArg.java, getTypes treats CHAR and STRING as same which will build a predicate with tail spaces.

        Attachments

        1. HIVE-17593.2.patch
          2 kB
          Junjie Chen
        2. HIVE-17593.3.patch
          3 kB
          Junjie Chen
        3. HIVE-17593.4.patch
          5 kB
          Junjie Chen
        4. HIVE-17593.5.patch
          6 kB
          Junjie Chen
        5. HIVE-17593.patch
          0.7 kB
          Junjie Chen

          Issue Links

            Activity

              People

              • Assignee:
                junjie Junjie Chen
                Reporter:
                junjie Junjie Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m