Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9896

\N un-recognized in AVRO format Hive tables

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.13.0
    • Fix Version/s: None
    • Labels:
      None
    • Environment:

      CDH5.2.1, RHEL6.5, Java 7

      Description

      We Sqooped (1.4.5) data from many RDBMS into HDFS in text format with options --null-non-string '\N' --null-string '\N'.
      When we load these into Hive tables in text format the \N is properly recognized as NULL and we are able to use SQL clauses such as IS NULL and IS NOT NULL against columns.
      However, when we convert the text files into AVRO (1.7.6) with SNAPPY compression through Pig (0.12) and try to query using the above SQL clauses, the query does not return results as expected.
      Further, we have to use column_name = '\N' or column_name <> '\N' as a workaround.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              madhan.sundararajan@tcs.com Madhan Sundararajan Devaki
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: