Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1598

use SequenceFile rather than TextFile format for hive query results

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None
    • Reviewed

    Description

      Hive query's result is written to a temporary directory first and then FetchTask takes the files and display it to the users. Currently the file format used for the resulting file is TextFile format. This could cause incorrect result display if some string typed column contains new lines, which are used as record delimiters in TextInputFormat. Switching to SequenceFile format will solve this problem.

      Attachments

        1. HIVE-1598.patch
          11 kB
          Ning Zhang
        2. HIVE-1598.2.patch
          18 kB
          Ning Zhang

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-3065 New lines in columns can cause problems even when using sequence files

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-1608 use sequencefile as the default for storing intermediate results

          • Major - Major loss of function.
          • Closed

          Activity

            People

              nzhang Ning Zhang
              nzhang Ning Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: