Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2711

Make the header of RCFile unique

    XMLWordPrintableJSON

Details

    Description

      The RCFile implementation was copied from Hadoop's SequenceFile and copied the 'magic' string in the header. This means that you can't use the header to distinguish between RCFiles and SequenceFiles.

      I'd propose that we create a new header for RCFiles (RCF?) to replace the current SEQ. To maintain compatibility, we'll need to continue to accept the current 'SEQ\06' and just make new files contain the new header.

      Attachments

        1. ASF.LICENSE.NOT.GRANTED--HIVE-2711.D2115.1.patch
          9 kB
          Phabricator
        2. ASF.LICENSE.NOT.GRANTED--HIVE-2711.D2115.2.patch
          9 kB
          Phabricator
        3. ASF.LICENSE.NOT.GRANTED--HIVE-2711.D2115.3.patch
          18 kB
          Phabricator
        4. ASF.LICENSE.NOT.GRANTED--HIVE-2711.D2571.1.patch
          9 kB
          Phabricator
        5. rc-file-v0.rc
          0.2 kB
          Owen O'Malley

        Activity

          People

            omalley Owen O'Malley
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: