Sqoop
  1. Sqoop
  2. SQOOP-428

AvroOutputFormat doesn't support compression even though documentation claims it does

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.0-incubating
    • Fix Version/s: 1.4.1-incubating
    • Component/s: docs
    • Labels:

      Description

      The documentation claims that Avro files can be compressed as well:

      By default, data is not compressed. You can compress your data by using the deflate (gzip) algorithm with the -z or --compress argument, or specify any Hadoop compression codec using the --compression-codec argument. This applies to SequenceFile, text, and Avro files.

      This is not true as the AvroOutputFormat currently doesn't support compression.

      1. TEST-com.cloudera.sqoop.TestAvroImport.txt
        690 kB
        Jarek Jarcec Cecho
      2. SQOOP-428.4.patch
        16 kB
        Lars Francke
      3. SQOOP-428.3.patch
        16 kB
        Lars Francke
      4. SQOOP-428.2.patch
        11 kB
        Lars Francke
      5. SQOOP-428.1.patch
        8 kB
        Lars Francke

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Lars Francke
            Reporter:
            Lars Francke
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development