Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-428

AvroOutputFormat doesn't support compression even though documentation claims it does

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.0-incubating
    • Fix Version/s: 1.4.1-incubating
    • Component/s: docs
    • Labels:

      Description

      The documentation claims that Avro files can be compressed as well:

      By default, data is not compressed. You can compress your data by using the deflate (gzip) algorithm with the -z or --compress argument, or specify any Hadoop compression codec using the --compression-codec argument. This applies to SequenceFile, text, and Avro files.

      This is not true as the AvroOutputFormat currently doesn't support compression.

        Attachments

        1. TEST-com.cloudera.sqoop.TestAvroImport.txt
          690 kB
          Jarek Jarcec Cecho
        2. SQOOP-428.4.patch
          16 kB
          Lars Francke
        3. SQOOP-428.3.patch
          16 kB
          Lars Francke
        4. SQOOP-428.2.patch
          11 kB
          Lars Francke
        5. SQOOP-428.1.patch
          8 kB
          Lars Francke

          Activity

            People

            • Assignee:
              lars_francke Lars Francke
              Reporter:
              lars_francke Lars Francke
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: