Sqoop
  1. Sqoop
  2. SQOOP-435

Avro import should write the Schema to a file

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.4.0-incubating
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:

      Description

      The Avro import should either automatically or optionally write the created schema to a file somewhere. That saves extracting it later on if needed.

      1. 435.patch
        3 kB
        James Anderson

        Issue Links

          Activity

          Lars Francke created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Labels newbie
          James Anderson made changes -
          Assignee James Anderson [ anderson.900 ]
          Hide
          James Anderson added a comment -

          SQOOP-435 patch

          Show
          James Anderson added a comment - SQOOP-435 patch
          James Anderson made changes -
          Attachment 435.diff [ 12609328 ]
          Hide
          James Anderson added a comment -

          Automatically generate an Avro schema file (*.avsc) in the JAR output directory when --as-avrodatafile is specified.

          Show
          James Anderson added a comment - Automatically generate an Avro schema file (*.avsc) in the JAR output directory when --as-avrodatafile is specified.
          James Anderson made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          James Anderson added a comment -

          Requested review of this patch.

          https://reviews.apache.org/r/14779/

          Show
          James Anderson added a comment - Requested review of this patch. https://reviews.apache.org/r/14779/
          James Anderson made changes -
          Attachment 435.diff [ 12609328 ]
          Hide
          James Anderson added a comment -

          Resolve issues raised in review #14779

          Show
          James Anderson added a comment - Resolve issues raised in review #14779
          James Anderson made changes -
          Attachment 435.patch [ 12609780 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12936 ]
          Hide
          ASF subversion and git services added a comment -

          Commit a555a1f31a5546083a9fb0c3e9af17ad996d5d18 in branch refs/heads/trunk from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a555a1f ]

          SQOOP-435: Avro import should write the Schema to a file

          (James Anderson via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit a555a1f31a5546083a9fb0c3e9af17ad996d5d18 in branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a555a1f ] SQOOP-435 : Avro import should write the Schema to a file (James Anderson via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you for your contribution James Anderson!

          Show
          Jarek Jarcec Cecho added a comment - Thank you for your contribution James Anderson !
          Jarek Jarcec Cecho made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 1.4.5 [ 12324765 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1061 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1061/)
          SQOOP-435: Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18)

          • src/test/com/cloudera/sqoop/TestAvroImport.java
          • src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1061 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1061/ ) SQOOP-435 : Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18 ) src/test/com/cloudera/sqoop/TestAvroImport.java src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #859 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/859/)
          SQOOP-435: Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18)

          • src/test/com/cloudera/sqoop/TestAvroImport.java
          • src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #859 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/859/ ) SQOOP-435 : Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18 ) src/test/com/cloudera/sqoop/TestAvroImport.java src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #823 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/823/)
          SQOOP-435: Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18)

          • src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          • src/test/com/cloudera/sqoop/TestAvroImport.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #823 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/823/ ) SQOOP-435 : Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18 ) src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java src/test/com/cloudera/sqoop/TestAvroImport.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #865 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/865/)
          SQOOP-435: Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18)

          • src/test/com/cloudera/sqoop/TestAvroImport.java
          • src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #865 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/865/ ) SQOOP-435 : Avro import should write the Schema to a file (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=a555a1f31a5546083a9fb0c3e9af17ad996d5d18 ) src/test/com/cloudera/sqoop/TestAvroImport.java src/java/org/apache/sqoop/mapreduce/DataDrivenImportJob.java

            People

            • Assignee:
              James Anderson
              Reporter:
              Lars Francke
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development