Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1146

Enable mysql's direct export to work with Avro

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • connectors/mysql
    • None

    Description

      Exporting data via sqoop to a mysql table works on Avro files without the direct option. The job's input format changes to org.apache.sqoop.mapreduce.AvroInputFormat from org.apache.sqoop.mapreduce.ExportInputFormat meant for plain text.

      Export does not work for avro files with the direct option though. There is no way an input format can be specified as well. Seems like it's assumed to be a plain text file. The mapreduce.inputformat.class remains org.apache.sqoop.mapreduce.ExportInputFormat even for an Avro directory.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rama_n Ramakrishna N
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: