Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-902

Make Avro field prefix configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.4.2
    • None
    • codegen
    • None

    Description

      When Sqoop encounters column names that break avro schema definition rules, an underscore sign is added by Sqoop to the field name (leaving the columnName property value faithful to the original name). This creates problems when processing the imported avro data using other tools such Pig (where underscore is illegal at the start of a field name).

      It would be useful to have the prefix sign configurable for avrodatafile import, but maybe still defaulting to underscore to retain backward compatibility.

      Attachments

        Activity

          People

            Unassigned Unassigned
            glca Glyton Camilleri
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: