Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1321

Add ability to serialize SqoopOption into JobConf

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None

      Description

      While working on various user issues, I've several times came into need to see what exact parameters were used when starting Sqoop. This seems relatively easy, but can get complicated when users are using some scripts on top of Sqoop binary or are directly integrating with the unsupported Java API.

      Hence I would like to propose to add option to simply dump entire SqoopOptions class into created Job object and make the used parameters available and persisted in the job.xml.

      This will also enable audit tools that are inspecting job.xml for various information.

        Attachments

        1. SQOOP-1321.patch
          4 kB
          Jarek Jarcec Cecho
        2. SQOOP-1321.patch
          5 kB
          Jarek Jarcec Cecho

          Issue Links

            Activity

              People

              • Assignee:
                jarcec Jarek Jarcec Cecho
                Reporter:
                jarcec Jarek Jarcec Cecho
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: