Sqoop
  1. Sqoop
  2. SQOOP-1223

Enhance the password file capability to enable plugging-in custom loaders

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.5
    • Component/s: None
    • Labels:
      None

      Description

      Using --password-file argument currently requires the file to be available in plain-text format in a special file. It would be great if we can enable plugging in custom loaders that will be able to understand custom formats and/or encrypted password files.

      1. SQOOP-1223.patch
        21 kB
        Jarek Jarcec Cecho
      2. SQOOP-1223.patch
        22 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #860 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/860/)
          SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c)

          • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
          • src/java/org/apache/sqoop/util/password/PasswordLoader.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • src/java/org/apache/sqoop/util/password/CryptoFileLoader.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/java/org/apache/sqoop/util/password/FilePasswordLoader.java
          • src/java/org/apache/sqoop/util/CredentialsUtil.java
          Show
          Hudson added a comment - FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #860 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/860/ ) SQOOP-1223 . Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c ) src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/util/password/PasswordLoader.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/java/org/apache/sqoop/util/password/CryptoFileLoader.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/util/password/FilePasswordLoader.java src/java/org/apache/sqoop/util/CredentialsUtil.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1062 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1062/)
          SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c)

          • src/java/org/apache/sqoop/util/password/FilePasswordLoader.java
          • src/java/org/apache/sqoop/util/password/CryptoFileLoader.java
          • src/java/org/apache/sqoop/util/password/PasswordLoader.java
          • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
          • src/java/org/apache/sqoop/util/CredentialsUtil.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1062 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1062/ ) SQOOP-1223 . Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c ) src/java/org/apache/sqoop/util/password/FilePasswordLoader.java src/java/org/apache/sqoop/util/password/CryptoFileLoader.java src/java/org/apache/sqoop/util/password/PasswordLoader.java src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/util/CredentialsUtil.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/java/org/apache/sqoop/SqoopOptions.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #866 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/866/)
          SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c)

          • src/java/org/apache/sqoop/util/password/FilePasswordLoader.java
          • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/java/org/apache/sqoop/util/password/PasswordLoader.java
          • src/java/org/apache/sqoop/util/password/CryptoFileLoader.java
          • src/java/org/apache/sqoop/util/CredentialsUtil.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #866 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/866/ ) SQOOP-1223 . Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c ) src/java/org/apache/sqoop/util/password/FilePasswordLoader.java src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/util/password/PasswordLoader.java src/java/org/apache/sqoop/util/password/CryptoFileLoader.java src/java/org/apache/sqoop/util/CredentialsUtil.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          Hide
          Jarek Jarcec Cecho added a comment -

          The failure in profile 100 is valid, it seems that SQOOP-1223 introduced dependency on API that is not available in Hadoop 1.0.

          Show
          Jarek Jarcec Cecho added a comment - The failure in profile 100 is valid, it seems that SQOOP-1223 introduced dependency on API that is not available in Hadoop 1.0.
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #825 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/825/)
          SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c)

          • src/java/org/apache/sqoop/util/password/FilePasswordLoader.java
          • src/java/org/apache/sqoop/SqoopOptions.java
          • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
          • src/java/org/apache/sqoop/util/password/PasswordLoader.java
          • src/java/org/apache/sqoop/util/password/CryptoFileLoader.java
          • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
          • src/java/org/apache/sqoop/util/CredentialsUtil.java
          Show
          Hudson added a comment - FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #825 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/825/ ) SQOOP-1223 . Enhance the password file capability to enable plugging-in custom loaders. (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed73f885a1e6b526945072090e1a83e74fd3a23c ) src/java/org/apache/sqoop/util/password/FilePasswordLoader.java src/java/org/apache/sqoop/SqoopOptions.java src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/util/password/PasswordLoader.java src/java/org/apache/sqoop/util/password/CryptoFileLoader.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/java/org/apache/sqoop/util/CredentialsUtil.java
          Hide
          Hari Shreedharan added a comment -

          Committed! Thanks Jarcec!

          Show
          Hari Shreedharan added a comment - Committed! Thanks Jarcec!
          Hide
          ASF subversion and git services added a comment -

          Commit ed73f885a1e6b526945072090e1a83e74fd3a23c in branch refs/heads/trunk from Hari Shreedharan
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ed73f88 ]

          SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders.

          (Jarek Jarcec Cecho via Hari Shreedharan)

          Show
          ASF subversion and git services added a comment - Commit ed73f885a1e6b526945072090e1a83e74fd3a23c in branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ed73f88 ] SQOOP-1223 . Enhance the password file capability to enable plugging-in custom loaders. (Jarek Jarcec Cecho via Hari Shreedharan)

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development