Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.4
    • Component/s: connectors
    • Labels:
      None

      Description

      An attempt to add a way for users to pass credentials to sqoop in a secure way.

      1. SQOOP-914.patch
        22 kB
        Venkatesh Seetharam

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        5d 8h 35m 1 Venkatesh Seetharam 06/Mar/13 07:27
        In Progress In Progress Resolved Resolved
        14d 11h 54m 1 Jarek Jarcec Cecho 20/Mar/13 19:22
        Hide
        Hudson added a comment -

        Integrated in Sqoop-ant-jdk-1.6-hadoop23 #805 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/805/)
        SQOOP-914: Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16)

        Result = SUCCESS
        jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16
        Files :

        • src/docs/man/common-args.txt
        • src/java/org/apache/sqoop/util/CredentialsUtil.java
        • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
        • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
        • src/docs/user/tools.txt
        • src/docs/user/help.txt
        • src/docs/user/common-args.txt
        • src/java/org/apache/sqoop/SqoopOptions.java
        • src/docs/user/connecting.txt
        • src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java
        Show
        Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #805 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/805/ ) SQOOP-914 : Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16 Files : src/docs/man/common-args.txt src/java/org/apache/sqoop/util/CredentialsUtil.java src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/docs/user/tools.txt src/docs/user/help.txt src/docs/user/common-args.txt src/java/org/apache/sqoop/SqoopOptions.java src/docs/user/connecting.txt src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java
        Hide
        Hudson added a comment -

        Integrated in Sqoop-ant-jdk-1.6-hadoop200 #589 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/589/)
        SQOOP-914: Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16)

        Result = SUCCESS
        jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16
        Files :

        • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
        • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
        • src/docs/user/connecting.txt
        • src/docs/man/common-args.txt
        • src/docs/user/tools.txt
        • src/docs/user/common-args.txt
        • src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java
        • src/docs/user/help.txt
        • src/java/org/apache/sqoop/SqoopOptions.java
        • src/java/org/apache/sqoop/util/CredentialsUtil.java
        Show
        Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #589 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/589/ ) SQOOP-914 : Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/docs/user/connecting.txt src/docs/man/common-args.txt src/docs/user/tools.txt src/docs/user/common-args.txt src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java src/docs/user/help.txt src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/util/CredentialsUtil.java
        Hide
        Hudson added a comment -

        Integrated in Sqoop-ant-jdk-1.6-hadoop100 #604 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/604/)
        SQOOP-914: Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16)

        Result = SUCCESS
        jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16
        Files :

        • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
        • src/docs/user/connecting.txt
        • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
        • src/docs/user/tools.txt
        • src/docs/man/common-args.txt
        • src/docs/user/help.txt
        • src/docs/user/common-args.txt
        • src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java
        • src/java/org/apache/sqoop/SqoopOptions.java
        • src/java/org/apache/sqoop/util/CredentialsUtil.java
        Show
        Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #604 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/604/ ) SQOOP-914 : Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16 Files : src/java/org/apache/sqoop/tool/BaseSqoopTool.java src/docs/user/connecting.txt src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/docs/user/tools.txt src/docs/man/common-args.txt src/docs/user/help.txt src/docs/user/common-args.txt src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/util/CredentialsUtil.java
        Hide
        Hudson added a comment -

        Integrated in Sqoop-ant-jdk-1.6-hadoop20 #596 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/596/)
        SQOOP-914: Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16)

        Result = SUCCESS
        jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16
        Files :

        • src/docs/user/common-args.txt
        • src/docs/user/connecting.txt
        • src/java/org/apache/sqoop/util/CredentialsUtil.java
        • src/java/org/apache/sqoop/SqoopOptions.java
        • src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java
        • src/docs/user/tools.txt
        • src/docs/user/help.txt
        • src/docs/man/common-args.txt
        • src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java
        • src/java/org/apache/sqoop/tool/BaseSqoopTool.java
        Show
        Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #596 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/596/ ) SQOOP-914 : Securing passwords in sqoop 1.x (Revision 86812b853fcd4d1b93c8ed5d128cde57465e9b16) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=86812b853fcd4d1b93c8ed5d128cde57465e9b16 Files : src/docs/user/common-args.txt src/docs/user/connecting.txt src/java/org/apache/sqoop/util/CredentialsUtil.java src/java/org/apache/sqoop/SqoopOptions.java src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java src/docs/user/tools.txt src/docs/user/help.txt src/docs/man/common-args.txt src/test/org/apache/sqoop/credentials/TestPassingSecurePassword.java src/java/org/apache/sqoop/tool/BaseSqoopTool.java
        Jarek Jarcec Cecho made changes -
        Status In Progress [ 3 ] Resolved [ 5 ]
        Fix Version/s 1.4.4 [ 12324082 ]
        Resolution Fixed [ 1 ]
        Hide
        Jarek Jarcec Cecho added a comment -

        The patch is in: https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=commit;h=86812b853fcd4d1b93c8ed5d128cde57465e9b16

        Thank you Venkatesh for your time, great job!

        Jarcec

        Show
        Jarek Jarcec Cecho added a comment - The patch is in: https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=commit;h=86812b853fcd4d1b93c8ed5d128cde57465e9b16 Thank you Venkatesh for your time, great job! Jarcec
        Venkatesh Seetharam made changes -
        Status Open [ 1 ] In Progress [ 3 ]
        Venkatesh Seetharam made changes -
        Attachment SQOOP-914.patch [ 12572283 ]
        Venkatesh Seetharam made changes -
        Attachment SQOOP-914.patch [ 12571855 ]
        Hide
        Venkatesh Seetharam added a comment -

        Sorry for the trouble Jarcec. Patch does have the unit test, not sure why its failing to apply. But went ahead and uploaded to RB.
        https://reviews.apache.org/r/9771/
        Also, reattaching the patch to reflect few changes.

        Show
        Venkatesh Seetharam added a comment - Sorry for the trouble Jarcec. Patch does have the unit test, not sure why its failing to apply. But went ahead and uploaded to RB. https://reviews.apache.org/r/9771/ Also, reattaching the patch to reflect few changes.
        Hide
        Jarek Jarcec Cecho added a comment -

        Hi Venkatesh Seetharam,
        thank you very much for working on this one, I believe that a lot of users will be very excited to see this functionality in Sqoop. Would you mind uploading your patch to review board? You might need to fix the patch as I'm for example failing to apply it in my environment:

        jarcec@Odie sqoop % git apply SQOOP-914.patch
        error: src/test/org/apache/sqoop/credentials/TestSqoopOptions.java: No such file or directory
        

        Jarcec

        Show
        Jarek Jarcec Cecho added a comment - Hi Venkatesh Seetharam , thank you very much for working on this one, I believe that a lot of users will be very excited to see this functionality in Sqoop. Would you mind uploading your patch to review board ? You might need to fix the patch as I'm for example failing to apply it in my environment: jarcec@Odie sqoop % git apply SQOOP-914.patch error: src/test/org/apache/sqoop/credentials/TestSqoopOptions.java: No such file or directory Jarcec
        Venkatesh Seetharam made changes -
        Attachment SQOOP-914.patch [ 12571855 ]
        Hide
        Venkatesh Seetharam added a comment -

        Attaching the patch for initial review.

        Show
        Venkatesh Seetharam added a comment - Attaching the patch for initial review.
        Venkatesh Seetharam made changes -
        Field Original Value New Value
        Description An attempt to add a way for users to pass credentials to sqoop in a secure way.
        Venkatesh Seetharam created issue -

          People

          • Assignee:
            Venkatesh Seetharam
            Reporter:
            Venkatesh Seetharam
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development