Sqoop
  1. Sqoop
  2. SQOOP-957

Proposed enhancements for getting Sqoop support on Windows

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 1.4.3
    • Fix Version/s: 1.4.6
    • Component/s: None
    • Labels:
      None

      Description

      This is an umbrella Jira for the set of propsed enhancements to get Sqoop fully functional on Windows. Those changes include:

      a) SQOOP-949: Allow Sqoop to build on Windows OS
      b) SQOOP-954: Create Sqoop runtime scripts to run Sqoop on Windows
      c) SQOOP-955: Fix Sqoop unit test failures on Windows
      d) SQOOP-956: Create a winpkg target for Sqoop to create a Winows installable Sqoop package
      e) SQOOP-960: Update Sqoop documentation for Windows changes

        Issue Links

          Activity

          Ahmed El Baz created issue -
          Ahmed El Baz made changes -
          Field Original Value New Value
          Link This issue incorporates SQOOP-954 [ SQOOP-954 ]
          Ahmed El Baz made changes -
          Link This issue incorporates SQOOP-955 [ SQOOP-955 ]
          Ahmed El Baz made changes -
          Link This issue incorporates SQOOP-956 [ SQOOP-956 ]
          Ahmed El Baz made changes -
          Link This issue incorporates SQOOP-949 [ SQOOP-949 ]
          Jarek Jarcec Cecho made changes -
          Link This issue incorporates SQOOP-954 [ SQOOP-954 ]
          Jarek Jarcec Cecho made changes -
          Link This issue incorporates SQOOP-955 [ SQOOP-955 ]
          Jarek Jarcec Cecho made changes -
          Link This issue incorporates SQOOP-956 [ SQOOP-956 ]
          Jarek Jarcec Cecho made changes -
          Link This issue incorporates SQOOP-949 [ SQOOP-949 ]
          Hide
          Jarek Jarcec Cecho added a comment - - edited

          Hi Ahmed El Baz,
          thank you very much for opening all the JIRAs that are required to enable Sqoop running on Windows. To be consistent with the way we usually handle these, I've changed this JIRA to umbrella one and moved all other JIRAs as a subtasks of this one. Please accept my apologies if it makes you feel uncomfortable.

          Jarcec

          Show
          Jarek Jarcec Cecho added a comment - - edited Hi Ahmed El Baz , thank you very much for opening all the JIRAs that are required to enable Sqoop running on Windows. To be consistent with the way we usually handle these, I've changed this JIRA to umbrella one and moved all other JIRAs as a subtasks of this one. Please accept my apologies if it makes you feel uncomfortable. Jarcec
          Hide
          Ahmed El Baz added a comment -

          Not at all. Thank you Jarek

          Show
          Ahmed El Baz added a comment - Not at all. Thank you Jarek
          Hide
          Venkat Ranganathan added a comment -

          Thanks Jarek Jarcec Cecho and Ahmed El Baz

          My understanding is that we will be collecting all the patches under the JIRA before we apply them to trunk? Is that right?

          I will try to apply them locally to my Windows VM for each of the patches?

          Show
          Venkat Ranganathan added a comment - Thanks Jarek Jarcec Cecho and Ahmed El Baz My understanding is that we will be collecting all the patches under the JIRA before we apply them to trunk? Is that right? I will try to apply them locally to my Windows VM for each of the patches?
          Hide
          Hari Shreedharan added a comment -

          Why not create a separate branch (I realize that sqoop-2 is already a non-trunk branch), continue development there, and then merge it back to sqoop-2? That way the branch owner does not need to rebase every single time.

          Show
          Hari Shreedharan added a comment - Why not create a separate branch (I realize that sqoop-2 is already a non-trunk branch), continue development there, and then merge it back to sqoop-2? That way the branch owner does not need to rebase every single time.
          Hide
          Venkat Ranganathan added a comment -

          Hi Hari Shreedharan

          That is a good assessment,but it looks like we are looking at 4 disjoint patches so a branch machinery may be a little overkill was the thought process to have an umbrella JIRA, collect the 4 patches and apply them and try.

          Ahmed El Baz, how long do you think it will take you to upload all the patches. I thought you will be uploading them quickly. As Hari Shreedharan says, if we are going to have this work extended over a longer period, a branch is a good approach.

          Show
          Venkat Ranganathan added a comment - Hi Hari Shreedharan That is a good assessment,but it looks like we are looking at 4 disjoint patches so a branch machinery may be a little overkill was the thought process to have an umbrella JIRA, collect the 4 patches and apply them and try. Ahmed El Baz , how long do you think it will take you to upload all the patches. I thought you will be uploading them quickly. As Hari Shreedharan says, if we are going to have this work extended over a longer period, a branch is a good approach.
          Hide
          Ahmed El Baz added a comment -

          I am working on getting the patches ready by end of this week. Since the patches were made against Sqoop 1.4.2 I am rebasing them to 1.4.4 to capture any deltas that happened.
          I would second Venkat that the having a dedicated branch for the patches could be an overkill if they are just 4 patches.

          Show
          Ahmed El Baz added a comment - I am working on getting the patches ready by end of this week. Since the patches were made against Sqoop 1.4.2 I am rebasing them to 1.4.4 to capture any deltas that happened. I would second Venkat that the having a dedicated branch for the patches could be an overkill if they are just 4 patches.
          Ahmed El Baz made changes -
          Description This is an umbrella Jira for the set of propsed enhancements to get Sqoop fully functional on Windows. Those changes include:

          a) SQOOP-949: Allow Sqoop to build on Windows OS
          b) SQOOP-954: Create Sqoop runtime scripts to run Sqoop on Windows
          c) SQOOP-955: Fix Sqoop unit test failures on Windows
          d) SQOOP-956: Create a winpkg target for Sqoop to create a Winows installable Sqoop package
          This is an umbrella Jira for the set of propsed enhancements to get Sqoop fully functional on Windows. Those changes include:

          a) SQOOP-949: Allow Sqoop to build on Windows OS
          b) SQOOP-954: Create Sqoop runtime scripts to run Sqoop on Windows
          c) SQOOP-955: Fix Sqoop unit test failures on Windows
          d) SQOOP-956: Create a winpkg target for Sqoop to create a Winows installable Sqoop package
          e) SQOOP-960: Update Sqoop documentation for Windows changes
          Jarek Jarcec Cecho made changes -
          Link This issue is duplicated by SQOOP-504 [ SQOOP-504 ]
          Hide
          Venkat Ranganathan added a comment -

          Ahmed El Baz are you still working on winpkg creation and docs? It would be good to get this JIRA completed.
          Thanks
          Venkat

          Show
          Venkat Ranganathan added a comment - Ahmed El Baz are you still working on winpkg creation and docs? It would be good to get this JIRA completed. Thanks Venkat
          Vasanth kumar RJ made changes -
          Fix Version/s 1.4.5 [ 12324765 ]
          Fix Version/s 1.4.4 [ 12324082 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Ahmed El Baz, thank you very much for working on the Windows support for Sqoop. I was wondering if you are still working on it?

          Show
          Jarek Jarcec Cecho added a comment - Hi Ahmed El Baz , thank you very much for working on the Windows support for Sqoop. I was wondering if you are still working on it?
          Abraham Elmahrek made changes -
          Fix Version/s 1.4.6 [ 12327469 ]
          Fix Version/s 1.4.5 [ 12324765 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Ahmed El Baz
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development