Hadoop Common
  1. Hadoop Common
  2. HADOOP-8409

Fix TestCommandLineJobSubmission and TestGenericOptionsParser to work for windows

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1-win
    • Component/s: fs, test, util
    • Labels:
      None
    • Target Version/s:

      Description

      There are multiple places in prod and test code where Windows paths are not handled properly. From a high level this could be summarized with:
      1. Windows paths are not necessarily valid DFS paths (while Unix paths are)
      2. Windows paths are not necessarily valid URIs (while Unix paths are)

      #1 causes a number of tests to fail because they implicitly assume that local paths are valid DFS paths (by extracting the DFS test path from for example "test.build.data" property)

      #2 causes issues when URIs are directly created on path strings passed in by the user

      1. HADOOP-8409-branch-1-win.4.patch
        4 kB
        Ivan Mitic
      2. HADOOP-8409-branch-1-win.3.patch
        4 kB
        Ivan Mitic
      3. HADOOP-8409-branch-1-win.2.patch
        4 kB
        Ivan Mitic
      4. HADOOP-8409-branch-1-win.patch
        24 kB
        Ivan Mitic

        Issue Links

          Activity

          Ivan Mitic created issue -
          Ivan Mitic made changes -
          Field Original Value New Value
          Link This issue is part of HADOOP-8079 [ HADOOP-8079 ]
          Ivan Mitic made changes -
          Attachment HADOOP-8409-branch-1-win.patch [ 12528186 ]
          Sanjay Radia made changes -
          Assignee Ivan Mitic [ ivanmi ]
          Ivan Mitic made changes -
          Attachment HADOOP-8409-branch-1-win.2.patch [ 12531176 ]
          Ivan Mitic made changes -
          Attachment HADOOP-8409-branch-1-win.3.patch [ 12531288 ]
          Ivan Mitic made changes -
          Attachment HADOOP-8409-branch-1-win.4.patch [ 12531354 ]
          Sanjay Radia made changes -
          Summary Address Hadoop path related issues on Windows Fix TestCommandLineJobSubmission and TestGenericOptionsParser to work for windows
          Bikas Saha made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Matt Foley made changes -
          Fix Version/s 1-win [ 12320361 ]
          Target Version/s 1.1.0 [ 12316501 ] 1-win [ 12320361 ]

            People

            • Assignee:
              Ivan Mitic
              Reporter:
              Ivan Mitic
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Development