Hadoop Common
  1. Hadoop Common
  2. HADOOP-8261

Har file system doesn't deal with FS URIs with a host but no port

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.0-alpha
    • Component/s: fs
    • Labels:
      None

      Description

      If you try to run an MR job with a Hadoop Archive as the input, but the URI you give it has no port specified (e.g. "hdfs://simon") the job will fail with an error like the following:

      java.io.IOException: Incomplete HDFS URI, no host: hdfs://simon:-1/user/atm/input.har/input
      
      1. HADOOP-8261-with-test-in-HDFS.patch
        4 kB
        Aaron T. Myers
      2. HADOOP-8261.patch
        0.9 kB
        Aaron T. Myers
      3. HADOOP-8261.patch
        4 kB
        Aaron T. Myers

        Activity

        Aaron T. Myers created issue -
        Aaron T. Myers made changes -
        Field Original Value New Value
        Attachment HADOOP-8261.patch [ 12521806 ]
        Aaron T. Myers made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Aaron T. Myers made changes -
        Attachment HADOOP-8261-with-test-in-HDFS.patch [ 12521807 ]
        Aaron T. Myers made changes -
        Attachment HADOOP-8261.patch [ 12521910 ]
        Aaron T. Myers made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.0.0 [ 12320352 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Aaron T. Myers
            Reporter:
            Aaron T. Myers
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development