Sqoop
  1. Sqoop
  2. SQOOP-1033

CombineFileInputFormat does not work with paths not on default FS like ASV

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.4
    • Component/s: None
    • Labels:
      None

      Description

      CombineFileInputFormat does not work with ASV. This appeared as an issue in Sqoop which failed to export files in ASV. CombineFileInputFormat strips out the scheme and authority components of the path, after which point the path is assumed to be on the default file system.
      Sqoop has it own copy of CombineFileInputFormat, but updated the ones in core as well for consistency.

      There are currently already solved Jiras for the same issue:
      https://issues.apache.org/jira/browse/MAPREDUCE-2704
      https://issues.apache.org/jira/browse/MAPREDUCE-1806

      1. SQOOP-1033.3.patch
        0.8 kB
        Shuaishuai Nie
      2. SQOOP-1033.2.patch
        0.8 kB
        Shuaishuai Nie
      3. SQOOP-1033.1.patch
        0.7 kB
        Shuaishuai Nie

        Issue Links

          Activity

          Jarek Jarcec Cecho made changes -
          Fix Version/s 1.4.4 [ 12324082 ]
          Jarek Jarcec Cecho made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Jarek Jarcec Cecho made changes -
          Assignee Shuaishuai Nie [ shuainie ]
          Shuaishuai Nie made changes -
          Attachment SQOOP-1033.3.patch [ 12582528 ]
          Shuaishuai Nie made changes -
          Attachment SQOOP-1033.3.patch [ 12582527 ]
          Shuaishuai Nie made changes -
          Attachment SQOOP-1033.3.patch [ 12582527 ]
          Shuaishuai Nie made changes -
          Attachment SQOOP-1033.2.patch [ 12582315 ]
          Venkat Ranganathan made changes -
          Remote Link This issue links to "Review board link (Web Link)" [ 12202 ]
          Venkat Ranganathan made changes -
          Link This issue is duplicated by SQOOP-891 [ SQOOP-891 ]
          Venkat Ranganathan made changes -
          Link This issue is duplicated by SQOOP-891 [ SQOOP-891 ]
          Venkat Ranganathan made changes -
          Link This issue duplicates SQOOP-891 [ SQOOP-891 ]
          Shuaishuai Nie made changes -
          Description CombineFileInputFormat does not work with ASV. This appeared as an issue in Sqoop which failed to export files in ASV. CombineFileInputFormat strips out the scheme and authority components of the path, after which point the path is assumed to be on the default file system.
           Sqoop has it own copy of CombineFileInputFormat, but updated the ones in core as well for consistency.

          There are currently open Jiras for the same issue:
          https://issues.apache.org/jira/browse/MAPREDUCE-2704
          https://issues.apache.org/jira/browse/MAPREDUCE-1806
          CombineFileInputFormat does not work with ASV. This appeared as an issue in Sqoop which failed to export files in ASV. CombineFileInputFormat strips out the scheme and authority components of the path, after which point the path is assumed to be on the default file system.
           Sqoop has it own copy of CombineFileInputFormat, but updated the ones in core as well for consistency.

          There are currently already solved Jiras for the same issue:
          https://issues.apache.org/jira/browse/MAPREDUCE-2704
          https://issues.apache.org/jira/browse/MAPREDUCE-1806
          Shuaishuai Nie made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Shuaishuai Nie made changes -
          Field Original Value New Value
          Attachment SQOOP-1033.1.patch [ 12582116 ]
          Shuaishuai Nie created issue -

            People

            • Assignee:
              Shuaishuai Nie
              Reporter:
              Shuaishuai Nie
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development