Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8065 Support HDFS encryption functionality on Hive
  3. HIVE-8919

Fix FileUtils.copy() method to call distcp only for HDFS files (not local files)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: encryption-branch
    • Component/s: None
    • Labels:
      None

      Description

      When loading a big file (> 32Mb) from the local filesystem to the HDFS filesystem, Hive fails because the local filesystem cannot load the 'distcp' class.

      The 'distcp' class is used only by HDFS filesystem.

      We should use distcp only when copying files between the HDFS filesystem.

        Attachments

        1. CDH-23392.1.patch
          1 kB
          Sergio Peña

          Activity

            People

            • Assignee:
              spena Sergio Peña
              Reporter:
              spena Sergio Peña
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: