[HIVE-8919] Fix FileUtils.copy() method to call distcp only for HDFS files (not local files) - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: encryption-branch
Component/s: None
Labels:
None

Description

When loading a big file (> 32Mb) from the local filesystem to the HDFS filesystem, Hive fails because the local filesystem cannot load the 'distcp' class.

The 'distcp' class is used only by HDFS filesystem.

We should use distcp only when copying files between the HDFS filesystem.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

CDH-23392.1.patch
20/Nov/14 00:00
1 kB
Sergio Peña

Activity

People

Assignee:: Sergio Peña

Reporter:: Sergio Peña

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 19/Nov/14 23:55

Updated:: 20/Nov/14 06:10

Resolved:: 20/Nov/14 06:10