Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9084

TotalOrderPartitioner fails on hadoop running on top of gpfs (or any parallel or distributed filesystem)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 1.0.3, 1.0.4
    • None
    • filecache, fs
    • None

    Description

      When running a job who uses TotalOrderPartitioner (like TeraSort or BulkImport of HBase) on hadoop running on top of gpfs (instead of hdfs) the program fails to find the file _partition.lst because is looking for it in the wrong directory. The confusion is between local fs meaning not hdfs and local meaning distributed fs.

      Attachments

        Activity

          People

            surfercrs4 giovanni delussu
            surfercrs4 giovanni delussu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: