Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5038

old API CombineFileInputFormat missing fixes that are in new API

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.1.1
    • Fix Version/s: 1.3.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The following changes patched the CombineFileInputFormat in mapreduce, but neglected the one in mapred
      MAPREDUCE-1597 enabled the CombineFileInputFormat to work on splittable files
      MAPREDUCE-2021 solved returning duplicate hostnames in split locations
      MAPREDUCE-1806 CombineFileInputFormat does not work with paths not on default FS

      In trunk this is not an issue as the one in mapred extends the one in mapreduce.

        Attachments

        1. MAPREDUCE-5038-revised-1.patch
          38 kB
          Sandy Ryza
        2. MAPREDUCE-5038-revised-1.patch
          38 kB
          Sandy Ryza
        3. MAPREDUCE-5038-revised.patch
          38 kB
          Sandy Ryza
        4. MAPREDUCE-5038-1.patch
          36 kB
          Sandy Ryza
        5. MAPREDUCE-5038.patch
          34 kB
          Sandy Ryza

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5046 backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5256 CombineInputFormat isn't thread safe affecting HiveServer

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                sandyr Sandy Ryza
                Reporter:
                sandyr Sandy Ryza
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated: