Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5038

old API CombineFileInputFormat missing fixes that are in new API

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • 1.1.1
    • 1.3.0
    • None
    • None
    • Reviewed

    Description

      The following changes patched the CombineFileInputFormat in mapreduce, but neglected the one in mapred
      MAPREDUCE-1597 enabled the CombineFileInputFormat to work on splittable files
      MAPREDUCE-2021 solved returning duplicate hostnames in split locations
      MAPREDUCE-1806 CombineFileInputFormat does not work with paths not on default FS

      In trunk this is not an issue as the one in mapred extends the one in mapreduce.

      Attachments

        1. MAPREDUCE-5038-revised-1.patch
          38 kB
          Sandy Ryza
        2. MAPREDUCE-5038-revised-1.patch
          38 kB
          Sandy Ryza
        3. MAPREDUCE-5038-revised.patch
          38 kB
          Sandy Ryza
        4. MAPREDUCE-5038-1.patch
          36 kB
          Sandy Ryza
        5. MAPREDUCE-5038.patch
          34 kB
          Sandy Ryza

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5046 backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5256 CombineInputFormat isn't thread safe affecting HiveServer

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sandyr Sandy Ryza
              sandyr Sandy Ryza
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated: