Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10425

Incompatible behavior of LocalFileSystem:getContentSummary

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • fs
    • None
    • Reviewed

    Description

      Unlike in Hadoop1, FilterFileSystem overrides getContentSummary, which causes content summary to be called on rawLocalFileSystem in Local mode.

      This impacts the computations of Stats in Hive with getting back FileSizes that include the size of the crc files.

      Attachments

        1. c10425_20140324.patch
          2 kB
          Tsz-wo Sze
        2. c10425_20140324b.patch
          3 kB
          Tsz-wo Sze

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5853 ChecksumFileSystem.getContentSummary() including contents for crc files

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-8014 ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary

          • Major - Major loss of function.
          • Closed

          Activity

            People

              szetszwo Tsz-wo Sze
              brandonli Brandon Li
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: