Hadoop Common
  1. Hadoop Common
  2. HADOOP-10425

Incompatible behavior of LocalFileSystem:getContentSummary

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.4.0
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Unlike in Hadoop1, FilterFileSystem overrides getContentSummary, which causes content summary to be called on rawLocalFileSystem in Local mode.

      This impacts the computations of Stats in Hive with getting back FileSizes that include the size of the crc files.

      1. c10425_20140324b.patch
        3 kB
        Tsz Wo Nicholas Sze
      2. c10425_20140324.patch
        2 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Brandon Li created issue -
          Brandon Li made changes -
          Field Original Value New Value
          Priority Major [ 3 ] Critical [ 2 ]
          Brandon Li made changes -
          Link This issue relates to HADOOP-8014 [ HADOOP-8014 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment c10425_20140324.patch [ 12636466 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment c10425_20140324b.patch [ 12636475 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.4.0 [ 12326144 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Jason Dere made changes -
          Link This issue relates to MAPREDUCE-5853 [ MAPREDUCE-5853 ]

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Brandon Li
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development