Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1628

HarFileSystem shows incorrect replication numbers and permissions

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: harchive
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In the har dir, the replication # of part-0 is 3.

      -bash-3.1$ hadoop fs -ls  ${DIR}.har
      Found 3 items
      -rw-------   5 tsz users       1141 2010-02-10 18:34 /user/tsz/t20.har/_index
      -rw-------   5 tsz users         24 2010-02-10 18:34 /user/tsz/t20.har/_masterindex
      -rw-------   3 tsz users      15052 2010-02-10 18:34 /user/tsz/t20.har/part-0
      

      but the replication # of the individual har:// files is shown as 5.

      -bash-3.1$ hadoop fs -lsr  ${HAR_FULL}/
      drw-------   - tsz users          0 2010-02-10 18:34 /user/tsz/t20.har/t20
      -rw-------   5 tsz users        723 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000000
      -rw-------   5 tsz users        779 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000001
      -rw-------   5 tsz users        818 2010-02-10 18:34 /user/tsz/t20.har/t20/text-00000002
      ...
      

      The permission also has similar problem. Clearly, the permission of t20.har/t20 shown above is incorrect.

      1. m1628_20100329.patch
        6 kB
        Tsz Wo Nicholas Sze
      2. m1628_20100329b.patch
        6 kB
        Tsz Wo Nicholas Sze
      3. m1628_20100330.patch
        9 kB
        Tsz Wo Nicholas Sze
      4. m1628_20100331.patch
        9 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development