Hadoop Common
  1. Hadoop Common
  2. HADOOP-4395

Reloading FSImage and FSEditLog may erase user and group information

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.18.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The bug can be reproduced as following:

      bash-3.2$ ./bin/hadoop fs -lsr                 
      -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
      -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
      bash-3.2$ ./bin/hadoop fs -chown sze a.txt
      bash-3.2$ ./bin/hadoop fs -lsr
      -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
      -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
      

      Then, restart cluster ...

      bash-3.2$ ./bin/hadoop fs -lsr
      -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
      -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
      

      The group information for a.txt is missing.

      1. 4395_20081011_0.18.patch
        5 kB
        Tsz Wo Nicholas Sze
      2. 4395_20081011.patch
        5 kB
        Tsz Wo Nicholas Sze
      3. 4395_20081010.patch
        1 kB
        Tsz Wo Nicholas Sze

        Activity

        Owen O'Malley made changes -
        Component/s dfs [ 12310710 ]
        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Tsz Wo Nicholas Sze made changes -
        Hadoop Flags [Reviewed]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment 4395_20081011_0.18.patch [ 12392025 ]
        Tsz Wo Nicholas Sze made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Tsz Wo Nicholas Sze made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment 4395_20081011.patch [ 12391936 ]
        Tsz Wo Nicholas Sze made changes -
        Assignee Tsz Wo (Nicholas), SZE [ szetszwo ]
        Status Open [ 1 ] Patch Available [ 10002 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment 4395_20081010.patch [ 12391924 ]
        Tsz Wo Nicholas Sze made changes -
        Field Original Value New Value
        Component/s dfs [ 12310710 ]
        Description The bug can be reproduced as following:
        {noformat}
        bash-3.2$ ./bin/hadoop fs -lsr
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/a.txt
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/b.txt
        bash-3.2$ ./bin/hadoop fs -chown sze a.txt
        {noformat}
        Then, restart cluster ...
        {noformat}
        bash-3.2$ ./bin/hadoop fs -lsr
        -rw-r--r-- 3 sze 1366 2008-10-10 17:52 /user/tsz/a.txt
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/b.txt
        {noformat}
        The bug can be reproduced as following:
        {noformat}
        bash-3.2$ ./bin/hadoop fs -lsr
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/a.txt
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/b.txt
        bash-3.2$ ./bin/hadoop fs -chown sze a.txt
        bash-3.2$ ./bin/hadoop fs -lsr
        -rw-r--r-- 3 sze supergroup 1366 2008-10-10 17:52 /user/tsz/a.txt
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/b.txt
        {noformat}
        Then, restart cluster ...
        {noformat}
        bash-3.2$ ./bin/hadoop fs -lsr
        -rw-r--r-- 3 sze 1366 2008-10-10 17:52 /user/tsz/a.txt
        -rw-r--r-- 3 tsz supergroup 1366 2008-10-10 17:52 /user/tsz/b.txt
        {noformat}
        The group information for a.txt is missing.
        Tsz Wo Nicholas Sze created issue -

          People

          • Assignee:
            Tsz Wo Nicholas Sze
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development