Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.15.3
    • Component/s: None
    • Labels:
      None

      Description

      bin/hadoop dfs -lsr /
      used to work but seems like its broken now. The output of this command just keeps on listing "/user" again and again and does not list any other files/directories.

        Activity

        Hide
        Konstantin Shvachko added a comment -

        The problem is with the data not the software.
        You have illegal sub-directory "/" inside /user. That is why it loops.

        bin/hadoop dfs -ls /user
        Found 7 items
        /user <dir>
        / <dir>
        /user/mahadev <dir>
        ....

        The entries were probably created prior to HADOOP-423, which fixed the problem.
        But I don't know how to get rid of this entries now when we do not allow them.
        I guess a custom code should be written.

        Show
        Konstantin Shvachko added a comment - The problem is with the data not the software. You have illegal sub-directory "/" inside /user. That is why it loops. bin/hadoop dfs -ls /user Found 7 items /user <dir> / <dir> /user/mahadev <dir> .... The entries were probably created prior to HADOOP-423 , which fixed the problem. But I don't know how to get rid of this entries now when we do not allow them. I guess a custom code should be written.
        Hide
        Konstantin Shvachko added a comment -

        Nobody else complained, but just in case I'd propose to include a deprecated method in FSImage
        that would delete files named ".", ".." and "/" if any when loading the image.

        Show
        Konstantin Shvachko added a comment - Nobody else complained, but just in case I'd propose to include a deprecated method in FSImage that would delete files named ".", ".." and "/" if any when loading the image.
        Hide
        Konstantin Shvachko added a comment -

        Another proposal is to make the removal of invalid files a part of fsck.

        Show
        Konstantin Shvachko added a comment - Another proposal is to make the removal of invalid files a part of fsck.
        Hide
        Mahadev konar added a comment -

        it seems like this issue has been resolved. SHould we close this ?

        Show
        Mahadev konar added a comment - it seems like this issue has been resolved. SHould we close this ?
        Hide
        Tsz Wo Nicholas Sze added a comment -

        >SHould we close this ?
        +1

        Show
        Tsz Wo Nicholas Sze added a comment - >SHould we close this ? +1
        Hide
        Mahadev konar added a comment -

        this has been fixed in 0.15 version.

        Show
        Mahadev konar added a comment - this has been fixed in 0.15 version.

          People

          • Assignee:
            Mahadev konar
            Reporter:
            Mahadev konar
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development