Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-5709

Improve NameNode upgrade with existing reserved paths and path components

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.2.0
    • Fix Version/s: 2.4.0
    • Component/s: namenode
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      Right now in trunk, upgrade fails messily if the old fsimage or edits refer to a directory named ".snapshot". We should at least print a better error message (which I believe was the original intention in HDFS-4666), and Aaron T. Myers proposed automatically renaming these files and directories.

      1. hdfs-5709-addendum.patch
        1 kB
        Andrew Wang
      2. hdfs-5709-7.patch
        48 kB
        Andrew Wang
      3. hdfs-5709-6.patch
        43 kB
        Andrew Wang
      4. hdfs-5709-5.patch
        32 kB
        Andrew Wang
      5. hdfs-5709-4.patch
        35 kB
        Andrew Wang
      6. hdfs-5709-3.patch
        34 kB
        Andrew Wang
      7. hdfs-5709-2.patch
        31 kB
        Andrew Wang
      8. hdfs-5709-1.patch
        31 kB
        Andrew Wang

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-addendum.patch [ 12627190 ]
          Aaron T. Myers made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.4.0 [ 12326143 ]
          Resolution Fixed [ 1 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-7.patch [ 12627049 ]
          Andrew Wang made changes -
          Summary Improve upgrade with existing files and directories named ".snapshot" Improve NameNode upgrade with existing reserved paths and path components
          Akira AJISAKA made changes -
          Link This issue incorporates HDFS-5880 [ HDFS-5880 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-6.patch [ 12626425 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-6.patch [ 12626424 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-6.patch [ 12626424 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-5.patch [ 12624021 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-4.patch [ 12623987 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-3.patch [ 12623844 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-2.patch [ 12623493 ]
          Andrew Wang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Andrew Wang made changes -
          Attachment hdfs-5709-1.patch [ 12623011 ]
          Andrew Wang made changes -
          Assignee Andrew Wang [ andrew.wang ]
          Andrew Wang made changes -
          Field Original Value New Value
          Link This issue relates to HDFS-4666 [ HDFS-4666 ]
          Andrew Wang created issue -

            People

            • Assignee:
              Andrew Wang
              Reporter:
              Andrew Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development