Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7646

HDFS truncate may remove data from the supposedly read-only previous/ directory during an upgrade

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Not A Problem
    • None
    • None
    • None
    • None

    Description

      During a DataNode layout version upgrade, HDFS creates hardlinks. These hardlinks allow the same block to be accessible from both the current/ and previous/ directories. Rollback is possible by deleting the current/ directory and renaming previous/ to current/.

      However, if the user truncates one of these hardlinked block files, it effectively eliminates the ability to roll back to the previous data.

      We probably need to disable truncation-in-place during a DataNode upgrade.

      Attachments

        Activity

          People

            Unassigned Unassigned
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: